Aug 04 17:46:54.980215 ip-10-0-141-117 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 17:46:55.351012 ip-10-0-141-117 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 17:46:55.351012 ip-10-0-141-117 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 17:46:55.351012 ip-10-0-141-117 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 17:46:55.351012 ip-10-0-141-117 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 17:46:55.351012 ip-10-0-141-117 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 17:46:55.352780 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.352693    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 17:46:55.360570 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360548    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:55.360570 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360565    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:55.360570 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360571    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:55.360570 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360575    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360579    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360583    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360588    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360592    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360596    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360600    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360605    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360609    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360613    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360617    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360621    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360625    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360630    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360634    2572 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360638    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360648    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360655    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360660    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360664    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:55.360803 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360668    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360673    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360677    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360681    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360686    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360690    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360695    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360699    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360704    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360709    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360713    2572 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360717    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360723    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360727    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360733    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360738    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360742    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360747    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360751    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360755    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:55.361639 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360759    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360763    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360767    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360772    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360776    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360781    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360785    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360797    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360802    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360806    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360810    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360815    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360819    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360823    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360827    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360831    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360835    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360840    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360844    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360848    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:55.362495 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360852    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360856    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360860    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360865    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360869    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360873    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360880    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360884    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360888    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360892    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360897    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360901    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360905    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360910    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360931    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360936    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360940    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360947    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360951    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360955    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:55.363341 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360969    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360975    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360980    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360986    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360991    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.360995    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.361000    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.361004    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.361008    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.361012    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.361016    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.361021    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.361025    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.361029    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.361036    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.361042    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362338    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362352    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362358    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:55.364218 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362363    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362368    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362373    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362378    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362382    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362386    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362391    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362395    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362399    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362404    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362408    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362413    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362417    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362422    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362434    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362439    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362443    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362448    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362452    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362456    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:55.365040 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362460    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362464    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362468    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362472    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362477    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362481    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362485    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362489    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362493    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362497    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362500    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362507    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362512    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362517    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362522    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362526    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362530    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362535    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362540    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362545    2572 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:55.365785 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362550    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362555    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362559    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362564    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362569    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362574    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362578    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362591    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362596    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362600    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362605    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362609    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362613    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362619    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362623    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362627    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362632    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362636    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362641    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:55.366379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362645    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362649    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362653    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362657    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362662    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362666    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362671    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362675    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362679    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362683    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362687    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362693    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362697    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362701    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362706    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362710    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362714    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362718    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362722    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:55.366849 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362726    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362730    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362744    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362749    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362753    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362757    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362761    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362765    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362769    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362774    2572 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362778    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362783    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362786    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362791    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362795    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362801    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362806    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.362813    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363485    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:55.367453 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363496    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363501    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363506    2572 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363511    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363516    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363522    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363527    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363531    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363535    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363539    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363544    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363548    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363552    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363557    2572 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363561    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363574    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363578    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363582    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363591    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:55.368078 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363595    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363599    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363604    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363608    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363612    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363616    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363620    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363624    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363628    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363632    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363636    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363641    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363645    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363649    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363653    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363657    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363661    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363666    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363674    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:55.368562 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363680    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363685    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363690    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363695    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363699    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363703    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363707    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363711    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363715    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363720    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363731    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363736    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363740    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363744    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363748    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363752    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363756    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363760    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363770    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363775    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:55.369121 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363779    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363783    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363787    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363791    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363795    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363800    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363804    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363808    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363812    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363816    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363820    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363824    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363828    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363832    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363837    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363841    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363846    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363850    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363854    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363858    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:55.369659 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363862    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363865    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363870    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363889    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363895    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363901    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363905    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363909    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363913    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363933    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363937    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363941    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363945    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363949    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363953    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363957    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363962    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363966    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363970    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.363975    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:55.370164 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364070    2572 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364081    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364093    2572 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364100    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364107    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364112    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364119    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364125    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364130    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364135    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364141    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364146    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364151    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364156    2572 flags.go:64] FLAG: --cgroup-root=""
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364160    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364165    2572 flags.go:64] FLAG: --client-ca-file=""
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364184    2572 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364190    2572 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364200    2572 flags.go:64] FLAG: --cluster-domain=""
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364205    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364210    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364214    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364220    2572 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364225    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 17:46:55.370634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364230    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364234    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364239    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364245    2572 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364251    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364256    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364261    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364265    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364272    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364277    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364281    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364285    2572 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364290    2572 flags.go:64] FLAG: --enable-server="true"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364295    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364306    2572 flags.go:64] FLAG: --event-burst="100"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364311    2572 flags.go:64] FLAG: --event-qps="50"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364316    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364320    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364325    2572 flags.go:64] FLAG: --eviction-hard=""
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364331    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364336    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364341    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364346    2572 flags.go:64] FLAG: --eviction-soft=""
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364351    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364356    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 17:46:55.371272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364368    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364373    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364377    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364382    2572 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364387    2572 flags.go:64] FLAG: --feature-gates=""
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364393    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364397    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364402    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364408    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364412    2572 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364420    2572 flags.go:64] FLAG: --help="false"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364429    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364434    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364439    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364444    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364450    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364455    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364460    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364464    2572 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364471    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364476    2572 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364481    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364486    2572 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364491    2572 flags.go:64] FLAG: --kube-reserved=""
Aug 04 17:46:55.371982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364495    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364500    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364505    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364510    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364514    2572 flags.go:64] FLAG: --lock-file=""
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364519    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364523    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364528    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364536    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364548    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364554    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364558    2572 flags.go:64] FLAG: --logging-format="text"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364563    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364568    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364572    2572 flags.go:64] FLAG: --manifest-url=""
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364577    2572 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364583    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364589    2572 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364596    2572 flags.go:64] FLAG: --max-pods="110"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364601    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364605    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364610    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364615    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364619    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364624    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 17:46:55.372566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364629    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364639    2572 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364647    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364651    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364656    2572 flags.go:64] FLAG: --pod-cidr=""
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364661    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364669    2572 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364674    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364678    2572 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364683    2572 flags.go:64] FLAG: --port="10250"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364688    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364692    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d1c8fb60ca5dc179"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364697    2572 flags.go:64] FLAG: --qos-reserved=""
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364703    2572 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364707    2572 flags.go:64] FLAG: --register-node="true"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364712    2572 flags.go:64] FLAG: --register-with-taints=""
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364718    2572 flags.go:64] FLAG: --registry-burst="10"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364729    2572 flags.go:64] FLAG: --registry-qps="5"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364734    2572 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364738    2572 flags.go:64] FLAG: --reserved-memory=""
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364744    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364749    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364754    2572 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364759    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364763    2572 flags.go:64] FLAG: --runonce="false"
Aug 04 17:46:55.373203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364768    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364774    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364780    2572 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364784    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364789    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364794    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364799    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364803    2572 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364808    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364814    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364818    2572 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364823    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364828    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364833    2572 flags.go:64] FLAG: --system-cgroups=""
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364837    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364846    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364850    2572 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364855    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364866    2572 flags.go:64] FLAG: --tls-min-version=""
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364871    2572 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364875    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364880    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364884    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364889    2572 flags.go:64] FLAG: --v="2"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364895    2572 flags.go:64] FLAG: --version="false"
Aug 04 17:46:55.373794 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364908    2572 flags.go:64] FLAG: --vmodule=""
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364931    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.364937    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365137    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365147    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365153    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365158    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365163    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365169    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365173    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365177    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365181    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365185    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365189    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365193    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365197    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365203    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365208    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365212    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365216    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:55.374465 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365220    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365224    2572 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365228    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365232    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365237    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365243    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365247    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365251    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365255    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365259    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365263    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365267    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365271    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365284    2572 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365288    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365293    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365297    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365302    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365306    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365310    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:55.374981 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365317    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365321    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365326    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365330    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365334    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365338    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365342    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365346    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365352    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365356    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365361    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365365    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365370    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365374    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365378    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365382    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365387    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365391    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365395    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365399    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:55.375461 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365403    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365408    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365412    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365416    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365420    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365424    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365433    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365438    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365443    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365447    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365451    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365456    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365462    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365466    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365470    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365474    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365478    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365483    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365487    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:55.375954 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365491    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365496    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365501    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365507    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365513    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365518    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365523    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365527    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365531    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365535    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365539    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365544    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365548    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365552    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365557    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365561    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365565    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365571    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365577    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:55.376441 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365582    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:55.376912 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365587    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:55.376912 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365591    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:55.376912 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.365596    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:55.376912 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.366162    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 17:46:55.376912 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.373102    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 17:46:55.376912 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.373117    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 17:46:55.376912 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.373937    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 17:46:55.376912 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.373944    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 17:46:55.376912 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374001    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:55.376912 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374006    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:55.376912 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374009    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:55.376912 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374012    2572 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:55.376912 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374015    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:55.376912 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374018    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:55.376912 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374021    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374023    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374026    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374028    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374031    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374034    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374037    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374039    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374042    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374044    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374047    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374050    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374053    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374055    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374058    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374061    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374064    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374066    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374070    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374073    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:55.377430 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374076    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374078    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374081    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374084    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374086    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374089    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374091    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374094    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374097    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374099    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374102    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374104    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374107    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374109    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374112    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374115    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374118    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374121    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374124    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:55.377907 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374127    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374130    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374132    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374135    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374137    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374140    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374144    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374148    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374158    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374161    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374164    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374167    2572 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374176    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374179    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374181    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374184    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374187    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374189    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374192    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374194    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:55.378379 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374198    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374202    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374205    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374208    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374211    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374214    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374217    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374220    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374222    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374231    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374234    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374237    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374240    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374243    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374245    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374248    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374250    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374253    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374255    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374258    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:55.378861 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374261    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:55.379359 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374263    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:55.379359 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374267    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:55.379359 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374271    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:55.379359 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374274    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:55.379359 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374277    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:55.379359 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374280    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:55.379359 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374282    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:55.379359 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374285    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:55.379359 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374287    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:55.379359 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374290    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:55.379359 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374293    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:55.379359 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374295    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:55.379359 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374298    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:55.379359 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.374303    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 17:46:55.379359 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374425    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374430    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374433    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374436    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374438    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374441    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374444    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374446    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374449    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374452    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374454    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374457    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374459    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374462    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374464    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374467    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374469    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374472    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374475    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374477    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:55.379734 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374482    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374485    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374488    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374492    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374494    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374497    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374500    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374503    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374507    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374509    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374512    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374515    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374517    2572 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374520    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374522    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374525    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374528    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374530    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374533    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374535    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:55.380220 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374538    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374540    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374543    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374545    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374548    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374550    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374553    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374555    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374558    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374560    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374563    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374565    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374568    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374571    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374573    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374576    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374579    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374581    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374584    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374587    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:55.380701 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374589    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374592    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374594    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374597    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374600    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374602    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374605    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374607    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374610    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374612    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374615    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374617    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374620    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374623    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374625    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374628    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374630    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374633    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374636    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:55.381191 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374638    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374641    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374643    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374645    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374648    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374651    2572 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374653    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374656    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374658    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374661    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374665    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374668    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374671    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374675    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374679    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374682    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374686    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374689    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374692    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:55.381638 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:55.374694    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:55.382164 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.374699    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 17:46:55.382164 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.374787    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 17:46:55.382164 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.376829    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 17:46:55.382164 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.378486    2572 server.go:1019] "Starting client certificate rotation"
Aug 04 17:46:55.382164 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.378591    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 17:46:55.382164 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.378626    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 17:46:55.382164 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.380758    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 17:46:55.385471 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.385453    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 17:46:55.399761 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.399743    2572 log.go:25] "Validated CRI v1 runtime API"
Aug 04 17:46:55.401600 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.401584    2572 log.go:25] "Validated CRI v1 image API"
Aug 04 17:46:55.402409 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.402389    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 17:46:55.404636 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.404611    2572 fs.go:135] Filesystem UUIDs: map[323b0376-7556-4ab9-bf68-c5fed8c73a54:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dbd61efc-7382-4a6e-8835-86f0bae7f543:/dev/nvme0n1p4]
Aug 04 17:46:55.404697 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.404638    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 17:46:55.405869 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.405849    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 17:46:55.410009 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.409892    2572 manager.go:216] Machine: {Timestamp:2026-08-04 17:46:55.408459513 +0000 UTC m=+0.318349113 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097808 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d841ea4c4d0780a88c73eaaa4b602 SystemUUID:ec2d841e-a4c4-d078-0a88-c73eaaa4b602 BootID:82cd57ff-8e38-4792-b8aa-34e76efe918f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e1:b6:6f:3a:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e1:b6:6f:3a:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:af:81:b8:fa:e1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 17:46:55.410009 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.410002    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 17:46:55.410114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.410071    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 17:46:55.413126 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.413099    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 17:46:55.413249 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.413129    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 17:46:55.413862 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.413852    2572 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 17:46:55.413895 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.413865    2572 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 17:46:55.413895 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.413872    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 17:46:55.414461 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.414451    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 17:46:55.415261 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.415251    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 17:46:55.418562 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.418550    2572 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 17:46:55.418681 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.418671    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 17:46:55.418716 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.418700    2572 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 17:46:55.418716 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.418714    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 17:46:55.418767 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.418725    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 17:46:55.418767 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.418733    2572 kubelet.go:398] "Adding apiserver pod source"
Aug 04 17:46:55.418767 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.418743    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 17:46:55.419187 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.419173    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 17:46:55.419246 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.419203    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 17:46:55.422138 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.422116    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 17:46:55.424887 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.424705    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 17:46:55.424887 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.424773    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 17:46:55.425321 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.425299    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8frst"
Aug 04 17:46:55.426218 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.426200    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 17:46:55.426335 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.426243    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 17:46:55.426335 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.426254    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 17:46:55.426335 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.426263    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 17:46:55.426335 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.426276    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 17:46:55.426335 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.426287    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 17:46:55.426335 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.426299    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 17:46:55.426335 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.426307    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 17:46:55.426335 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.426318    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 17:46:55.426335 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.426327    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 17:46:55.426335 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.426338    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 17:46:55.426611 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.426347    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 17:46:55.427077 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.427066    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 17:46:55.427129 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.427079    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 17:46:55.430167 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.430137    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 17:46:55.430411 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.430386    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 17:46:55.430495 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.430449    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 17:46:55.430495 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.430477    2572 server.go:1268] "Started kubelet"
Aug 04 17:46:55.430585 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.430512    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 17:46:55.430667 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.430615    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 17:46:55.430713 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.430688    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 17:46:55.431334 ip-10-0-141-117 systemd[1]: Started Kubernetes Kubelet.
Aug 04 17:46:55.431842 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.431820    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 17:46:55.433066 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.433051    2572 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 17:46:55.433066 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.433058    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8frst"
Aug 04 17:46:55.435046 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.435024    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 17:46:55.437372 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.437353    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 17:46:55.437372 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.436440    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-117.ec2.internal.18c8ab50b8510946  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-117.ec2.internal,UID:ip-10-0-141-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-117.ec2.internal,},FirstTimestamp:2026-08-04 17:46:55.430453574 +0000 UTC m=+0.340343155,LastTimestamp:2026-08-04 17:46:55.430453574 +0000 UTC m=+0.340343155,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-117.ec2.internal,}"
Aug 04 17:46:55.437523 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.437368    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 17:46:55.437523 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.437514    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-117.ec2.internal\" not found"
Aug 04 17:46:55.437995 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.437856    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 17:46:55.437995 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.437868    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 17:46:55.437995 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.437884    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 17:46:55.438173 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.438054    2572 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 17:46:55.438173 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.438063    2572 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 17:46:55.438173 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.438081    2572 factory.go:55] Registering systemd factory
Aug 04 17:46:55.438173 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.438096    2572 factory.go:223] Registration of the systemd container factory successfully
Aug 04 17:46:55.438347 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.438305    2572 factory.go:153] Registering CRI-O factory
Aug 04 17:46:55.438347 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.438317    2572 factory.go:223] Registration of the crio container factory successfully
Aug 04 17:46:55.438444 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.438366    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 17:46:55.438444 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.438398    2572 factory.go:103] Registering Raw factory
Aug 04 17:46:55.438444 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.438412    2572 manager.go:1196] Started watching for new ooms in manager
Aug 04 17:46:55.439344 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.439330    2572 manager.go:349] Starting recovery of all containers
Aug 04 17:46:55.441092 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.441073    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:55.444068 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.444049    2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-117.ec2.internal\" not found" node="ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.449982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.449811    2572 manager.go:354] Recovery completed
Aug 04 17:46:55.454327 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.454316    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:55.455818 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.455802    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:55.455870 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.455829    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:55.455870 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.455839    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:55.456371 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.456359    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 17:46:55.456416 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.456370    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 17:46:55.456416 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.456385    2572 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 17:46:55.456476 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.456429    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:55.457129 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.457113    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:55.457194 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.457143    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:55.457194 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.457157    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:55.457470 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.457458    2572 policy_none.go:49] "None policy: Start"
Aug 04 17:46:55.457508 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.457472    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 17:46:55.457508 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.457482    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 17:46:55.458397 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.458387    2572 policy_none.go:47] "Start"
Aug 04 17:46:55.492434 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.492417    2572 manager.go:337] "Starting Device Plugin manager"
Aug 04 17:46:55.492506 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.492443    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 17:46:55.492506 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.492452    2572 server.go:87] "Starting device plugin registration server"
Aug 04 17:46:55.492685 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.492672    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 17:46:55.492738 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.492686    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 17:46:55.492779 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.492760    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 17:46:55.492841 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.492830    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 17:46:55.492881 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.492841    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 17:46:55.493380 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.493360    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 17:46:55.493476 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.493409    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-117.ec2.internal\" not found"
Aug 04 17:46:55.591075 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.591033    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 17:46:55.592272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.592210    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 17:46:55.592272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.592255    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 17:46:55.592396 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.592281    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 17:46:55.592396 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.592322    2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 17:46:55.592773 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.592759    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:55.594048 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.594031    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:55.594137 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.594064    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:55.594137 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.594080    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:55.594137 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.594110    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.594534 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.594516    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:55.602131 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.602091    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.602131 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.602113    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-117.ec2.internal\": node \"ip-10-0-141-117.ec2.internal\" not found"
Aug 04 17:46:55.617625 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.617607    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-117.ec2.internal\" not found"
Aug 04 17:46:55.693696 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.693654    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-117.ec2.internal"]
Aug 04 17:46:55.693803 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.693734    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:55.695250 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.695233    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:55.695321 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.695265    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:55.695321 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.695276    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:55.696520 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.696507    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:55.696636 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.696621    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.696674 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.696657    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:55.697249 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.697232    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:55.697312 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.697264    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:55.697312 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.697275    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:55.697383 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.697232    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:55.697383 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.697343    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:55.697383 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.697357    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:55.698535 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.698520    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.698584 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.698546    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:55.699257 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.699242    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:55.699318 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.699277    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:55.699318 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.699296    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:55.718697 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.718677    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-117.ec2.internal\" not found"
Aug 04 17:46:55.723661 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.723645    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-117.ec2.internal\" not found" node="ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.728209 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.728191    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-117.ec2.internal\" not found" node="ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.738819 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.738799    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e68297ee54b15e4d72d8c3e3d25a5ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal\" (UID: \"3e68297ee54b15e4d72d8c3e3d25a5ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.738897 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.738850    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e68297ee54b15e4d72d8c3e3d25a5ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal\" (UID: \"3e68297ee54b15e4d72d8c3e3d25a5ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.738897 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.738890    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/739cbf3763c2362a5b179b6a7695be8f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-117.ec2.internal\" (UID: \"739cbf3763c2362a5b179b6a7695be8f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.818796 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.818770    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-117.ec2.internal\" not found"
Aug 04 17:46:55.839360 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.839335    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e68297ee54b15e4d72d8c3e3d25a5ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal\" (UID: \"3e68297ee54b15e4d72d8c3e3d25a5ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.839420 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.839365    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e68297ee54b15e4d72d8c3e3d25a5ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal\" (UID: \"3e68297ee54b15e4d72d8c3e3d25a5ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.839420 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.839382    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/739cbf3763c2362a5b179b6a7695be8f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-117.ec2.internal\" (UID: \"739cbf3763c2362a5b179b6a7695be8f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.839499 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.839433    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e68297ee54b15e4d72d8c3e3d25a5ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal\" (UID: \"3e68297ee54b15e4d72d8c3e3d25a5ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.839499 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.839444    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e68297ee54b15e4d72d8c3e3d25a5ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal\" (UID: \"3e68297ee54b15e4d72d8c3e3d25a5ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.839499 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:55.839493    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/739cbf3763c2362a5b179b6a7695be8f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-117.ec2.internal\" (UID: \"739cbf3763c2362a5b179b6a7695be8f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-117.ec2.internal"
Aug 04 17:46:55.920987 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:55.920902    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-117.ec2.internal\" not found"
Aug 04 17:46:56.027409 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:56.027360    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-117.ec2.internal\" not found"
Aug 04 17:46:56.027409 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:56.027372    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal"
Aug 04 17:46:56.032381 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:56.032224    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-117.ec2.internal"
Aug 04 17:46:56.127531 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:56.127491    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-117.ec2.internal\" not found"
Aug 04 17:46:56.229041 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:56.228968    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-117.ec2.internal\" not found"
Aug 04 17:46:56.299481 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:56.299449    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:56.330887 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:56.330857    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-117.ec2.internal\" not found"
Aug 04 17:46:56.380083 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:56.380040    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 17:46:56.380721 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:56.380246    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 17:46:56.380721 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:56.380242    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 17:46:56.380721 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:56.380247    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 17:46:56.431563 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:56.431522    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-117.ec2.internal\" not found"
Aug 04 17:46:56.435590 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:56.435566    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 17:41:56 +0000 UTC" deadline="2028-04-28 23:14:17.544380618 +0000 UTC"
Aug 04 17:46:56.435645 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:56.435591    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15197h27m21.108792936s"
Aug 04 17:46:56.532490 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:56.532460    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-117.ec2.internal\" not found"
Aug 04 17:46:56.631259 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:56.631217    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e68297ee54b15e4d72d8c3e3d25a5ea.slice/crio-d561f2f21bc8dc47610eded3855908dcf401bed9bf25edbc67cba94686f0fbe4 WatchSource:0}: Error finding container d561f2f21bc8dc47610eded3855908dcf401bed9bf25edbc67cba94686f0fbe4: Status 404 returned error can't find the container with id d561f2f21bc8dc47610eded3855908dcf401bed9bf25edbc67cba94686f0fbe4
Aug 04 17:46:56.631693 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:56.631668    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod739cbf3763c2362a5b179b6a7695be8f.slice/crio-fe728429efc183b3c4947d3d704a6eb11809715d61bcf31e648c8149d721fd95 WatchSource:0}: Error finding container fe728429efc183b3c4947d3d704a6eb11809715d61bcf31e648c8149d721fd95: Status 404 returned error can't find the container with id fe728429efc183b3c4947d3d704a6eb11809715d61bcf31e648c8149d721fd95
Aug 04 17:46:56.632860 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:56.632843    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-117.ec2.internal\" not found"
Aug 04 17:46:56.636544 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:56.636528    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 17:46:56.733674 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:56.733629    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-117.ec2.internal\" not found"
Aug 04 17:46:56.835805 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:56.835763    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-117.ec2.internal\" not found"
Aug 04 17:46:56.892104 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:56.892072    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:56.937679 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:56.937652    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal"
Aug 04 17:46:56.950108 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:56.950083    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 17:46:56.951057 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:56.951042    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-117.ec2.internal"
Aug 04 17:46:56.957395 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:56.957378    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 17:46:57.420266 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.420231    2572 apiserver.go:52] "Watching apiserver"
Aug 04 17:46:57.426936 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.426890    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 17:46:57.427413 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.427383    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal","openshift-multus/network-metrics-daemon-sftls","openshift-network-diagnostics/network-check-target-4l4mw","openshift-network-operator/iptables-alerter-kmnhw","openshift-ovn-kubernetes/ovnkube-node-mfjqr","kube-system/konnectivity-agent-znb94","kube-system/kube-apiserver-proxy-ip-10-0-141-117.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh","openshift-image-registry/node-ca-hhd6t","openshift-multus/multus-additional-cni-plugins-vnbxn","openshift-multus/multus-kzb4p","kube-system/global-pull-secret-syncer-q8sr8","openshift-cluster-node-tuning-operator/tuned-4x2k2","openshift-dns/node-resolver-v9vlx"]
Aug 04 17:46:57.429153 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.429126    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.430363 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.430339    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.431634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.431614    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 17:46:57.431822 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.431799    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bnhrq\""
Aug 04 17:46:57.431921 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.431904    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 17:46:57.432040 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.432023    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 17:46:57.432147 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.432132    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 17:46:57.432311 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.432281    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 17:46:57.432669 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.432650    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:46:57.432744 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:57.432725    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:46:57.433163 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.433132    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 17:46:57.433252 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.433168    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tt9dx\""
Aug 04 17:46:57.433551 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.433532    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 17:46:57.434722 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.434427    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kmnhw"
Aug 04 17:46:57.435935 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.435832    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.436719 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.436510    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 17:46:57.436719 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.436665    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-67nsf\""
Aug 04 17:46:57.436963 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.436928    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 17:46:57.436963 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.436939    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 17:46:57.437336 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.437241    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-znb94"
Aug 04 17:46:57.438861 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.438328    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 17:46:57.438861 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.438378    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 17:46:57.438861 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.438506    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 17:46:57.439648 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.439610    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 17:46:57.439871 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.439856    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 17:46:57.440095 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.440080    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hhd6t"
Aug 04 17:46:57.441687 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.439331    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qjgcm\""
Aug 04 17:46:57.442363 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.442343    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 17:46:57.442643 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.442622    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 17:46:57.443075 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.443058    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 17:46:57.443820 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.443799    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 17:46:57.443907 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.443836    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-g25ld\""
Aug 04 17:46:57.444033 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.444011    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 17:46:57.444115 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.444048    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 17:46:57.444183 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.444125    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 17:46:57.444546 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.444526    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v9vlx"
Aug 04 17:46:57.444633 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.444575    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j4jj8\""
Aug 04 17:46:57.446175 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.446153    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:46:57.446301 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:57.446246    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:46:57.447577 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.447551    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 17:46:57.448006 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.447987    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 17:46:57.448200 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448175    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d075b2ff-c092-4dd0-86ca-90badefc19e2-host\") pod \"node-ca-hhd6t\" (UID: \"d075b2ff-c092-4dd0-86ca-90badefc19e2\") " pod="openshift-image-registry/node-ca-hhd6t"
Aug 04 17:46:57.448275 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448218    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.448275 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448246    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.448393 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448273    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px92z\" (UniqueName: \"kubernetes.io/projected/63763418-db79-4049-a524-ab7fcd3c9949-kube-api-access-px92z\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.448393 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448298    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2kzj\" (UniqueName: \"kubernetes.io/projected/2589d8d1-41de-4a99-879b-30c3eba8be1c-kube-api-access-q2kzj\") pod \"iptables-alerter-kmnhw\" (UID: \"2589d8d1-41de-4a99-879b-30c3eba8be1c\") " pod="openshift-network-operator/iptables-alerter-kmnhw"
Aug 04 17:46:57.448393 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448331    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-env-overrides\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.448393 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448354    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d075b2ff-c092-4dd0-86ca-90badefc19e2-serviceca\") pod \"node-ca-hhd6t\" (UID: \"d075b2ff-c092-4dd0-86ca-90badefc19e2\") " pod="openshift-image-registry/node-ca-hhd6t"
Aug 04 17:46:57.448393 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448378    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.448648 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448402    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-sysctl-conf\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.448648 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448427    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-lib-modules\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.448648 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448450    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-run-systemd\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.448648 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448473    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-run-openvswitch\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.448648 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448496    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-run-ovn\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.448648 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448519    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-cni-bin\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.448648 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448543    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-ovn-node-metrics-cert\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.448648 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448574    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-ovnkube-script-lib\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.448648 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448602    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhd6x\" (UniqueName: \"kubernetes.io/projected/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-kube-api-access-mhd6x\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.448648 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448628    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-sysctl-d\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.448648 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448654    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-systemd-units\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.449178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448679    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-run-netns\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.449178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448711    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn69w\" (UniqueName: \"kubernetes.io/projected/d075b2ff-c092-4dd0-86ca-90badefc19e2-kube-api-access-bn69w\") pod \"node-ca-hhd6t\" (UID: \"d075b2ff-c092-4dd0-86ca-90badefc19e2\") " pod="openshift-image-registry/node-ca-hhd6t"
Aug 04 17:46:57.449178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448735    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-system-cni-dir\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.449178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448760    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.449178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448785    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-modprobe-d\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.449178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448808    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-systemd\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.449178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-kubelet\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.449178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448860    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.449178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448887    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp6pk\" (UniqueName: \"kubernetes.io/projected/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-kube-api-access-kp6pk\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.449178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448910    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-host\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.449178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448932    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63763418-db79-4049-a524-ab7fcd3c9949-tmp\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.449178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448955    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2589d8d1-41de-4a99-879b-30c3eba8be1c-host-slash\") pod \"iptables-alerter-kmnhw\" (UID: \"2589d8d1-41de-4a99-879b-30c3eba8be1c\") " pod="openshift-network-operator/iptables-alerter-kmnhw"
Aug 04 17:46:57.449178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448983    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-etc-openvswitch\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.449178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449029    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.449178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449060    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-cni-netd\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.449178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449094    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br2q7\" (UniqueName: \"kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7\") pod \"network-check-target-4l4mw\" (UID: \"b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc\") " pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449124    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-sysconfig\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449148    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-sys\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449172    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63763418-db79-4049-a524-ab7fcd3c9949-etc-tuned\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449200    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-log-socket\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449238    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-os-release\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449262    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1c74287e-62ab-4f8d-8f3b-55bce380c99d-agent-certs\") pod \"konnectivity-agent-znb94\" (UID: \"1c74287e-62ab-4f8d-8f3b-55bce380c99d\") " pod="kube-system/konnectivity-agent-znb94"
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449289    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1c74287e-62ab-4f8d-8f3b-55bce380c99d-konnectivity-ca\") pod \"konnectivity-agent-znb94\" (UID: \"1c74287e-62ab-4f8d-8f3b-55bce380c99d\") " pod="kube-system/konnectivity-agent-znb94"
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449314    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-kubernetes\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449339    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-run\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449363    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-var-lib-kubelet\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449389    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-slash\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.448183    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6thpr\""
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449632    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-var-lib-openvswitch\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449714    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-node-log\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449744    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-cnibin\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449774    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2589d8d1-41de-4a99-879b-30c3eba8be1c-iptables-alerter-script\") pod \"iptables-alerter-kmnhw\" (UID: \"2589d8d1-41de-4a99-879b-30c3eba8be1c\") " pod="openshift-network-operator/iptables-alerter-kmnhw"
Aug 04 17:46:57.449945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449803    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-ovnkube-config\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.450790 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.449849    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 17:46:57.450790 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.450112    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.450790 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.450408    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.451878 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.451857    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:46:57.451983 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:57.451933    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:46:57.456044 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.452515    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 17:46:57.456044 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.454295    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 17:46:57.456044 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.454307    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 17:46:57.456044 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.454404    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 17:46:57.456044 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.454483    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-49hhh\""
Aug 04 17:46:57.456044 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.454744    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bjc57\""
Aug 04 17:46:57.473551 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.473527    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qx9hh"
Aug 04 17:46:57.482613 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.482581    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qx9hh"
Aug 04 17:46:57.539540 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.539504    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 17:46:57.550750 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.550706    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-cnibin\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.550975 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.550774    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-var-lib-kubelet\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.550975 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.550801    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-cnibin\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.550975 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.550803    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-kubelet-config\") pod \"global-pull-secret-syncer-q8sr8\" (UID: \"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725\") " pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:46:57.550975 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.550864    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-multus-cni-dir\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.550975 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.550893    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-socket-dir\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.550975 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.550924    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-env-overrides\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.551430 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551034    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d075b2ff-c092-4dd0-86ca-90badefc19e2-serviceca\") pod \"node-ca-hhd6t\" (UID: \"d075b2ff-c092-4dd0-86ca-90badefc19e2\") " pod="openshift-image-registry/node-ca-hhd6t"
Aug 04 17:46:57.551430 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551083    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.551430 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551108    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-lib-modules\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.551430 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551138    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret\") pod \"global-pull-secret-syncer-q8sr8\" (UID: \"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725\") " pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:46:57.551430 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551165    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.551430 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551193    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-sys\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.551430 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551218    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-cni-bin\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.551430 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551244    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-ovn-node-metrics-cert\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.551430 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551269    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-ovnkube-script-lib\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.551430 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551298    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhd6x\" (UniqueName: \"kubernetes.io/projected/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-kube-api-access-mhd6x\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.551430 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551324    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b132d677-de62-4ae6-8819-70add7cd8664-tmp-dir\") pod \"node-resolver-v9vlx\" (UID: \"b132d677-de62-4ae6-8819-70add7cd8664\") " pod="openshift-dns/node-resolver-v9vlx"
Aug 04 17:46:57.551430 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551354    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-sys-fs\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.551430 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551384    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-run-netns\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.551430 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551411    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn69w\" (UniqueName: \"kubernetes.io/projected/d075b2ff-c092-4dd0-86ca-90badefc19e2-kube-api-access-bn69w\") pod \"node-ca-hhd6t\" (UID: \"d075b2ff-c092-4dd0-86ca-90badefc19e2\") " pod="openshift-image-registry/node-ca-hhd6t"
Aug 04 17:46:57.551430 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551437    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2589d8d1-41de-4a99-879b-30c3eba8be1c-host-slash\") pod \"iptables-alerter-kmnhw\" (UID: \"2589d8d1-41de-4a99-879b-30c3eba8be1c\") " pod="openshift-network-operator/iptables-alerter-kmnhw"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551464    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-system-cni-dir\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551491    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-multus-socket-dir-parent\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551523    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp6pk\" (UniqueName: \"kubernetes.io/projected/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-kube-api-access-kp6pk\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551552    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-var-lib-cni-bin\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551538    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-env-overrides\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551553    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d075b2ff-c092-4dd0-86ca-90badefc19e2-serviceca\") pod \"node-ca-hhd6t\" (UID: \"d075b2ff-c092-4dd0-86ca-90badefc19e2\") " pod="openshift-image-registry/node-ca-hhd6t"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551583    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-etc-openvswitch\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551613    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-cni-netd\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551638    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63763418-db79-4049-a524-ab7fcd3c9949-etc-tuned\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551655    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2589d8d1-41de-4a99-879b-30c3eba8be1c-host-slash\") pod \"iptables-alerter-kmnhw\" (UID: \"2589d8d1-41de-4a99-879b-30c3eba8be1c\") " pod="openshift-network-operator/iptables-alerter-kmnhw"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551698    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2kzj\" (UniqueName: \"kubernetes.io/projected/2589d8d1-41de-4a99-879b-30c3eba8be1c-kube-api-access-q2kzj\") pod \"iptables-alerter-kmnhw\" (UID: \"2589d8d1-41de-4a99-879b-30c3eba8be1c\") " pod="openshift-network-operator/iptables-alerter-kmnhw"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551705    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-cni-netd\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551731    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-os-release\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551760    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-run-k8s-cni-cncf-io\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551786    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-hostroot\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551837    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2241cc8-8250-4928-8766-3baa44e0244a-multus-daemon-config\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.552276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551860    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.551895    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-log-socket\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552035    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552210    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-lib-modules\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552269    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-etc-openvswitch\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552432    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-cni-bin\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552459    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-log-socket\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552476    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-os-release\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552507    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1c74287e-62ab-4f8d-8f3b-55bce380c99d-agent-certs\") pod \"konnectivity-agent-znb94\" (UID: \"1c74287e-62ab-4f8d-8f3b-55bce380c99d\") " pod="kube-system/konnectivity-agent-znb94"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552545    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1c74287e-62ab-4f8d-8f3b-55bce380c99d-konnectivity-ca\") pod \"konnectivity-agent-znb94\" (UID: \"1c74287e-62ab-4f8d-8f3b-55bce380c99d\") " pod="kube-system/konnectivity-agent-znb94"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552579    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-var-lib-kubelet\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552611    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-os-release\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552670    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-run-netns\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552685    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-var-lib-kubelet\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552706    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2241cc8-8250-4928-8766-3baa44e0244a-cni-binary-copy\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552710    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-ovnkube-script-lib\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552829    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-run-multus-certs\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552909    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-etc-kubernetes\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.553199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.552970    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-var-lib-openvswitch\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553056    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-var-lib-openvswitch\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553067    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-node-log\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553080    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-sys\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553122    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2589d8d1-41de-4a99-879b-30c3eba8be1c-iptables-alerter-script\") pod \"iptables-alerter-kmnhw\" (UID: \"2589d8d1-41de-4a99-879b-30c3eba8be1c\") " pod="openshift-network-operator/iptables-alerter-kmnhw"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553180    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-var-lib-cni-multus\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553214    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1c74287e-62ab-4f8d-8f3b-55bce380c99d-konnectivity-ca\") pod \"konnectivity-agent-znb94\" (UID: \"1c74287e-62ab-4f8d-8f3b-55bce380c99d\") " pod="kube-system/konnectivity-agent-znb94"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553212    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-node-log\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553269    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-etc-selinux\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553298    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-ovnkube-config\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553321    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d075b2ff-c092-4dd0-86ca-90badefc19e2-host\") pod \"node-ca-hhd6t\" (UID: \"d075b2ff-c092-4dd0-86ca-90badefc19e2\") " pod="openshift-image-registry/node-ca-hhd6t"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553344    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553450    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553490    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-dbus\") pod \"global-pull-secret-syncer-q8sr8\" (UID: \"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725\") " pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553514    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-registration-dir\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553540    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-sysctl-conf\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553560    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-systemd\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.554114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553583    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-run-systemd\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.554937 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553610    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-run-openvswitch\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.554937 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.553670    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-run-ovn\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.554937 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.554178    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d075b2ff-c092-4dd0-86ca-90badefc19e2-host\") pod \"node-ca-hhd6t\" (UID: \"d075b2ff-c092-4dd0-86ca-90badefc19e2\") " pod="openshift-image-registry/node-ca-hhd6t"
Aug 04 17:46:57.554937 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.554236    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-sysctl-d\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.554937 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.554287    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-systemd-units\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.554937 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.554316    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-system-cni-dir\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.554937 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.554349    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.554937 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.554465    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.554937 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.554477    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-modprobe-d\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.554937 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.554718    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-ovnkube-config\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.555495 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.554956    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.555495 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.555051    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-sysctl-conf\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.555495 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.555060    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-run-ovn\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.555495 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.555084    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2589d8d1-41de-4a99-879b-30c3eba8be1c-iptables-alerter-script\") pod \"iptables-alerter-kmnhw\" (UID: \"2589d8d1-41de-4a99-879b-30c3eba8be1c\") " pod="openshift-network-operator/iptables-alerter-kmnhw"
Aug 04 17:46:57.555495 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.555151    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-run-openvswitch\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.555495 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.555152    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-systemd\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.555495 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.555197    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-run-systemd\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.555495 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.555231    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-systemd-units\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.555495 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.555268    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-system-cni-dir\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.555495 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.555335    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-sysctl-d\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.556019 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.555735    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.556019 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.555830    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-modprobe-d\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.556019 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.555891    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-cnibin\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.556019 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.555942    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smfrp\" (UniqueName: \"kubernetes.io/projected/b132d677-de62-4ae6-8819-70add7cd8664-kube-api-access-smfrp\") pod \"node-resolver-v9vlx\" (UID: \"b132d677-de62-4ae6-8819-70add7cd8664\") " pod="openshift-dns/node-resolver-v9vlx"
Aug 04 17:46:57.556019 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.555978    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-device-dir\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.556285 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556012    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-kubelet\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.556285 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556064    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.556285 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556117    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-host\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.556285 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556154    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63763418-db79-4049-a524-ab7fcd3c9949-tmp\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.556285 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556222    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-run-netns\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.556285 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556258    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-multus-conf-dir\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.556602 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556292    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz48p\" (UniqueName: \"kubernetes.io/projected/f2241cc8-8250-4928-8766-3baa44e0244a-kube-api-access-sz48p\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.556602 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556334    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkcz8\" (UniqueName: \"kubernetes.io/projected/22e7de3d-a8d4-40a0-aad0-88b9c053f316-kube-api-access-pkcz8\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.556602 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556368    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.556602 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556396    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br2q7\" (UniqueName: \"kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7\") pod \"network-check-target-4l4mw\" (UID: \"b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc\") " pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:46:57.556602 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556430    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-sysconfig\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.556602 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556474    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px92z\" (UniqueName: \"kubernetes.io/projected/63763418-db79-4049-a524-ab7fcd3c9949-kube-api-access-px92z\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.556602 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556521    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs\") pod \"network-metrics-daemon-sftls\" (UID: \"7acf398c-a516-4d37-9792-38cf40564333\") " pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:46:57.556931 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556672    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b132d677-de62-4ae6-8819-70add7cd8664-hosts-file\") pod \"node-resolver-v9vlx\" (UID: \"b132d677-de62-4ae6-8819-70add7cd8664\") " pod="openshift-dns/node-resolver-v9vlx"
Aug 04 17:46:57.556931 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556716    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-kubernetes\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.556931 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556762    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-run\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.556931 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556771    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63763418-db79-4049-a524-ab7fcd3c9949-etc-tuned\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.556931 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556858    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4xg9\" (UniqueName: \"kubernetes.io/projected/7acf398c-a516-4d37-9792-38cf40564333-kube-api-access-g4xg9\") pod \"network-metrics-daemon-sftls\" (UID: \"7acf398c-a516-4d37-9792-38cf40564333\") " pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:46:57.556931 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556894    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-kubelet\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.556931 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556909    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-slash\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.557189 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.556952    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.557189 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.557064    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.557189 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.557103    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-kubernetes\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.557287 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.557200    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-run\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.557287 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.557279    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-host-slash\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.557358 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.557332    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-host\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.557392 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.557363    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63763418-db79-4049-a524-ab7fcd3c9949-etc-sysconfig\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.560122 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.559382    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1c74287e-62ab-4f8d-8f3b-55bce380c99d-agent-certs\") pod \"konnectivity-agent-znb94\" (UID: \"1c74287e-62ab-4f8d-8f3b-55bce380c99d\") " pod="kube-system/konnectivity-agent-znb94"
Aug 04 17:46:57.561054 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.561028    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63763418-db79-4049-a524-ab7fcd3c9949-tmp\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.562832 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:57.562790    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:46:57.562944 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:57.562862    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:46:57.562944 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:57.562885    2572 projected.go:196] Error preparing data for projected volume kube-api-access-br2q7 for pod openshift-network-diagnostics/network-check-target-4l4mw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:57.563069 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:57.563052    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7 podName:b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc nodeName:}" failed. No retries permitted until 2026-08-04 17:46:58.063005406 +0000 UTC m=+2.972894992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-br2q7" (UniqueName: "kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7") pod "network-check-target-4l4mw" (UID: "b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:57.563276 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.563213    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn69w\" (UniqueName: \"kubernetes.io/projected/d075b2ff-c092-4dd0-86ca-90badefc19e2-kube-api-access-bn69w\") pod \"node-ca-hhd6t\" (UID: \"d075b2ff-c092-4dd0-86ca-90badefc19e2\") " pod="openshift-image-registry/node-ca-hhd6t"
Aug 04 17:46:57.563738 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.563712    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-ovn-node-metrics-cert\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.564233 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.564209    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp6pk\" (UniqueName: \"kubernetes.io/projected/4cce1fb4-a6cb-4481-b1e2-a828f22547b3-kube-api-access-kp6pk\") pod \"ovnkube-node-mfjqr\" (UID: \"4cce1fb4-a6cb-4481-b1e2-a828f22547b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.565013 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.564989    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2kzj\" (UniqueName: \"kubernetes.io/projected/2589d8d1-41de-4a99-879b-30c3eba8be1c-kube-api-access-q2kzj\") pod \"iptables-alerter-kmnhw\" (UID: \"2589d8d1-41de-4a99-879b-30c3eba8be1c\") " pod="openshift-network-operator/iptables-alerter-kmnhw"
Aug 04 17:46:57.566582 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.566556    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px92z\" (UniqueName: \"kubernetes.io/projected/63763418-db79-4049-a524-ab7fcd3c9949-kube-api-access-px92z\") pod \"tuned-4x2k2\" (UID: \"63763418-db79-4049-a524-ab7fcd3c9949\") " pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.567030 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.567002    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhd6x\" (UniqueName: \"kubernetes.io/projected/d075f732-ebb5-4bee-bd7a-4ebf3427dc6a-kube-api-access-mhd6x\") pod \"multus-additional-cni-plugins-vnbxn\" (UID: \"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a\") " pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.597769 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.597711    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal" event={"ID":"3e68297ee54b15e4d72d8c3e3d25a5ea","Type":"ContainerStarted","Data":"d561f2f21bc8dc47610eded3855908dcf401bed9bf25edbc67cba94686f0fbe4"}
Aug 04 17:46:57.599154 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.599090    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-117.ec2.internal" event={"ID":"739cbf3763c2362a5b179b6a7695be8f","Type":"ContainerStarted","Data":"fe728429efc183b3c4947d3d704a6eb11809715d61bcf31e648c8149d721fd95"}
Aug 04 17:46:57.655241 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.655208    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:57.657448 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657422    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs\") pod \"network-metrics-daemon-sftls\" (UID: \"7acf398c-a516-4d37-9792-38cf40564333\") " pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:46:57.657579 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657460    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b132d677-de62-4ae6-8819-70add7cd8664-hosts-file\") pod \"node-resolver-v9vlx\" (UID: \"b132d677-de62-4ae6-8819-70add7cd8664\") " pod="openshift-dns/node-resolver-v9vlx"
Aug 04 17:46:57.657579 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657491    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4xg9\" (UniqueName: \"kubernetes.io/projected/7acf398c-a516-4d37-9792-38cf40564333-kube-api-access-g4xg9\") pod \"network-metrics-daemon-sftls\" (UID: \"7acf398c-a516-4d37-9792-38cf40564333\") " pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:46:57.657579 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657521    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-var-lib-kubelet\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.657579 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657547    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-kubelet-config\") pod \"global-pull-secret-syncer-q8sr8\" (UID: \"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725\") " pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:46:57.657756 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657590    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-multus-cni-dir\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.657756 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657617    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-socket-dir\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.657756 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:57.657627    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:57.657756 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657646    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret\") pod \"global-pull-secret-syncer-q8sr8\" (UID: \"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725\") " pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:46:57.657756 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657670    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.657756 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657672    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-var-lib-kubelet\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.657756 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:57.657694    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs podName:7acf398c-a516-4d37-9792-38cf40564333 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:58.157673603 +0000 UTC m=+3.067563185 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs") pod "network-metrics-daemon-sftls" (UID: "7acf398c-a516-4d37-9792-38cf40564333") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:57.657756 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657730    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b132d677-de62-4ae6-8819-70add7cd8664-tmp-dir\") pod \"node-resolver-v9vlx\" (UID: \"b132d677-de62-4ae6-8819-70add7cd8664\") " pod="openshift-dns/node-resolver-v9vlx"
Aug 04 17:46:57.657756 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657738    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-kubelet-config\") pod \"global-pull-secret-syncer-q8sr8\" (UID: \"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725\") " pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:46:57.657756 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657755    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-sys-fs\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.658274 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657782    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-system-cni-dir\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.658274 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657805    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-multus-socket-dir-parent\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.658274 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657832    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-var-lib-cni-bin\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.658274 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657842    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-socket-dir\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.658274 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657861    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-os-release\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.658274 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657879    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-multus-cni-dir\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.658274 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657885    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-run-k8s-cni-cncf-io\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.658274 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657910    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-hostroot\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.658274 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:57.657927    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:57.658274 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657933    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2241cc8-8250-4928-8766-3baa44e0244a-multus-daemon-config\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.658274 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:57.657981    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret podName:7a807e47-6a40-4d63-bc6f-3d2b1c5a3725 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:58.157965378 +0000 UTC m=+3.067854959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret") pod "global-pull-secret-syncer-q8sr8" (UID: "7a807e47-6a40-4d63-bc6f-3d2b1c5a3725") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:57.658274 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658010    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.658274 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658013    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2241cc8-8250-4928-8766-3baa44e0244a-cni-binary-copy\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.658274 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.657623    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b132d677-de62-4ae6-8819-70add7cd8664-hosts-file\") pod \"node-resolver-v9vlx\" (UID: \"b132d677-de62-4ae6-8819-70add7cd8664\") " pod="openshift-dns/node-resolver-v9vlx"
Aug 04 17:46:57.658274 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658039    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-run-multus-certs\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.658274 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658229    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-var-lib-cni-bin\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658308    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-multus-socket-dir-parent\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658347    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-etc-kubernetes\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658372    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-var-lib-cni-multus\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658392    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-etc-selinux\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658415    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b132d677-de62-4ae6-8819-70add7cd8664-tmp-dir\") pod \"node-resolver-v9vlx\" (UID: \"b132d677-de62-4ae6-8819-70add7cd8664\") " pod="openshift-dns/node-resolver-v9vlx"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658454    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-dbus\") pod \"global-pull-secret-syncer-q8sr8\" (UID: \"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725\") " pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658483    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-registration-dir\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658527    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-etc-selinux\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658545    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-sys-fs\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658560    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-run-multus-certs\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658584    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-etc-kubernetes\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658596    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-system-cni-dir\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658608    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-var-lib-cni-multus\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658636    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-run-k8s-cni-cncf-io\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658654    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2241cc8-8250-4928-8766-3baa44e0244a-cni-binary-copy\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658696    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-os-release\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658728    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-dbus\") pod \"global-pull-secret-syncer-q8sr8\" (UID: \"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725\") " pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:46:57.659168 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658741    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-hostroot\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.660081 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658777    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-registration-dir\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.660081 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658797    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-cnibin\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.660081 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658881    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smfrp\" (UniqueName: \"kubernetes.io/projected/b132d677-de62-4ae6-8819-70add7cd8664-kube-api-access-smfrp\") pod \"node-resolver-v9vlx\" (UID: \"b132d677-de62-4ae6-8819-70add7cd8664\") " pod="openshift-dns/node-resolver-v9vlx"
Aug 04 17:46:57.660081 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.658912    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-device-dir\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.660081 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.659004    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/22e7de3d-a8d4-40a0-aad0-88b9c053f316-device-dir\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.660081 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.659081    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-cnibin\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.660081 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.659262    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2241cc8-8250-4928-8766-3baa44e0244a-multus-daemon-config\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.660081 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.659301    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-run-netns\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.660081 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.659328    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-multus-conf-dir\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.660081 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.659354    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz48p\" (UniqueName: \"kubernetes.io/projected/f2241cc8-8250-4928-8766-3baa44e0244a-kube-api-access-sz48p\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.660081 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.659369    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-host-run-netns\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.660081 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.659381    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkcz8\" (UniqueName: \"kubernetes.io/projected/22e7de3d-a8d4-40a0-aad0-88b9c053f316-kube-api-access-pkcz8\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.660081 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.659428    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2241cc8-8250-4928-8766-3baa44e0244a-multus-conf-dir\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.669863 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.669806    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smfrp\" (UniqueName: \"kubernetes.io/projected/b132d677-de62-4ae6-8819-70add7cd8664-kube-api-access-smfrp\") pod \"node-resolver-v9vlx\" (UID: \"b132d677-de62-4ae6-8819-70add7cd8664\") " pod="openshift-dns/node-resolver-v9vlx"
Aug 04 17:46:57.669863 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.669826    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz48p\" (UniqueName: \"kubernetes.io/projected/f2241cc8-8250-4928-8766-3baa44e0244a-kube-api-access-sz48p\") pod \"multus-kzb4p\" (UID: \"f2241cc8-8250-4928-8766-3baa44e0244a\") " pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:57.670076 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.669930    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4xg9\" (UniqueName: \"kubernetes.io/projected/7acf398c-a516-4d37-9792-38cf40564333-kube-api-access-g4xg9\") pod \"network-metrics-daemon-sftls\" (UID: \"7acf398c-a516-4d37-9792-38cf40564333\") " pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:46:57.670722 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.670660    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkcz8\" (UniqueName: \"kubernetes.io/projected/22e7de3d-a8d4-40a0-aad0-88b9c053f316-kube-api-access-pkcz8\") pod \"aws-ebs-csi-driver-node-r6dsh\" (UID: \"22e7de3d-a8d4-40a0-aad0-88b9c053f316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.749887 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.749853    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vnbxn"
Aug 04 17:46:57.756700 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.756673    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4x2k2"
Aug 04 17:46:57.768906 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.768877    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kmnhw"
Aug 04 17:46:57.775905 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.775881    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:46:57.783004 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.782978    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-znb94"
Aug 04 17:46:57.793039 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.793009    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hhd6t"
Aug 04 17:46:57.796935 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.796910    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:57.802909 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.802886    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v9vlx"
Aug 04 17:46:57.818127 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.818098    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh"
Aug 04 17:46:57.825209 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:57.825183    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kzb4p"
Aug 04 17:46:58.063702 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:58.063667    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br2q7\" (UniqueName: \"kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7\") pod \"network-check-target-4l4mw\" (UID: \"b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc\") " pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:46:58.063889 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:58.063852    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:46:58.063889 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:58.063877    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:46:58.063889 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:58.063886    2572 projected.go:196] Error preparing data for projected volume kube-api-access-br2q7 for pod openshift-network-diagnostics/network-check-target-4l4mw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:58.064035 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:58.063979    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7 podName:b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc nodeName:}" failed. No retries permitted until 2026-08-04 17:46:59.063955904 +0000 UTC m=+3.973845484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-br2q7" (UniqueName: "kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7") pod "network-check-target-4l4mw" (UID: "b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:58.112482 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:58.112446    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:58.165019 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:58.164988    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs\") pod \"network-metrics-daemon-sftls\" (UID: \"7acf398c-a516-4d37-9792-38cf40564333\") " pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:46:58.165198 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:58.165026    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret\") pod \"global-pull-secret-syncer-q8sr8\" (UID: \"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725\") " pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:46:58.165198 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:58.165153    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:58.165311 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:58.165221    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs podName:7acf398c-a516-4d37-9792-38cf40564333 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:59.165205064 +0000 UTC m=+4.075094632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs") pod "network-metrics-daemon-sftls" (UID: "7acf398c-a516-4d37-9792-38cf40564333") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:58.165311 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:58.165156    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:58.165399 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:58.165320    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret podName:7a807e47-6a40-4d63-bc6f-3d2b1c5a3725 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:59.165305112 +0000 UTC m=+4.075194682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret") pod "global-pull-secret-syncer-q8sr8" (UID: "7a807e47-6a40-4d63-bc6f-3d2b1c5a3725") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:58.485184 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:58.485089    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 17:41:58 +0000 UTC" deadline="2028-04-30 01:58:20.016535072 +0000 UTC"
Aug 04 17:46:58.485184 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:58.485121    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15224h11m21.531419126s"
Aug 04 17:46:58.594249 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:58.594216    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:46:58.594426 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:58.594324    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:46:58.594426 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:58.594391    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:46:58.594571 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:58.594535    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:46:58.644331 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:58.644292    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2241cc8_8250_4928_8766_3baa44e0244a.slice/crio-34b3845a3f7edeadd899751a722ac11f542984146f0ec7418c57c245b5d29d40 WatchSource:0}: Error finding container 34b3845a3f7edeadd899751a722ac11f542984146f0ec7418c57c245b5d29d40: Status 404 returned error can't find the container with id 34b3845a3f7edeadd899751a722ac11f542984146f0ec7418c57c245b5d29d40
Aug 04 17:46:58.647057 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:58.646969    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2589d8d1_41de_4a99_879b_30c3eba8be1c.slice/crio-b758c5a7137df6dc15fb202be485b5c57188116ec457a0a3d5aaf0593bc284e5 WatchSource:0}: Error finding container b758c5a7137df6dc15fb202be485b5c57188116ec457a0a3d5aaf0593bc284e5: Status 404 returned error can't find the container with id b758c5a7137df6dc15fb202be485b5c57188116ec457a0a3d5aaf0593bc284e5
Aug 04 17:46:58.650427 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:58.650401    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c74287e_62ab_4f8d_8f3b_55bce380c99d.slice/crio-2807e2bcad6a3a80bee7c8ef5f5af03b3d00029371aa3d51a5d8e7414e1d79cc WatchSource:0}: Error finding container 2807e2bcad6a3a80bee7c8ef5f5af03b3d00029371aa3d51a5d8e7414e1d79cc: Status 404 returned error can't find the container with id 2807e2bcad6a3a80bee7c8ef5f5af03b3d00029371aa3d51a5d8e7414e1d79cc
Aug 04 17:46:58.651101 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:58.650977    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd075b2ff_c092_4dd0_86ca_90badefc19e2.slice/crio-714e18368d3e15e0a8826cd391b0a0c3228482e675af0caaf8d0e838dbec873d WatchSource:0}: Error finding container 714e18368d3e15e0a8826cd391b0a0c3228482e675af0caaf8d0e838dbec873d: Status 404 returned error can't find the container with id 714e18368d3e15e0a8826cd391b0a0c3228482e675af0caaf8d0e838dbec873d
Aug 04 17:46:58.652419 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:58.652393    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63763418_db79_4049_a524_ab7fcd3c9949.slice/crio-872da6182483759e2bbe1e8a9ac2532b7de112eaca0f3974621a3b0e6620673e WatchSource:0}: Error finding container 872da6182483759e2bbe1e8a9ac2532b7de112eaca0f3974621a3b0e6620673e: Status 404 returned error can't find the container with id 872da6182483759e2bbe1e8a9ac2532b7de112eaca0f3974621a3b0e6620673e
Aug 04 17:46:58.653968 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:58.653588    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd075f732_ebb5_4bee_bd7a_4ebf3427dc6a.slice/crio-a44f2171ce52097a6c62c442056e126a84bc62490899a2e52db84c10f751e9a5 WatchSource:0}: Error finding container a44f2171ce52097a6c62c442056e126a84bc62490899a2e52db84c10f751e9a5: Status 404 returned error can't find the container with id a44f2171ce52097a6c62c442056e126a84bc62490899a2e52db84c10f751e9a5
Aug 04 17:46:58.659298 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:46:58.659158    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e7de3d_a8d4_40a0_aad0_88b9c053f316.slice/crio-9804bfb4f29845909da25ce4ab361a71f977cabd681031929b61bc33e1948a97 WatchSource:0}: Error finding container 9804bfb4f29845909da25ce4ab361a71f977cabd681031929b61bc33e1948a97: Status 404 returned error can't find the container with id 9804bfb4f29845909da25ce4ab361a71f977cabd681031929b61bc33e1948a97
Aug 04 17:46:59.071210 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.071166    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br2q7\" (UniqueName: \"kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7\") pod \"network-check-target-4l4mw\" (UID: \"b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc\") " pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:46:59.071389 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:59.071368    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:46:59.071453 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:59.071396    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:46:59.071453 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:59.071412    2572 projected.go:196] Error preparing data for projected volume kube-api-access-br2q7 for pod openshift-network-diagnostics/network-check-target-4l4mw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:59.071571 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:59.071489    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7 podName:b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc nodeName:}" failed. No retries permitted until 2026-08-04 17:47:01.071469299 +0000 UTC m=+5.981358890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-br2q7" (UniqueName: "kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7") pod "network-check-target-4l4mw" (UID: "b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:59.172655 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.172501    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs\") pod \"network-metrics-daemon-sftls\" (UID: \"7acf398c-a516-4d37-9792-38cf40564333\") " pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:46:59.172655 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.172565    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret\") pod \"global-pull-secret-syncer-q8sr8\" (UID: \"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725\") " pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:46:59.172886 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:59.172708    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:59.172886 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:59.172710    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:59.172886 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:59.172779    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret podName:7a807e47-6a40-4d63-bc6f-3d2b1c5a3725 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:01.172758816 +0000 UTC m=+6.082648387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret") pod "global-pull-secret-syncer-q8sr8" (UID: "7a807e47-6a40-4d63-bc6f-3d2b1c5a3725") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:59.172886 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:59.172802    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs podName:7acf398c-a516-4d37-9792-38cf40564333 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:01.172790607 +0000 UTC m=+6.082680183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs") pod "network-metrics-daemon-sftls" (UID: "7acf398c-a516-4d37-9792-38cf40564333") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:59.486288 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.486131    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 17:41:58 +0000 UTC" deadline="2028-05-03 04:38:36.573542224 +0000 UTC"
Aug 04 17:46:59.486288 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.486202    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15298h51m37.087345673s"
Aug 04 17:46:59.595232 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.595194    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:46:59.595429 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:46:59.595359    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:46:59.615567 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.614660    2572 generic.go:356] "Generic (PLEG): container finished" podID="3e68297ee54b15e4d72d8c3e3d25a5ea" containerID="6df23a095376b946d6941fab5f50c34889ecee85cf456cc64d9c528a818d6f4e" exitCode=0
Aug 04 17:46:59.615567 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.614751    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal" event={"ID":"3e68297ee54b15e4d72d8c3e3d25a5ea","Type":"ContainerDied","Data":"6df23a095376b946d6941fab5f50c34889ecee85cf456cc64d9c528a818d6f4e"}
Aug 04 17:46:59.637311 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.637274    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh" event={"ID":"22e7de3d-a8d4-40a0-aad0-88b9c053f316","Type":"ContainerStarted","Data":"9804bfb4f29845909da25ce4ab361a71f977cabd681031929b61bc33e1948a97"}
Aug 04 17:46:59.665965 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.665886    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr" event={"ID":"4cce1fb4-a6cb-4481-b1e2-a828f22547b3","Type":"ContainerStarted","Data":"0c731eab14d8a2f78992d3fff8eb34fb7b115510a594949c1e6dafb133bf1f7b"}
Aug 04 17:46:59.677843 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.677709    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vnbxn" event={"ID":"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a","Type":"ContainerStarted","Data":"a44f2171ce52097a6c62c442056e126a84bc62490899a2e52db84c10f751e9a5"}
Aug 04 17:46:59.694829 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.694700    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4x2k2" event={"ID":"63763418-db79-4049-a524-ab7fcd3c9949","Type":"ContainerStarted","Data":"872da6182483759e2bbe1e8a9ac2532b7de112eaca0f3974621a3b0e6620673e"}
Aug 04 17:46:59.720516 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.720474    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-znb94" event={"ID":"1c74287e-62ab-4f8d-8f3b-55bce380c99d","Type":"ContainerStarted","Data":"2807e2bcad6a3a80bee7c8ef5f5af03b3d00029371aa3d51a5d8e7414e1d79cc"}
Aug 04 17:46:59.740693 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.740606    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kmnhw" event={"ID":"2589d8d1-41de-4a99-879b-30c3eba8be1c","Type":"ContainerStarted","Data":"b758c5a7137df6dc15fb202be485b5c57188116ec457a0a3d5aaf0593bc284e5"}
Aug 04 17:46:59.764080 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.763330    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-117.ec2.internal" event={"ID":"739cbf3763c2362a5b179b6a7695be8f","Type":"ContainerStarted","Data":"bce481cf1f164730d4f3a984b1bee463f51ae7b5a573aeed13beaab62a296a5d"}
Aug 04 17:46:59.779906 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.779843    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-117.ec2.internal" podStartSLOduration=2.779820095 podStartE2EDuration="2.779820095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:46:59.778706595 +0000 UTC m=+4.688596187" watchObservedRunningTime="2026-08-04 17:46:59.779820095 +0000 UTC m=+4.689709687"
Aug 04 17:46:59.780613 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.780538    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v9vlx" event={"ID":"b132d677-de62-4ae6-8819-70add7cd8664","Type":"ContainerStarted","Data":"d0d1f4fb20896af1f866732f3b7ed6443d9fff418e7550a887c629eab15c2f2d"}
Aug 04 17:46:59.807346 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.807298    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hhd6t" event={"ID":"d075b2ff-c092-4dd0-86ca-90badefc19e2","Type":"ContainerStarted","Data":"714e18368d3e15e0a8826cd391b0a0c3228482e675af0caaf8d0e838dbec873d"}
Aug 04 17:46:59.835986 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:46:59.835893    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kzb4p" event={"ID":"f2241cc8-8250-4928-8766-3baa44e0244a","Type":"ContainerStarted","Data":"34b3845a3f7edeadd899751a722ac11f542984146f0ec7418c57c245b5d29d40"}
Aug 04 17:47:00.593439 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:00.593405    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:00.594032 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:00.593540    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:47:00.594032 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:00.593957    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:00.594189 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:00.594090    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:47:00.873829 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:00.873676    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal" event={"ID":"3e68297ee54b15e4d72d8c3e3d25a5ea","Type":"ContainerStarted","Data":"65eecf1a32e409d86cfc7a02576e043baf2527a4df9026e35340119f4fa1a41a"}
Aug 04 17:47:00.889552 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:00.888756    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-117.ec2.internal" podStartSLOduration=3.888733343 podStartE2EDuration="3.888733343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:00.888256129 +0000 UTC m=+5.798145721" watchObservedRunningTime="2026-08-04 17:47:00.888733343 +0000 UTC m=+5.798622936"
Aug 04 17:47:01.090545 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:01.090501    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br2q7\" (UniqueName: \"kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7\") pod \"network-check-target-4l4mw\" (UID: \"b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc\") " pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:01.090757 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:01.090718    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:47:01.090757 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:01.090740    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:47:01.090757 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:01.090754    2572 projected.go:196] Error preparing data for projected volume kube-api-access-br2q7 for pod openshift-network-diagnostics/network-check-target-4l4mw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:47:01.090929 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:01.090816    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7 podName:b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc nodeName:}" failed. No retries permitted until 2026-08-04 17:47:05.090795068 +0000 UTC m=+10.000684643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-br2q7" (UniqueName: "kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7") pod "network-check-target-4l4mw" (UID: "b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:47:01.191059 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:01.190924    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs\") pod \"network-metrics-daemon-sftls\" (UID: \"7acf398c-a516-4d37-9792-38cf40564333\") " pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:01.191059 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:01.191002    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret\") pod \"global-pull-secret-syncer-q8sr8\" (UID: \"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725\") " pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:01.191293 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:01.191169    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:47:01.191293 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:01.191235    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret podName:7a807e47-6a40-4d63-bc6f-3d2b1c5a3725 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:05.191216315 +0000 UTC m=+10.101105899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret") pod "global-pull-secret-syncer-q8sr8" (UID: "7a807e47-6a40-4d63-bc6f-3d2b1c5a3725") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:47:01.192075 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:01.191651    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:47:01.192075 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:01.191703    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs podName:7acf398c-a516-4d37-9792-38cf40564333 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:05.191687324 +0000 UTC m=+10.101576893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs") pod "network-metrics-daemon-sftls" (UID: "7acf398c-a516-4d37-9792-38cf40564333") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:47:01.593513 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:01.593477    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:01.594041 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:01.593634    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:47:02.593322 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:02.593285    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:02.593322 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:02.593319    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:02.593581 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:02.593423    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:47:02.593964 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:02.593573    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:47:03.593492 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:03.593296    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:03.593492 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:03.593449    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:47:04.592751 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:04.592700    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:04.592957 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:04.592700    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:04.592957 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:04.592863    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:47:04.592957 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:04.592905    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:47:05.124423 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:05.124386    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br2q7\" (UniqueName: \"kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7\") pod \"network-check-target-4l4mw\" (UID: \"b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc\") " pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:05.124895 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:05.124592    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:47:05.124895 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:05.124609    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:47:05.124895 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:05.124621    2572 projected.go:196] Error preparing data for projected volume kube-api-access-br2q7 for pod openshift-network-diagnostics/network-check-target-4l4mw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:47:05.124895 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:05.124681    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7 podName:b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc nodeName:}" failed. No retries permitted until 2026-08-04 17:47:13.124662109 +0000 UTC m=+18.034551679 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-br2q7" (UniqueName: "kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7") pod "network-check-target-4l4mw" (UID: "b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:47:05.225562 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:05.225529    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs\") pod \"network-metrics-daemon-sftls\" (UID: \"7acf398c-a516-4d37-9792-38cf40564333\") " pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:05.225721 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:05.225574    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret\") pod \"global-pull-secret-syncer-q8sr8\" (UID: \"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725\") " pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:05.225721 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:05.225685    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:47:05.225839 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:05.225746    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret podName:7a807e47-6a40-4d63-bc6f-3d2b1c5a3725 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:13.225725545 +0000 UTC m=+18.135615114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret") pod "global-pull-secret-syncer-q8sr8" (UID: "7a807e47-6a40-4d63-bc6f-3d2b1c5a3725") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:47:05.226129 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:05.225685    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:47:05.226129 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:05.226102    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs podName:7acf398c-a516-4d37-9792-38cf40564333 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:13.226082415 +0000 UTC m=+18.135971991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs") pod "network-metrics-daemon-sftls" (UID: "7acf398c-a516-4d37-9792-38cf40564333") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:47:05.594653 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:05.594153    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:05.594653 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:05.594268    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:47:06.593804 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:06.593078    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:06.593804 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:06.593235    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:47:06.593804 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:06.593659    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:06.593804 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:06.593754    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:47:07.593427 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:07.593381    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:07.593619 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:07.593513    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:47:08.592777 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:08.592742    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:08.593197 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:08.592742    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:08.593197 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:08.592882    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:47:08.593197 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:08.592941    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:47:09.592676 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:09.592648    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:09.592812 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:09.592780    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:47:10.592748 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:10.592708    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:10.592748 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:10.592745    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:10.593226 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:10.592861    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:47:10.593226 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:10.592997    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:47:11.593504 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:11.593469    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:11.594013 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:11.593606    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:47:12.593295 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:12.593253    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:12.593529 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:12.593253    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:12.593529 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:12.593393    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:47:12.593529 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:12.593501    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:47:13.188512 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:13.188471    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br2q7\" (UniqueName: \"kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7\") pod \"network-check-target-4l4mw\" (UID: \"b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc\") " pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:13.188678 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:13.188630    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:47:13.188678 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:13.188653    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:47:13.188678 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:13.188666    2572 projected.go:196] Error preparing data for projected volume kube-api-access-br2q7 for pod openshift-network-diagnostics/network-check-target-4l4mw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:47:13.188849 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:13.188731    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7 podName:b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc nodeName:}" failed. No retries permitted until 2026-08-04 17:47:29.188715039 +0000 UTC m=+34.098604629 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-br2q7" (UniqueName: "kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7") pod "network-check-target-4l4mw" (UID: "b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:47:13.289744 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:13.289707    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs\") pod \"network-metrics-daemon-sftls\" (UID: \"7acf398c-a516-4d37-9792-38cf40564333\") " pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:13.289744 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:13.289753    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret\") pod \"global-pull-secret-syncer-q8sr8\" (UID: \"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725\") " pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:13.290003 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:13.289856    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:47:13.290003 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:13.289865    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:47:13.290003 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:13.289941    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret podName:7a807e47-6a40-4d63-bc6f-3d2b1c5a3725 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:29.289904535 +0000 UTC m=+34.199794106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret") pod "global-pull-secret-syncer-q8sr8" (UID: "7a807e47-6a40-4d63-bc6f-3d2b1c5a3725") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:47:13.290003 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:13.289964    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs podName:7acf398c-a516-4d37-9792-38cf40564333 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:29.28995133 +0000 UTC m=+34.199840901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs") pod "network-metrics-daemon-sftls" (UID: "7acf398c-a516-4d37-9792-38cf40564333") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:47:13.593166 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:13.593127    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:13.593341 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:13.593261    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:47:14.593091 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:14.593055    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:14.593091 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:14.593084    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:14.593561 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:14.593204    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:47:14.593561 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:14.593337    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:47:15.594540 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:15.594499    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:15.594979 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:15.594618    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:47:16.592805 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:16.592768    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:16.593019 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:16.592815    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:16.593019 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:16.592898    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:47:16.593123 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:16.593037    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:47:17.595704 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:17.595506    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:17.596090 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:17.595847    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:47:17.911650 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:17.911623    2572 generic.go:356] "Generic (PLEG): container finished" podID="d075f732-ebb5-4bee-bd7a-4ebf3427dc6a" containerID="073cbacc95c7b3d99e1841676b1c7d65ee991bf0f2b95852f3faf2312bca38cd" exitCode=0
Aug 04 17:47:17.911788 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:17.911700    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vnbxn" event={"ID":"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a","Type":"ContainerDied","Data":"073cbacc95c7b3d99e1841676b1c7d65ee991bf0f2b95852f3faf2312bca38cd"}
Aug 04 17:47:17.913483 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:17.913455    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4x2k2" event={"ID":"63763418-db79-4049-a524-ab7fcd3c9949","Type":"ContainerStarted","Data":"352a0c92fb9bb1ffdf0faf3b5aa88556f4a989ae3a58d411de4cd695a8f41c6a"}
Aug 04 17:47:17.914871 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:17.914846    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-znb94" event={"ID":"1c74287e-62ab-4f8d-8f3b-55bce380c99d","Type":"ContainerStarted","Data":"3f7da8f0f91907ac5026d07fba553abab1774a8de99d90e9ec9aefd16041d32e"}
Aug 04 17:47:17.916056 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:17.916030    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v9vlx" event={"ID":"b132d677-de62-4ae6-8819-70add7cd8664","Type":"ContainerStarted","Data":"8b8c7770eb072d576511c186d8fcb90174a0da4a3420f061d60a8d694391f970"}
Aug 04 17:47:17.917309 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:17.917289    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hhd6t" event={"ID":"d075b2ff-c092-4dd0-86ca-90badefc19e2","Type":"ContainerStarted","Data":"567d2b901fc728e02ed8d13b845a9d69fe8cfe14fc47086b08a5744131d3f310"}
Aug 04 17:47:17.918573 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:17.918552    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kzb4p" event={"ID":"f2241cc8-8250-4928-8766-3baa44e0244a","Type":"ContainerStarted","Data":"debe8dea16f0b8e32fc48dd23cd6ac4d9c302a830662c2bfffca13fefc957e97"}
Aug 04 17:47:17.919834 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:17.919814    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh" event={"ID":"22e7de3d-a8d4-40a0-aad0-88b9c053f316","Type":"ContainerStarted","Data":"9bda1a9c929c30e0a0011e4b9ba742f571c748448be64652b8a34f62a57579b3"}
Aug 04 17:47:17.921038 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:17.921021    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr" event={"ID":"4cce1fb4-a6cb-4481-b1e2-a828f22547b3","Type":"ContainerStarted","Data":"64e5e592a9f20542bd6f1cd96463d6f8d84bf2aa6beda7b7ed29485d823d111e"}
Aug 04 17:47:17.946048 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:17.946009    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kzb4p" podStartSLOduration=3.057505035 podStartE2EDuration="21.945995139s" totalImagesPullingTime="18.888490104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:17.945877908 +0000 UTC m=+22.855767496" watchObservedRunningTime="2026-08-04 17:47:17.945995139 +0000 UTC m=+22.855884727"
Aug 04 17:47:17.961211 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:17.961174    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4x2k2" podStartSLOduration=3.124607215 podStartE2EDuration="21.961161108s" totalImagesPullingTime="18.836553893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:17.961017028 +0000 UTC m=+22.870906616" watchObservedRunningTime="2026-08-04 17:47:17.961161108 +0000 UTC m=+22.871050695"
Aug 04 17:47:17.973716 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:17.973685    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hhd6t" podStartSLOduration=3.152874421 podStartE2EDuration="21.973673946s" totalImagesPullingTime="18.820799525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:17.973209539 +0000 UTC m=+22.883099150" watchObservedRunningTime="2026-08-04 17:47:17.973673946 +0000 UTC m=+22.883563533"
Aug 04 17:47:18.001196 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:18.001152    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v9vlx" podStartSLOduration=3.170123014 podStartE2EDuration="22.001133303s" totalImagesPullingTime="18.831010289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:17.988066945 +0000 UTC m=+22.897956533" watchObservedRunningTime="2026-08-04 17:47:18.001133303 +0000 UTC m=+22.911022892"
Aug 04 17:47:18.001592 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:18.001566    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-znb94" podStartSLOduration=7.220235803 podStartE2EDuration="22.001558711s" totalImagesPullingTime="14.781322908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:18.000733782 +0000 UTC m=+22.910623390" watchObservedRunningTime="2026-08-04 17:47:18.001558711 +0000 UTC m=+22.911448300"
Aug 04 17:47:18.592994 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:18.592741    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:18.593187 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:18.592767    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:18.593187 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:18.593105    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:47:18.593187 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:18.593147    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:47:18.928308 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:18.928270    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 17:47:18.929136 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:18.928930    2572 generic.go:356] "Generic (PLEG): container finished" podID="4cce1fb4-a6cb-4481-b1e2-a828f22547b3" containerID="e79a603eedd8d6e6b1bc8a8bae74f41854ed1bf0bfa4aacc9d7508d016188871" exitCode=1
Aug 04 17:47:18.929136 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:18.928950    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr" event={"ID":"4cce1fb4-a6cb-4481-b1e2-a828f22547b3","Type":"ContainerStarted","Data":"4fd6a9248c707dbc471d471bf1808bc17cf759191a75343258c933fe99ac449d"}
Aug 04 17:47:18.929136 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:18.929047    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr" event={"ID":"4cce1fb4-a6cb-4481-b1e2-a828f22547b3","Type":"ContainerStarted","Data":"28aad3fe2d5b57f2dbc0ca030927cfd37f77c1e5eff4c2891db2bee85faad18e"}
Aug 04 17:47:18.930742 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:18.930669    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr" event={"ID":"4cce1fb4-a6cb-4481-b1e2-a828f22547b3","Type":"ContainerStarted","Data":"640c8d17e5a295be7006ebe5f60427612abd1ab0d53b0b449467d780146a6f26"}
Aug 04 17:47:18.930846 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:18.930745    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr" event={"ID":"4cce1fb4-a6cb-4481-b1e2-a828f22547b3","Type":"ContainerStarted","Data":"33e13e070b38e081db0d80e7c610b240d1034b1e85e58f815b46a4df164623e9"}
Aug 04 17:47:18.930846 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:18.930794    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr" event={"ID":"4cce1fb4-a6cb-4481-b1e2-a828f22547b3","Type":"ContainerDied","Data":"e79a603eedd8d6e6b1bc8a8bae74f41854ed1bf0bfa4aacc9d7508d016188871"}
Aug 04 17:47:18.930978 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:18.930844    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kmnhw" event={"ID":"2589d8d1-41de-4a99-879b-30c3eba8be1c","Type":"ContainerStarted","Data":"f770ae57453615074225a4973bcfa2403d54fde24609878c5ce817fbaae34831"}
Aug 04 17:47:18.945567 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:18.945517    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kmnhw" podStartSLOduration=4.120335861 podStartE2EDuration="22.945498537s" totalImagesPullingTime="18.825162676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:18.945420136 +0000 UTC m=+23.855309749" watchObservedRunningTime="2026-08-04 17:47:18.945498537 +0000 UTC m=+23.855388131"
Aug 04 17:47:19.042656 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:19.042616    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 17:47:19.513534 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:19.513403    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T17:47:19.04263772Z","UUID":"f15ea926-c969-4dd8-a686-8217ee47dc51","Handler":null,"Name":"","Endpoint":""}
Aug 04 17:47:19.515236 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:19.515210    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 17:47:19.515381 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:19.515276    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 17:47:19.593558 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:19.593522    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:19.593742 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:19.593660    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:47:19.934145 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:19.934111    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh" event={"ID":"22e7de3d-a8d4-40a0-aad0-88b9c053f316","Type":"ContainerStarted","Data":"a5ff2935a17d4c5f3a28d28e8063e5b710ba3e2c2535bec903ff6e0522b3f9df"}
Aug 04 17:47:20.465563 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:20.465415    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-znb94"
Aug 04 17:47:20.592910 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:20.592880    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:20.593100 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:20.593017    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:47:20.593100 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:20.593060    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:20.593213 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:20.593149    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:47:20.938880 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:20.938840    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh" event={"ID":"22e7de3d-a8d4-40a0-aad0-88b9c053f316","Type":"ContainerStarted","Data":"dc47a3ad5dec8a73110d96f8c0f433f4967759946de63fec381ca4876415760b"}
Aug 04 17:47:20.942254 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:20.942228    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-znb94"
Aug 04 17:47:20.942618 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:20.942601    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 17:47:20.942846 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:20.942823    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-znb94"
Aug 04 17:47:20.943144 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:20.943125    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr" event={"ID":"4cce1fb4-a6cb-4481-b1e2-a828f22547b3","Type":"ContainerStarted","Data":"cbe35ea63ed4d516844bf2068afe2a7dd3c68cc5b2244b55d3193a741e3b5ca6"}
Aug 04 17:47:20.943596 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:20.943580    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-znb94"
Aug 04 17:47:20.957745 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:20.957667    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6dsh" podStartSLOduration=3.9030601000000003 podStartE2EDuration="24.957645608s" totalImagesPullingTime="21.054585508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:20.956733854 +0000 UTC m=+25.866623446" watchObservedRunningTime="2026-08-04 17:47:20.957645608 +0000 UTC m=+25.867535195"
Aug 04 17:47:21.592696 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:21.592657    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:21.592871 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:21.592797    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:47:22.593013 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:22.592949    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:22.593013 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:22.592965    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:22.593693 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:22.593074    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:47:22.593693 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:22.593245    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:47:23.593476 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:23.593294    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:23.593975 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:23.593554    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:47:23.952609 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:23.952579    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 17:47:23.952979 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:23.952959    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr" event={"ID":"4cce1fb4-a6cb-4481-b1e2-a828f22547b3","Type":"ContainerStarted","Data":"8bd4d2b67280279e20ba5d95807fd9c0d199b082fe179397c3156fc3ef51715b"}
Aug 04 17:47:23.953193 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:23.953177    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:47:23.953544 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:23.953369    2572 scope.go:117] "RemoveContainer" containerID="e79a603eedd8d6e6b1bc8a8bae74f41854ed1bf0bfa4aacc9d7508d016188871"
Aug 04 17:47:23.955153 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:23.955126    2572 generic.go:356] "Generic (PLEG): container finished" podID="d075f732-ebb5-4bee-bd7a-4ebf3427dc6a" containerID="eb4223cf8342a6a3b93cb92bb24a4ff6ed8f6977130db4c5e3d4826959fac584" exitCode=0
Aug 04 17:47:23.955253 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:23.955166    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vnbxn" event={"ID":"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a","Type":"ContainerDied","Data":"eb4223cf8342a6a3b93cb92bb24a4ff6ed8f6977130db4c5e3d4826959fac584"}
Aug 04 17:47:23.969870 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:23.969850    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:47:24.593142 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:24.593102    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:24.593355 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:24.593160    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:24.593355 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:24.593230    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:47:24.593447 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:24.593361    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:47:24.961091 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:24.961026    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 17:47:24.961568 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:24.961349    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr" event={"ID":"4cce1fb4-a6cb-4481-b1e2-a828f22547b3","Type":"ContainerStarted","Data":"1db98b9527293e604b710831c54b1b65c2acbc12c0526346902363ad3a520fc8"}
Aug 04 17:47:24.961568 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:24.961556    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:47:24.961664 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:24.961634    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:47:24.976285 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:24.976265    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:47:24.987334 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:24.987294    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr" podStartSLOduration=9.935033174 podStartE2EDuration="28.987281678s" totalImagesPullingTime="19.052248504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:24.985654225 +0000 UTC m=+29.895543829" watchObservedRunningTime="2026-08-04 17:47:24.987281678 +0000 UTC m=+29.897171266"
Aug 04 17:47:25.514723 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:25.514693    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q8sr8"]
Aug 04 17:47:25.514904 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:25.514827    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:25.514985 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:25.514961    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:47:25.520783 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:25.520756    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sftls"]
Aug 04 17:47:25.520954 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:25.520847    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:25.520954 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:25.520944    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:47:25.521656 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:25.521633    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4l4mw"]
Aug 04 17:47:25.521757 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:25.521720    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:25.521838 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:25.521817    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:47:25.966039 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:25.966003    2572 generic.go:356] "Generic (PLEG): container finished" podID="d075f732-ebb5-4bee-bd7a-4ebf3427dc6a" containerID="aac180eb742ad111f65ee5052271bb1f0c3b856ca97a54d3592ce09b5fa8a6b8" exitCode=0
Aug 04 17:47:25.966770 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:25.966083    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vnbxn" event={"ID":"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a","Type":"ContainerDied","Data":"aac180eb742ad111f65ee5052271bb1f0c3b856ca97a54d3592ce09b5fa8a6b8"}
Aug 04 17:47:26.593336 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:26.593299    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:26.593502 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:26.593432    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:47:27.592800 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:27.592774    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:27.593431 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:27.592902    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:47:27.593431 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:27.592940    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:27.593431 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:27.593018    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:47:27.972533 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:27.972461    2572 generic.go:356] "Generic (PLEG): container finished" podID="d075f732-ebb5-4bee-bd7a-4ebf3427dc6a" containerID="b9a0eaa0ea6a8a01c08ca4fa8cb3c21c96bbac8565fd5baf25d97a253d1a0d42" exitCode=0
Aug 04 17:47:27.972533 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:27.972506    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vnbxn" event={"ID":"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a","Type":"ContainerDied","Data":"b9a0eaa0ea6a8a01c08ca4fa8cb3c21c96bbac8565fd5baf25d97a253d1a0d42"}
Aug 04 17:47:28.592695 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:28.592659    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:28.592876 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:28.592793    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:47:29.207195 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:29.207160    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br2q7\" (UniqueName: \"kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7\") pod \"network-check-target-4l4mw\" (UID: \"b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc\") " pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:29.207374 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:29.207296    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:47:29.207374 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:29.207315    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:47:29.207374 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:29.207323    2572 projected.go:196] Error preparing data for projected volume kube-api-access-br2q7 for pod openshift-network-diagnostics/network-check-target-4l4mw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:47:29.207374 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:29.207372    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7 podName:b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc nodeName:}" failed. No retries permitted until 2026-08-04 17:48:01.207359423 +0000 UTC m=+66.117248989 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-br2q7" (UniqueName: "kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7") pod "network-check-target-4l4mw" (UID: "b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:47:29.308461 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:29.308431    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs\") pod \"network-metrics-daemon-sftls\" (UID: \"7acf398c-a516-4d37-9792-38cf40564333\") " pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:29.308634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:29.308476    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret\") pod \"global-pull-secret-syncer-q8sr8\" (UID: \"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725\") " pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:29.308634 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:29.308590    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:47:29.308739 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:29.308657    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs podName:7acf398c-a516-4d37-9792-38cf40564333 nodeName:}" failed. No retries permitted until 2026-08-04 17:48:01.308636149 +0000 UTC m=+66.218525726 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs") pod "network-metrics-daemon-sftls" (UID: "7acf398c-a516-4d37-9792-38cf40564333") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:47:29.308739 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:29.308593    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:47:29.308739 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:29.308701    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret podName:7a807e47-6a40-4d63-bc6f-3d2b1c5a3725 nodeName:}" failed. No retries permitted until 2026-08-04 17:48:01.308690703 +0000 UTC m=+66.218580275 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret") pod "global-pull-secret-syncer-q8sr8" (UID: "7a807e47-6a40-4d63-bc6f-3d2b1c5a3725") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:47:29.593431 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:29.593405    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:29.593886 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:29.593405    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:29.593886 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:29.593539    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8sr8" podUID="7a807e47-6a40-4d63-bc6f-3d2b1c5a3725"
Aug 04 17:47:29.593886 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:29.593607    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4l4mw" podUID="b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc"
Aug 04 17:47:30.416017 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.415774    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-117.ec2.internal" event="NodeReady"
Aug 04 17:47:30.416192 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.416137    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 17:47:30.458546 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.458515    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9v6j5"]
Aug 04 17:47:30.460908 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.460881    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:30.461461 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.461434    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x8fdb"]
Aug 04 17:47:30.463142 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.463124    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x8fdb"
Aug 04 17:47:30.463238 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.463197    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 17:47:30.463580 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.463558    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-56pss\""
Aug 04 17:47:30.463688 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.463643    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 17:47:30.465341 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.465323    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 17:47:30.465434 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.465358    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 17:47:30.465601 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.465583    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 17:47:30.465739 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.465585    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dvz98\""
Aug 04 17:47:30.470395 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.470079    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9v6j5"]
Aug 04 17:47:30.472664 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.472642    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x8fdb"]
Aug 04 17:47:30.593339 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.593305    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:47:30.596176 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.596153    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 17:47:30.596176 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.596165    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wlqn\""
Aug 04 17:47:30.617728 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.617695    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-config-volume\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:30.617876 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.617739    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5bnl\" (UniqueName: \"kubernetes.io/projected/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-kube-api-access-w5bnl\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:30.617876 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.617797    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:30.617986 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.617896    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/571b97b3-7164-4be6-96f6-70ae0783e371-cert\") pod \"ingress-canary-x8fdb\" (UID: \"571b97b3-7164-4be6-96f6-70ae0783e371\") " pod="openshift-ingress-canary/ingress-canary-x8fdb"
Aug 04 17:47:30.617986 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.617944    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hxl8\" (UniqueName: \"kubernetes.io/projected/571b97b3-7164-4be6-96f6-70ae0783e371-kube-api-access-6hxl8\") pod \"ingress-canary-x8fdb\" (UID: \"571b97b3-7164-4be6-96f6-70ae0783e371\") " pod="openshift-ingress-canary/ingress-canary-x8fdb"
Aug 04 17:47:30.617986 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.617974    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-tmp-dir\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:30.719084 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.719005    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-config-volume\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:30.719084 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.719054    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5bnl\" (UniqueName: \"kubernetes.io/projected/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-kube-api-access-w5bnl\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:30.719084 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.719082    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:30.719345 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.719143    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/571b97b3-7164-4be6-96f6-70ae0783e371-cert\") pod \"ingress-canary-x8fdb\" (UID: \"571b97b3-7164-4be6-96f6-70ae0783e371\") " pod="openshift-ingress-canary/ingress-canary-x8fdb"
Aug 04 17:47:30.719345 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.719165    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hxl8\" (UniqueName: \"kubernetes.io/projected/571b97b3-7164-4be6-96f6-70ae0783e371-kube-api-access-6hxl8\") pod \"ingress-canary-x8fdb\" (UID: \"571b97b3-7164-4be6-96f6-70ae0783e371\") " pod="openshift-ingress-canary/ingress-canary-x8fdb"
Aug 04 17:47:30.719345 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.719193    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-tmp-dir\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:30.719345 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:30.719269    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:30.719345 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:30.719340    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls podName:9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:31.219319209 +0000 UTC m=+36.129208783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls") pod "dns-default-9v6j5" (UID: "9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:30.719586 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.719554    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-tmp-dir\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:30.719741 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.719718    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-config-volume\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:30.724021 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.723997    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/571b97b3-7164-4be6-96f6-70ae0783e371-cert\") pod \"ingress-canary-x8fdb\" (UID: \"571b97b3-7164-4be6-96f6-70ae0783e371\") " pod="openshift-ingress-canary/ingress-canary-x8fdb"
Aug 04 17:47:30.728138 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.728103    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hxl8\" (UniqueName: \"kubernetes.io/projected/571b97b3-7164-4be6-96f6-70ae0783e371-kube-api-access-6hxl8\") pod \"ingress-canary-x8fdb\" (UID: \"571b97b3-7164-4be6-96f6-70ae0783e371\") " pod="openshift-ingress-canary/ingress-canary-x8fdb"
Aug 04 17:47:30.728426 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.728405    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5bnl\" (UniqueName: \"kubernetes.io/projected/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-kube-api-access-w5bnl\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:30.780653 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.780618    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x8fdb"
Aug 04 17:47:30.931169 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:30.930187    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x8fdb"]
Aug 04 17:47:31.222255 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:31.222210    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:31.222425 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:31.222387    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:31.222498 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:31.222474    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls podName:9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:32.222451658 +0000 UTC m=+37.132341246 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls") pod "dns-default-9v6j5" (UID: "9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:31.592715 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:31.592672    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:47:31.592908 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:31.592723    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:47:31.595452 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:31.595418    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 17:47:31.595452 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:31.595419    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 17:47:31.596410 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:31.596379    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dfqn6\""
Aug 04 17:47:31.596799 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:31.596386    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 17:47:32.229314 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:32.229277    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:32.229512 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:32.229404    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:32.229512 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:32.229488    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls podName:9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:34.229466409 +0000 UTC m=+39.139355987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls") pod "dns-default-9v6j5" (UID: "9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:32.405245 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:47:32.405213    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod571b97b3_7164_4be6_96f6_70ae0783e371.slice/crio-c2ae21e924f65fcf8acb5ad2757b041c187303cf8fbe213999a3fa3d73ec0709 WatchSource:0}: Error finding container c2ae21e924f65fcf8acb5ad2757b041c187303cf8fbe213999a3fa3d73ec0709: Status 404 returned error can't find the container with id c2ae21e924f65fcf8acb5ad2757b041c187303cf8fbe213999a3fa3d73ec0709
Aug 04 17:47:32.987120 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:32.986946    2572 generic.go:356] "Generic (PLEG): container finished" podID="d075f732-ebb5-4bee-bd7a-4ebf3427dc6a" containerID="0151b03908f62bb5f3ebfffcd091a93c4690d3cc3001326bab72e959eef7a3e1" exitCode=0
Aug 04 17:47:32.987555 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:32.987026    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vnbxn" event={"ID":"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a","Type":"ContainerDied","Data":"0151b03908f62bb5f3ebfffcd091a93c4690d3cc3001326bab72e959eef7a3e1"}
Aug 04 17:47:32.988166 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:32.988140    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x8fdb" event={"ID":"571b97b3-7164-4be6-96f6-70ae0783e371","Type":"ContainerStarted","Data":"c2ae21e924f65fcf8acb5ad2757b041c187303cf8fbe213999a3fa3d73ec0709"}
Aug 04 17:47:33.993186 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:33.993149    2572 generic.go:356] "Generic (PLEG): container finished" podID="d075f732-ebb5-4bee-bd7a-4ebf3427dc6a" containerID="f529f0b7d0f14981f29b4c0e97dd416670bf8d915674bef6ce89bc563c144b9f" exitCode=0
Aug 04 17:47:33.993568 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:33.993226    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vnbxn" event={"ID":"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a","Type":"ContainerDied","Data":"f529f0b7d0f14981f29b4c0e97dd416670bf8d915674bef6ce89bc563c144b9f"}
Aug 04 17:47:34.244526 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:34.244452    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:34.244665 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:34.244603    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:34.244708 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:34.244666    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls podName:9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:38.244651333 +0000 UTC m=+43.154540902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls") pod "dns-default-9v6j5" (UID: "9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:34.998814 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:34.998780    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vnbxn" event={"ID":"d075f732-ebb5-4bee-bd7a-4ebf3427dc6a","Type":"ContainerStarted","Data":"5d9bf219c918d13d633660ec1cf0857c229b85fdaa4b7233cec6bdcbc24fe308"}
Aug 04 17:47:35.020566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:35.020480    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vnbxn" podStartSLOduration=7.821601082 podStartE2EDuration="39.020464524s" totalImagesPullingTime="31.198863442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:35.019095505 +0000 UTC m=+39.928985093" watchObservedRunningTime="2026-08-04 17:47:35.020464524 +0000 UTC m=+39.930354112"
Aug 04 17:47:36.003019 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:36.002980    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x8fdb" event={"ID":"571b97b3-7164-4be6-96f6-70ae0783e371","Type":"ContainerStarted","Data":"ea7c02e48cb16c1c281fb797753f8b5dd16227cef991c858215ffc08714d31da"}
Aug 04 17:47:36.017376 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:36.017323    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x8fdb" podStartSLOduration=3.255659085 podStartE2EDuration="6.017309912s" totalImagesPullingTime="2.761650827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:36.017219968 +0000 UTC m=+40.927109567" watchObservedRunningTime="2026-08-04 17:47:36.017309912 +0000 UTC m=+40.927199500"
Aug 04 17:47:38.274130 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:38.274086    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:38.274500 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:38.274241    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:38.274500 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:38.274302    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls podName:9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:46.274285443 +0000 UTC m=+51.184175011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls") pod "dns-default-9v6j5" (UID: "9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:46.331373 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:46.331327    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:47:46.331902 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:46.331511    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:46.331902 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:47:46.331577    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls podName:9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9 nodeName:}" failed. No retries permitted until 2026-08-04 17:48:02.331560788 +0000 UTC m=+67.241450357 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls") pod "dns-default-9v6j5" (UID: "9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:56.984966 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:47:56.984941    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfjqr"
Aug 04 17:48:01.242771 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:01.242722    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br2q7\" (UniqueName: \"kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7\") pod \"network-check-target-4l4mw\" (UID: \"b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc\") " pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:48:01.246587 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:01.246570    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 17:48:01.255421 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:01.255403    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 17:48:01.267469 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:01.267449    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br2q7\" (UniqueName: \"kubernetes.io/projected/b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc-kube-api-access-br2q7\") pod \"network-check-target-4l4mw\" (UID: \"b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc\") " pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:48:01.308121 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:01.308091    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dfqn6\""
Aug 04 17:48:01.316333 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:01.316315    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:48:01.343155 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:01.343126    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret\") pod \"global-pull-secret-syncer-q8sr8\" (UID: \"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725\") " pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:48:01.343292 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:01.343204    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs\") pod \"network-metrics-daemon-sftls\" (UID: \"7acf398c-a516-4d37-9792-38cf40564333\") " pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:48:01.346131 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:01.346115    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 17:48:01.346254 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:01.346235    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 17:48:01.353632 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:48:01.353610    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 04 17:48:01.353739 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:48:01.353679    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs podName:7acf398c-a516-4d37-9792-38cf40564333 nodeName:}" failed. No retries permitted until 2026-08-04 17:49:05.35365712 +0000 UTC m=+130.263546693 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs") pod "network-metrics-daemon-sftls" (UID: "7acf398c-a516-4d37-9792-38cf40564333") : secret "metrics-daemon-secret" not found
Aug 04 17:48:01.355669 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:01.355648    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a807e47-6a40-4d63-bc6f-3d2b1c5a3725-original-pull-secret\") pod \"global-pull-secret-syncer-q8sr8\" (UID: \"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725\") " pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:48:01.433338 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:01.433312    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4l4mw"]
Aug 04 17:48:01.436340 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:48:01.436314    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ea43a1_d8d8_4b3f_bd6c_8d2b98db6edc.slice/crio-99894d27a209f3582c10c296f503b0e46b67305db7b8ab4d0aaadbb8832dad46 WatchSource:0}: Error finding container 99894d27a209f3582c10c296f503b0e46b67305db7b8ab4d0aaadbb8832dad46: Status 404 returned error can't find the container with id 99894d27a209f3582c10c296f503b0e46b67305db7b8ab4d0aaadbb8832dad46
Aug 04 17:48:01.610329 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:01.610298    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8sr8"
Aug 04 17:48:01.727982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:01.726459    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q8sr8"]
Aug 04 17:48:01.732568 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:48:01.732157    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a807e47_6a40_4d63_bc6f_3d2b1c5a3725.slice/crio-9d6cfdec8bd55ea83d90d63e3ca6e8e1de0ae448b2f1addae8df7443dcc5cf23 WatchSource:0}: Error finding container 9d6cfdec8bd55ea83d90d63e3ca6e8e1de0ae448b2f1addae8df7443dcc5cf23: Status 404 returned error can't find the container with id 9d6cfdec8bd55ea83d90d63e3ca6e8e1de0ae448b2f1addae8df7443dcc5cf23
Aug 04 17:48:02.061908 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:02.061871    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4l4mw" event={"ID":"b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc","Type":"ContainerStarted","Data":"99894d27a209f3582c10c296f503b0e46b67305db7b8ab4d0aaadbb8832dad46"}
Aug 04 17:48:02.062878 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:02.062855    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q8sr8" event={"ID":"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725","Type":"ContainerStarted","Data":"9d6cfdec8bd55ea83d90d63e3ca6e8e1de0ae448b2f1addae8df7443dcc5cf23"}
Aug 04 17:48:02.350851 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:02.350766    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:48:02.351282 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:48:02.350932    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:48:02.351282 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:48:02.350988    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls podName:9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9 nodeName:}" failed. No retries permitted until 2026-08-04 17:48:34.350973079 +0000 UTC m=+99.260862645 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls") pod "dns-default-9v6j5" (UID: "9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9") : secret "dns-default-metrics-tls" not found
Aug 04 17:48:07.077606 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:07.077569    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4l4mw" event={"ID":"b2ea43a1-d8d8-4b3f-bd6c-8d2b98db6edc","Type":"ContainerStarted","Data":"c8d933d758f1a79e090d0eec21e9d2fa8f67f022de5b062176f7ba0d54bdabd2"}
Aug 04 17:48:07.078082 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:07.077638    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:48:07.078830 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:07.078811    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q8sr8" event={"ID":"7a807e47-6a40-4d63-bc6f-3d2b1c5a3725","Type":"ContainerStarted","Data":"2c9b0c93e8993b69736d7f4265020b38bd0b6b74f5d2d60ab9b29f4639381bfb"}
Aug 04 17:48:07.093641 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:07.093589    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4l4mw" podStartSLOduration=65.996009306 podStartE2EDuration="1m11.093573592s" totalImagesPullingTime="5.097564286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:48:07.092225064 +0000 UTC m=+72.002114680" watchObservedRunningTime="2026-08-04 17:48:07.093573592 +0000 UTC m=+72.003463175"
Aug 04 17:48:07.105733 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:07.105686    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q8sr8" podStartSLOduration=66.300820812 podStartE2EDuration="1m11.105670368s" totalImagesPullingTime="4.804849556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:48:07.10553687 +0000 UTC m=+72.015426477" watchObservedRunningTime="2026-08-04 17:48:07.105670368 +0000 UTC m=+72.015559950"
Aug 04 17:48:34.360907 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:34.360791    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:48:34.360907 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:48:34.360891    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:48:34.361394 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:48:34.360971    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls podName:9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9 nodeName:}" failed. No retries permitted until 2026-08-04 17:49:38.360957695 +0000 UTC m=+163.270847261 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls") pod "dns-default-9v6j5" (UID: "9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9") : secret "dns-default-metrics-tls" not found
Aug 04 17:48:38.083785 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:48:38.083754    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4l4mw"
Aug 04 17:49:05.366169 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:49:05.366117    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs\") pod \"network-metrics-daemon-sftls\" (UID: \"7acf398c-a516-4d37-9792-38cf40564333\") " pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:49:05.366738 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:49:05.366280    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 04 17:49:05.366738 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:49:05.366367    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs podName:7acf398c-a516-4d37-9792-38cf40564333 nodeName:}" failed. No retries permitted until 2026-08-04 17:51:07.366345156 +0000 UTC m=+252.276234726 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs") pod "network-metrics-daemon-sftls" (UID: "7acf398c-a516-4d37-9792-38cf40564333") : secret "metrics-daemon-secret" not found
Aug 04 17:49:33.474398 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:49:33.474346    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9v6j5" podUID="9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9"
Aug 04 17:49:33.603592 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:49:33.603560    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sftls" podUID="7acf398c-a516-4d37-9792-38cf40564333"
Aug 04 17:49:34.280542 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:49:34.280515    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:49:38.381582 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:49:38.381529    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:49:38.382012 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:49:38.381669    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:49:38.382012 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:49:38.381736    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls podName:9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9 nodeName:}" failed. No retries permitted until 2026-08-04 17:51:40.381717304 +0000 UTC m=+285.291606879 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls") pod "dns-default-9v6j5" (UID: "9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9") : secret "dns-default-metrics-tls" not found
Aug 04 17:49:48.593212 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:49:48.593131    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:50:33.959040 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.959014    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-wxw48"]
Aug 04 17:50:33.960632 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.960617    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-555484c5bd-f27lq"]
Aug 04 17:50:33.960751 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.960735    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:33.962252 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.962232    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:33.965522 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.965504    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Aug 04 17:50:33.966479 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.966460    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Aug 04 17:50:33.966479 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.966469    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 17:50:33.966863 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.966844    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 17:50:33.967331 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.967259    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Aug 04 17:50:33.968175 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.967421    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-lwpg7\""
Aug 04 17:50:33.971646 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.970740    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Aug 04 17:50:33.971646 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.971019    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 17:50:33.971646 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.971123    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Aug 04 17:50:33.973207 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.973184    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Aug 04 17:50:33.973299 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.973284    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vvsrl\""
Aug 04 17:50:33.973355 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.973331    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 17:50:33.975842 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.975821    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-wxw48"]
Aug 04 17:50:33.976759 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.976741    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Aug 04 17:50:33.981524 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:33.981504    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-555484c5bd-f27lq"]
Aug 04 17:50:34.030671 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.030639    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-snapshots\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.030825 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.030678    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgstr\" (UniqueName: \"kubernetes.io/projected/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-kube-api-access-dgstr\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.030825 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.030699    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-default-certificate\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:34.030825 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.030714    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-trusted-ca-bundle\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.030825 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.030754    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:34.030825 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.030807    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-stats-auth\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:34.031029 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.030830    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:34.031029 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.030847    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2n4h\" (UniqueName: \"kubernetes.io/projected/0e22064c-5296-4c38-8d82-dca1e4d6a209-kube-api-access-b2n4h\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:34.031029 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.030861    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-tmp\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.031029 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.030880    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-service-ca-bundle\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.031029 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.030914    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-serving-cert\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.049153 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.049125    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-pmwjr"]
Aug 04 17:50:34.050874 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.050856    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pmwjr"
Aug 04 17:50:34.053433 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.053413    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-kv6m9\""
Aug 04 17:50:34.053667 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.053647    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr"]
Aug 04 17:50:34.055494 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.055474    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk"]
Aug 04 17:50:34.055588 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.055536    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr"
Aug 04 17:50:34.057191 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.057173    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c9857f644-6bxl2"]
Aug 04 17:50:34.057295 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.057281    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk"
Aug 04 17:50:34.057930 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.057893    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Aug 04 17:50:34.058265 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.058247    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Aug 04 17:50:34.058348 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.058277    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-sj9zn\""
Aug 04 17:50:34.058399 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.058345    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Aug 04 17:50:34.058399 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.058371    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Aug 04 17:50:34.059054 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.059035    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.060084 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.060067    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Aug 04 17:50:34.061087 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.061067    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 04 17:50:34.061202 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.061091    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 04 17:50:34.061496 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.061483    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 04 17:50:34.061670 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.061647    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lh26t\""
Aug 04 17:50:34.061730 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.061687    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6z64c\""
Aug 04 17:50:34.061806 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.061737    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Aug 04 17:50:34.061806 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.061761    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Aug 04 17:50:34.064818 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.064802    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-pmwjr"]
Aug 04 17:50:34.071367 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.071349    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr"]
Aug 04 17:50:34.071472 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.071382    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 04 17:50:34.072519 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.072499    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk"]
Aug 04 17:50:34.073835 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.073816    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c9857f644-6bxl2"]
Aug 04 17:50:34.131980 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.131948    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-trusted-ca-bundle\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.132138 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.131986    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a78b03fa-ab27-4065-915a-9b9658f59304-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-v6nfr\" (UID: \"a78b03fa-ab27-4065-915a-9b9658f59304\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr"
Aug 04 17:50:34.132138 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132011    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-bound-sa-token\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.132138 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132032    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-default-certificate\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:34.132138 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132061    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xgb6\" (UniqueName: \"kubernetes.io/projected/5b76b84a-d54e-4d20-81ca-2c09c28a073f-kube-api-access-7xgb6\") pod \"cluster-samples-operator-559cbf5745-q5xqk\" (UID: \"5b76b84a-d54e-4d20-81ca-2c09c28a073f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk"
Aug 04 17:50:34.132307 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132196    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:34.132307 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132248    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vv4w\" (UniqueName: \"kubernetes.io/projected/a78b03fa-ab27-4065-915a-9b9658f59304-kube-api-access-6vv4w\") pod \"kube-storage-version-migrator-operator-7878f4b88c-v6nfr\" (UID: \"a78b03fa-ab27-4065-915a-9b9658f59304\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr"
Aug 04 17:50:34.132307 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132286    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8plf6\" (UniqueName: \"kubernetes.io/projected/e6d22f11-554c-4e0f-90ad-c549cf25e84a-kube-api-access-8plf6\") pod \"network-check-source-65bdbbff45-pmwjr\" (UID: \"e6d22f11-554c-4e0f-90ad-c549cf25e84a\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pmwjr"
Aug 04 17:50:34.132447 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132311    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2n4h\" (UniqueName: \"kubernetes.io/projected/0e22064c-5296-4c38-8d82-dca1e4d6a209-kube-api-access-b2n4h\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:34.132447 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132332    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-service-ca-bundle\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.132447 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132377    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-q5xqk\" (UID: \"5b76b84a-d54e-4d20-81ca-2c09c28a073f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk"
Aug 04 17:50:34.132447 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:34.132406    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle podName:0e22064c-5296-4c38-8d82-dca1e4d6a209 nodeName:}" failed. No retries permitted until 2026-08-04 17:50:34.632379217 +0000 UTC m=+219.542268803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle") pod "router-default-555484c5bd-f27lq" (UID: "0e22064c-5296-4c38-8d82-dca1e4d6a209") : configmap references non-existent config key: service-ca.crt
Aug 04 17:50:34.132633 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132463    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-snapshots\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.132633 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132500    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c3615de-d486-481b-914f-23fce8aaf04d-ca-trust-extracted\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.132633 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132613    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c3615de-d486-481b-914f-23fce8aaf04d-registry-certificates\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.132800 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132649    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.132800 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132688    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a78b03fa-ab27-4065-915a-9b9658f59304-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-v6nfr\" (UID: \"a78b03fa-ab27-4065-915a-9b9658f59304\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr"
Aug 04 17:50:34.132800 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132733    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-stats-auth\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:34.132800 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132784    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:34.133022 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132824    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nstsp\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-kube-api-access-nstsp\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.133022 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132845    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-tmp\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.133022 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:34.132856    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 17:50:34.133022 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132872    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-serving-cert\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.133022 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:34.132905    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs podName:0e22064c-5296-4c38-8d82-dca1e4d6a209 nodeName:}" failed. No retries permitted until 2026-08-04 17:50:34.632889683 +0000 UTC m=+219.542779267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs") pod "router-default-555484c5bd-f27lq" (UID: "0e22064c-5296-4c38-8d82-dca1e4d6a209") : secret "router-metrics-certs-default" not found
Aug 04 17:50:34.133022 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132967    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgstr\" (UniqueName: \"kubernetes.io/projected/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-kube-api-access-dgstr\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.133022 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132983    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-service-ca-bundle\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.133022 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.132996    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c3615de-d486-481b-914f-23fce8aaf04d-image-registry-private-configuration\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.133347 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.133042    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c3615de-d486-481b-914f-23fce8aaf04d-trusted-ca\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.133347 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.133119    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-snapshots\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.133347 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.133124    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c3615de-d486-481b-914f-23fce8aaf04d-installation-pull-secrets\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.133347 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.133231    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-tmp\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.133494 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.133358    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-trusted-ca-bundle\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.135046 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.135024    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-serving-cert\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.135218 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.135201    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-default-certificate\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:34.135314 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.135298    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-stats-auth\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:34.142135 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.142117    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2n4h\" (UniqueName: \"kubernetes.io/projected/0e22064c-5296-4c38-8d82-dca1e4d6a209-kube-api-access-b2n4h\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:34.142826 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.142810    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgstr\" (UniqueName: \"kubernetes.io/projected/cb785aa2-a9a1-4501-ad29-0ec94b0675ca-kube-api-access-dgstr\") pod \"insights-operator-77696685b-wxw48\" (UID: \"cb785aa2-a9a1-4501-ad29-0ec94b0675ca\") " pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.237947 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.234575    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c3615de-d486-481b-914f-23fce8aaf04d-image-registry-private-configuration\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.237947 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.234642    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c3615de-d486-481b-914f-23fce8aaf04d-trusted-ca\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.237947 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.234669    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c3615de-d486-481b-914f-23fce8aaf04d-installation-pull-secrets\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.237947 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.234707    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a78b03fa-ab27-4065-915a-9b9658f59304-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-v6nfr\" (UID: \"a78b03fa-ab27-4065-915a-9b9658f59304\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr"
Aug 04 17:50:34.237947 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.234738    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-bound-sa-token\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.237947 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.234771    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xgb6\" (UniqueName: \"kubernetes.io/projected/5b76b84a-d54e-4d20-81ca-2c09c28a073f-kube-api-access-7xgb6\") pod \"cluster-samples-operator-559cbf5745-q5xqk\" (UID: \"5b76b84a-d54e-4d20-81ca-2c09c28a073f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk"
Aug 04 17:50:34.237947 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.234834    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vv4w\" (UniqueName: \"kubernetes.io/projected/a78b03fa-ab27-4065-915a-9b9658f59304-kube-api-access-6vv4w\") pod \"kube-storage-version-migrator-operator-7878f4b88c-v6nfr\" (UID: \"a78b03fa-ab27-4065-915a-9b9658f59304\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr"
Aug 04 17:50:34.237947 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.234881    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8plf6\" (UniqueName: \"kubernetes.io/projected/e6d22f11-554c-4e0f-90ad-c549cf25e84a-kube-api-access-8plf6\") pod \"network-check-source-65bdbbff45-pmwjr\" (UID: \"e6d22f11-554c-4e0f-90ad-c549cf25e84a\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pmwjr"
Aug 04 17:50:34.237947 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.234943    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-q5xqk\" (UID: \"5b76b84a-d54e-4d20-81ca-2c09c28a073f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk"
Aug 04 17:50:34.237947 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.234985    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c3615de-d486-481b-914f-23fce8aaf04d-ca-trust-extracted\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.237947 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.235014    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c3615de-d486-481b-914f-23fce8aaf04d-registry-certificates\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.237947 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.235049    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.237947 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.235076    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a78b03fa-ab27-4065-915a-9b9658f59304-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-v6nfr\" (UID: \"a78b03fa-ab27-4065-915a-9b9658f59304\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr"
Aug 04 17:50:34.237947 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.235141    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nstsp\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-kube-api-access-nstsp\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.238700 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.238638    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c3615de-d486-481b-914f-23fce8aaf04d-registry-certificates\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.238700 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.238662    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c3615de-d486-481b-914f-23fce8aaf04d-image-registry-private-configuration\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.238807 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.238764    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a78b03fa-ab27-4065-915a-9b9658f59304-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-v6nfr\" (UID: \"a78b03fa-ab27-4065-915a-9b9658f59304\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr"
Aug 04 17:50:34.238860 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:34.238810    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 17:50:34.238860 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:34.238828    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c9857f644-6bxl2: secret "image-registry-tls" not found
Aug 04 17:50:34.238976 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:34.238902    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls podName:2c3615de-d486-481b-914f-23fce8aaf04d nodeName:}" failed. No retries permitted until 2026-08-04 17:50:34.738880631 +0000 UTC m=+219.648770212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls") pod "image-registry-6c9857f644-6bxl2" (UID: "2c3615de-d486-481b-914f-23fce8aaf04d") : secret "image-registry-tls" not found
Aug 04 17:50:34.239076 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:34.239057    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 17:50:34.239328 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.239280    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c3615de-d486-481b-914f-23fce8aaf04d-ca-trust-extracted\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.239489 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:34.239444    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls podName:5b76b84a-d54e-4d20-81ca-2c09c28a073f nodeName:}" failed. No retries permitted until 2026-08-04 17:50:34.739423097 +0000 UTC m=+219.649312677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-q5xqk" (UID: "5b76b84a-d54e-4d20-81ca-2c09c28a073f") : secret "samples-operator-tls" not found
Aug 04 17:50:34.240089 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.240065    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c3615de-d486-481b-914f-23fce8aaf04d-trusted-ca\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.240955 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.240938    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a78b03fa-ab27-4065-915a-9b9658f59304-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-v6nfr\" (UID: \"a78b03fa-ab27-4065-915a-9b9658f59304\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr"
Aug 04 17:50:34.241014 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.240965    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c3615de-d486-481b-914f-23fce8aaf04d-installation-pull-secrets\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.244192 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.244170    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nstsp\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-kube-api-access-nstsp\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.245361 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.245339    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-bound-sa-token\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.245434 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.245386    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xgb6\" (UniqueName: \"kubernetes.io/projected/5b76b84a-d54e-4d20-81ca-2c09c28a073f-kube-api-access-7xgb6\") pod \"cluster-samples-operator-559cbf5745-q5xqk\" (UID: \"5b76b84a-d54e-4d20-81ca-2c09c28a073f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk"
Aug 04 17:50:34.246519 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.246502    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8plf6\" (UniqueName: \"kubernetes.io/projected/e6d22f11-554c-4e0f-90ad-c549cf25e84a-kube-api-access-8plf6\") pod \"network-check-source-65bdbbff45-pmwjr\" (UID: \"e6d22f11-554c-4e0f-90ad-c549cf25e84a\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pmwjr"
Aug 04 17:50:34.246682 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.246662    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vv4w\" (UniqueName: \"kubernetes.io/projected/a78b03fa-ab27-4065-915a-9b9658f59304-kube-api-access-6vv4w\") pod \"kube-storage-version-migrator-operator-7878f4b88c-v6nfr\" (UID: \"a78b03fa-ab27-4065-915a-9b9658f59304\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr"
Aug 04 17:50:34.273214 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.273197    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-wxw48"
Aug 04 17:50:34.360847 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.360822    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pmwjr"
Aug 04 17:50:34.367308 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.367288    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr"
Aug 04 17:50:34.392384 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.392350    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-wxw48"]
Aug 04 17:50:34.395463 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:50:34.395433    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb785aa2_a9a1_4501_ad29_0ec94b0675ca.slice/crio-4a17855d5376eb30b489373b88b0931336177ebd34d886df2f4e962fedeca55e WatchSource:0}: Error finding container 4a17855d5376eb30b489373b88b0931336177ebd34d886df2f4e962fedeca55e: Status 404 returned error can't find the container with id 4a17855d5376eb30b489373b88b0931336177ebd34d886df2f4e962fedeca55e
Aug 04 17:50:34.421444 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.421309    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-wxw48" event={"ID":"cb785aa2-a9a1-4501-ad29-0ec94b0675ca","Type":"ContainerStarted","Data":"4a17855d5376eb30b489373b88b0931336177ebd34d886df2f4e962fedeca55e"}
Aug 04 17:50:34.491795 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.491720    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-pmwjr"]
Aug 04 17:50:34.495294 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:50:34.495270    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d22f11_554c_4e0f_90ad_c549cf25e84a.slice/crio-3622b84a4a62426b2ad2b350be1644c1cb6907018075d0130b4bc65be3a947d2 WatchSource:0}: Error finding container 3622b84a4a62426b2ad2b350be1644c1cb6907018075d0130b4bc65be3a947d2: Status 404 returned error can't find the container with id 3622b84a4a62426b2ad2b350be1644c1cb6907018075d0130b4bc65be3a947d2
Aug 04 17:50:34.504848 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.504827    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr"]
Aug 04 17:50:34.507956 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:50:34.507931    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda78b03fa_ab27_4065_915a_9b9658f59304.slice/crio-6f8bbe7c785faedbad5b92fa3f55010a590f422616300c0923729ae64dab562c WatchSource:0}: Error finding container 6f8bbe7c785faedbad5b92fa3f55010a590f422616300c0923729ae64dab562c: Status 404 returned error can't find the container with id 6f8bbe7c785faedbad5b92fa3f55010a590f422616300c0923729ae64dab562c
Aug 04 17:50:34.637770 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.637737    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:34.637939 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.637814    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:34.637939 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:34.637937    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 17:50:34.638051 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:34.637957    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle podName:0e22064c-5296-4c38-8d82-dca1e4d6a209 nodeName:}" failed. No retries permitted until 2026-08-04 17:50:35.637914488 +0000 UTC m=+220.547804054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle") pod "router-default-555484c5bd-f27lq" (UID: "0e22064c-5296-4c38-8d82-dca1e4d6a209") : configmap references non-existent config key: service-ca.crt
Aug 04 17:50:34.638051 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:34.637986    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs podName:0e22064c-5296-4c38-8d82-dca1e4d6a209 nodeName:}" failed. No retries permitted until 2026-08-04 17:50:35.637973472 +0000 UTC m=+220.547863042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs") pod "router-default-555484c5bd-f27lq" (UID: "0e22064c-5296-4c38-8d82-dca1e4d6a209") : secret "router-metrics-certs-default" not found
Aug 04 17:50:34.839547 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.839514    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:34.839718 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:34.839685    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 17:50:34.839718 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:34.839706    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c9857f644-6bxl2: secret "image-registry-tls" not found
Aug 04 17:50:34.839828 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:34.839691    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-q5xqk\" (UID: \"5b76b84a-d54e-4d20-81ca-2c09c28a073f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk"
Aug 04 17:50:34.839828 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:34.839755    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 17:50:34.839828 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:34.839760    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls podName:2c3615de-d486-481b-914f-23fce8aaf04d nodeName:}" failed. No retries permitted until 2026-08-04 17:50:35.83974163 +0000 UTC m=+220.749631209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls") pod "image-registry-6c9857f644-6bxl2" (UID: "2c3615de-d486-481b-914f-23fce8aaf04d") : secret "image-registry-tls" not found
Aug 04 17:50:34.839828 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:34.839811    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls podName:5b76b84a-d54e-4d20-81ca-2c09c28a073f nodeName:}" failed. No retries permitted until 2026-08-04 17:50:35.839800142 +0000 UTC m=+220.749689711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-q5xqk" (UID: "5b76b84a-d54e-4d20-81ca-2c09c28a073f") : secret "samples-operator-tls" not found
Aug 04 17:50:35.426342 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:35.426276    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr" event={"ID":"a78b03fa-ab27-4065-915a-9b9658f59304","Type":"ContainerStarted","Data":"6f8bbe7c785faedbad5b92fa3f55010a590f422616300c0923729ae64dab562c"}
Aug 04 17:50:35.428223 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:35.428200    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pmwjr" event={"ID":"e6d22f11-554c-4e0f-90ad-c549cf25e84a","Type":"ContainerStarted","Data":"b9c02aad729ef7daf8f3dbd9cf62db5ea8f9cc741b90ce86187285bc006aa8c1"}
Aug 04 17:50:35.428352 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:35.428242    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pmwjr" event={"ID":"e6d22f11-554c-4e0f-90ad-c549cf25e84a","Type":"ContainerStarted","Data":"3622b84a4a62426b2ad2b350be1644c1cb6907018075d0130b4bc65be3a947d2"}
Aug 04 17:50:35.444215 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:35.444045    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pmwjr" podStartSLOduration=1.44402662 podStartE2EDuration="1.44402662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:50:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:50:35.442191837 +0000 UTC m=+220.352081445" watchObservedRunningTime="2026-08-04 17:50:35.44402662 +0000 UTC m=+220.353916211"
Aug 04 17:50:35.646184 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:35.646147    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:35.646350 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:35.646273    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle podName:0e22064c-5296-4c38-8d82-dca1e4d6a209 nodeName:}" failed. No retries permitted until 2026-08-04 17:50:37.646249992 +0000 UTC m=+222.556139577 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle") pod "router-default-555484c5bd-f27lq" (UID: "0e22064c-5296-4c38-8d82-dca1e4d6a209") : configmap references non-existent config key: service-ca.crt
Aug 04 17:50:35.646350 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:35.646324    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:35.646481 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:35.646463    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 17:50:35.646526 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:35.646517    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs podName:0e22064c-5296-4c38-8d82-dca1e4d6a209 nodeName:}" failed. No retries permitted until 2026-08-04 17:50:37.646502495 +0000 UTC m=+222.556392074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs") pod "router-default-555484c5bd-f27lq" (UID: "0e22064c-5296-4c38-8d82-dca1e4d6a209") : secret "router-metrics-certs-default" not found
Aug 04 17:50:35.847876 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:35.847841    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-q5xqk\" (UID: \"5b76b84a-d54e-4d20-81ca-2c09c28a073f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk"
Aug 04 17:50:35.848082 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:35.847895    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:35.848082 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:35.848031    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 17:50:35.848202 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:35.848099    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls podName:5b76b84a-d54e-4d20-81ca-2c09c28a073f nodeName:}" failed. No retries permitted until 2026-08-04 17:50:37.848078762 +0000 UTC m=+222.757968328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-q5xqk" (UID: "5b76b84a-d54e-4d20-81ca-2c09c28a073f") : secret "samples-operator-tls" not found
Aug 04 17:50:35.848202 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:35.848035    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 17:50:35.848202 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:35.848150    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c9857f644-6bxl2: secret "image-registry-tls" not found
Aug 04 17:50:35.848202 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:35.848194    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls podName:2c3615de-d486-481b-914f-23fce8aaf04d nodeName:}" failed. No retries permitted until 2026-08-04 17:50:37.84818213 +0000 UTC m=+222.758071700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls") pod "image-registry-6c9857f644-6bxl2" (UID: "2c3615de-d486-481b-914f-23fce8aaf04d") : secret "image-registry-tls" not found
Aug 04 17:50:37.440267 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:37.440181    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-wxw48" event={"ID":"cb785aa2-a9a1-4501-ad29-0ec94b0675ca","Type":"ContainerStarted","Data":"a36f4e424e44b16efb922c497294b81f3a3f3f23faa831a662a3113f534576b0"}
Aug 04 17:50:37.441706 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:37.441679    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr" event={"ID":"a78b03fa-ab27-4065-915a-9b9658f59304","Type":"ContainerStarted","Data":"16e3689738cad5a26312d4aa49e71b786af224633c5e28db73ea91485eda91ab"}
Aug 04 17:50:37.455092 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:37.455054    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-wxw48" podStartSLOduration=1.7727280840000001 podStartE2EDuration="4.455037842s" totalImagesPullingTime="2.682309758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:50:37.454755671 +0000 UTC m=+222.364645259" watchObservedRunningTime="2026-08-04 17:50:37.455037842 +0000 UTC m=+222.364927430"
Aug 04 17:50:37.469288 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:37.469237    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr" podStartSLOduration=0.899314374 podStartE2EDuration="3.469219683s" totalImagesPullingTime="2.569905309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:50:37.468439541 +0000 UTC m=+222.378329176" watchObservedRunningTime="2026-08-04 17:50:37.469219683 +0000 UTC m=+222.379109278"
Aug 04 17:50:37.660122 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:37.660089    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:37.660278 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:37.660138    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:37.660278 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:37.660231    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 17:50:37.660395 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:37.660288    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs podName:0e22064c-5296-4c38-8d82-dca1e4d6a209 nodeName:}" failed. No retries permitted until 2026-08-04 17:50:41.660272195 +0000 UTC m=+226.570161767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs") pod "router-default-555484c5bd-f27lq" (UID: "0e22064c-5296-4c38-8d82-dca1e4d6a209") : secret "router-metrics-certs-default" not found
Aug 04 17:50:37.660395 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:37.660302    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle podName:0e22064c-5296-4c38-8d82-dca1e4d6a209 nodeName:}" failed. No retries permitted until 2026-08-04 17:50:41.660296825 +0000 UTC m=+226.570186395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle") pod "router-default-555484c5bd-f27lq" (UID: "0e22064c-5296-4c38-8d82-dca1e4d6a209") : configmap references non-existent config key: service-ca.crt
Aug 04 17:50:37.861708 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:37.861669    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:37.861862 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:37.861798    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 17:50:37.861862 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:37.861820    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c9857f644-6bxl2: secret "image-registry-tls" not found
Aug 04 17:50:37.861862 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:37.861826    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-q5xqk\" (UID: \"5b76b84a-d54e-4d20-81ca-2c09c28a073f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk"
Aug 04 17:50:37.862012 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:37.861880    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls podName:2c3615de-d486-481b-914f-23fce8aaf04d nodeName:}" failed. No retries permitted until 2026-08-04 17:50:41.86186014 +0000 UTC m=+226.771749708 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls") pod "image-registry-6c9857f644-6bxl2" (UID: "2c3615de-d486-481b-914f-23fce8aaf04d") : secret "image-registry-tls" not found
Aug 04 17:50:37.862012 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:37.861960    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 17:50:37.862088 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:37.862015    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls podName:5b76b84a-d54e-4d20-81ca-2c09c28a073f nodeName:}" failed. No retries permitted until 2026-08-04 17:50:41.861999832 +0000 UTC m=+226.771889405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-q5xqk" (UID: "5b76b84a-d54e-4d20-81ca-2c09c28a073f") : secret "samples-operator-tls" not found
Aug 04 17:50:38.468628 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.468591    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6dbtk"]
Aug 04 17:50:38.471165 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.471145    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:38.473405 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.473326    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 17:50:38.473525 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.473487    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 17:50:38.473872 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.473857    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tv89b\""
Aug 04 17:50:38.481661 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.481642    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6dbtk"]
Aug 04 17:50:38.568040 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.568005    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k682v\" (UniqueName: \"kubernetes.io/projected/c69247c0-d792-4110-89f6-abd9b723d10a-kube-api-access-k682v\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:38.568189 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.568145    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:38.568295 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.568273    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c69247c0-d792-4110-89f6-abd9b723d10a-data-volume\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:38.568353 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.568331    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:38.568453 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.568412    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c69247c0-d792-4110-89f6-abd9b723d10a-crio-socket\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:38.668738 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.668711    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c69247c0-d792-4110-89f6-abd9b723d10a-data-volume\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:38.668862 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.668753    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:38.668907 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:38.668858    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:38.668907 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.668892    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c69247c0-d792-4110-89f6-abd9b723d10a-crio-socket\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:38.669019 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:38.668929    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls podName:c69247c0-d792-4110-89f6-abd9b723d10a nodeName:}" failed. No retries permitted until 2026-08-04 17:50:39.168896032 +0000 UTC m=+224.078785601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6dbtk" (UID: "c69247c0-d792-4110-89f6-abd9b723d10a") : secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:38.669019 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.668981    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c69247c0-d792-4110-89f6-abd9b723d10a-crio-socket\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:38.669019 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.668986    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k682v\" (UniqueName: \"kubernetes.io/projected/c69247c0-d792-4110-89f6-abd9b723d10a-kube-api-access-k682v\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:38.669179 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.669107    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c69247c0-d792-4110-89f6-abd9b723d10a-data-volume\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:38.669179 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.669116    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:38.669179 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:38.669165    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 17:50:38.669322 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:38.669217    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm podName:c69247c0-d792-4110-89f6-abd9b723d10a nodeName:}" failed. No retries permitted until 2026-08-04 17:50:39.169202706 +0000 UTC m=+224.079092274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6dbtk" (UID: "c69247c0-d792-4110-89f6-abd9b723d10a") : configmap "kube-rbac-proxy" not found
Aug 04 17:50:38.678703 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:38.678679    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k682v\" (UniqueName: \"kubernetes.io/projected/c69247c0-d792-4110-89f6-abd9b723d10a-kube-api-access-k682v\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:39.172989 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:39.172953    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:39.173252 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:39.173017    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:39.173252 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:39.173074    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 17:50:39.173252 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:39.173104    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:39.173252 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:39.173149    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm podName:c69247c0-d792-4110-89f6-abd9b723d10a nodeName:}" failed. No retries permitted until 2026-08-04 17:50:40.173133275 +0000 UTC m=+225.083022840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6dbtk" (UID: "c69247c0-d792-4110-89f6-abd9b723d10a") : configmap "kube-rbac-proxy" not found
Aug 04 17:50:39.173252 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:39.173169    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls podName:c69247c0-d792-4110-89f6-abd9b723d10a nodeName:}" failed. No retries permitted until 2026-08-04 17:50:40.17316226 +0000 UTC m=+225.083051825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6dbtk" (UID: "c69247c0-d792-4110-89f6-abd9b723d10a") : secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:40.180221 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:40.180187    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:40.180626 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:40.180250    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:40.180626 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:40.180372    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 17:50:40.180626 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:40.180384    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:40.180626 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:40.180436    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm podName:c69247c0-d792-4110-89f6-abd9b723d10a nodeName:}" failed. No retries permitted until 2026-08-04 17:50:42.180420845 +0000 UTC m=+227.090310413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6dbtk" (UID: "c69247c0-d792-4110-89f6-abd9b723d10a") : configmap "kube-rbac-proxy" not found
Aug 04 17:50:40.180626 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:40.180450    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls podName:c69247c0-d792-4110-89f6-abd9b723d10a nodeName:}" failed. No retries permitted until 2026-08-04 17:50:42.180444063 +0000 UTC m=+227.090333629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6dbtk" (UID: "c69247c0-d792-4110-89f6-abd9b723d10a") : secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:40.635260 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:40.635234    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v9vlx_b132d677-de62-4ae6-8819-70add7cd8664/dns-node-resolver/0.log"
Aug 04 17:50:41.635664 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:41.635638    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hhd6t_d075b2ff-c092-4dd0-86ca-90badefc19e2/node-ca/0.log"
Aug 04 17:50:41.694140 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:41.694085    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:41.694304 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:41.694180    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:41.694304 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:41.694233    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 17:50:41.694304 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:41.694292    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs podName:0e22064c-5296-4c38-8d82-dca1e4d6a209 nodeName:}" failed. No retries permitted until 2026-08-04 17:50:49.694276367 +0000 UTC m=+234.604165933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs") pod "router-default-555484c5bd-f27lq" (UID: "0e22064c-5296-4c38-8d82-dca1e4d6a209") : secret "router-metrics-certs-default" not found
Aug 04 17:50:41.694432 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:41.694345    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle podName:0e22064c-5296-4c38-8d82-dca1e4d6a209 nodeName:}" failed. No retries permitted until 2026-08-04 17:50:49.694327614 +0000 UTC m=+234.604217181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle") pod "router-default-555484c5bd-f27lq" (UID: "0e22064c-5296-4c38-8d82-dca1e4d6a209") : configmap references non-existent config key: service-ca.crt
Aug 04 17:50:41.895683 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:41.895603    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-q5xqk\" (UID: \"5b76b84a-d54e-4d20-81ca-2c09c28a073f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk"
Aug 04 17:50:41.895683 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:41.895654    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:41.895856 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:41.895735    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 17:50:41.895856 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:41.895746    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c9857f644-6bxl2: secret "image-registry-tls" not found
Aug 04 17:50:41.895856 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:41.895734    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 17:50:41.895856 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:41.895797    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls podName:2c3615de-d486-481b-914f-23fce8aaf04d nodeName:}" failed. No retries permitted until 2026-08-04 17:50:49.895783847 +0000 UTC m=+234.805673416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls") pod "image-registry-6c9857f644-6bxl2" (UID: "2c3615de-d486-481b-914f-23fce8aaf04d") : secret "image-registry-tls" not found
Aug 04 17:50:41.895856 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:41.895824    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls podName:5b76b84a-d54e-4d20-81ca-2c09c28a073f nodeName:}" failed. No retries permitted until 2026-08-04 17:50:49.895811164 +0000 UTC m=+234.805700729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-q5xqk" (UID: "5b76b84a-d54e-4d20-81ca-2c09c28a073f") : secret "samples-operator-tls" not found
Aug 04 17:50:42.197097 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:42.197026    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:42.197097 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:42.197072    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:42.197267 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:42.197135    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 17:50:42.197267 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:42.197178    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:42.197267 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:42.197194    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm podName:c69247c0-d792-4110-89f6-abd9b723d10a nodeName:}" failed. No retries permitted until 2026-08-04 17:50:46.197178865 +0000 UTC m=+231.107068431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6dbtk" (UID: "c69247c0-d792-4110-89f6-abd9b723d10a") : configmap "kube-rbac-proxy" not found
Aug 04 17:50:42.197267 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:42.197213    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls podName:c69247c0-d792-4110-89f6-abd9b723d10a nodeName:}" failed. No retries permitted until 2026-08-04 17:50:46.197203136 +0000 UTC m=+231.107092702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6dbtk" (UID: "c69247c0-d792-4110-89f6-abd9b723d10a") : secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:42.434555 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:42.434532    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x8fdb_571b97b3-7164-4be6-96f6-70ae0783e371/serve-healthcheck-canary/0.log"
Aug 04 17:50:46.228826 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:46.228791    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:46.229285 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:46.228846    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:46.229285 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:46.228914    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 17:50:46.229285 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:46.229004    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm podName:c69247c0-d792-4110-89f6-abd9b723d10a nodeName:}" failed. No retries permitted until 2026-08-04 17:50:54.228986607 +0000 UTC m=+239.138876173 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6dbtk" (UID: "c69247c0-d792-4110-89f6-abd9b723d10a") : configmap "kube-rbac-proxy" not found
Aug 04 17:50:46.229285 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:46.229016    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:46.229285 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:50:46.229064    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls podName:c69247c0-d792-4110-89f6-abd9b723d10a nodeName:}" failed. No retries permitted until 2026-08-04 17:50:54.229050611 +0000 UTC m=+239.138940182 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6dbtk" (UID: "c69247c0-d792-4110-89f6-abd9b723d10a") : secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:49.756510 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:49.756476    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:49.756877 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:49.756532    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:49.757105 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:49.757087    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22064c-5296-4c38-8d82-dca1e4d6a209-service-ca-bundle\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:49.758889 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:49.758863    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22064c-5296-4c38-8d82-dca1e4d6a209-metrics-certs\") pod \"router-default-555484c5bd-f27lq\" (UID: \"0e22064c-5296-4c38-8d82-dca1e4d6a209\") " pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:49.878659 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:49.878628    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:49.958458 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:49.958428    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:49.958594 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:49.958525    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-q5xqk\" (UID: \"5b76b84a-d54e-4d20-81ca-2c09c28a073f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk"
Aug 04 17:50:49.960655 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:49.960626    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b76b84a-d54e-4d20-81ca-2c09c28a073f-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-q5xqk\" (UID: \"5b76b84a-d54e-4d20-81ca-2c09c28a073f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk"
Aug 04 17:50:49.960750 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:49.960693    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls\") pod \"image-registry-6c9857f644-6bxl2\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") " pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:49.975574 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:49.975536    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk"
Aug 04 17:50:49.981317 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:49.981299    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:50.009049 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:50.008779    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-555484c5bd-f27lq"]
Aug 04 17:50:50.011387 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:50:50.011359    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e22064c_5296_4c38_8d82_dca1e4d6a209.slice/crio-65d132253b3c6de31a5c1d7d0667519c0b31144a8ad1010b802fb27b077a896a WatchSource:0}: Error finding container 65d132253b3c6de31a5c1d7d0667519c0b31144a8ad1010b802fb27b077a896a: Status 404 returned error can't find the container with id 65d132253b3c6de31a5c1d7d0667519c0b31144a8ad1010b802fb27b077a896a
Aug 04 17:50:50.107371 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:50.107335    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk"]
Aug 04 17:50:50.126936 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:50.126854    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c9857f644-6bxl2"]
Aug 04 17:50:50.129862 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:50:50.129839    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3615de_d486_481b_914f_23fce8aaf04d.slice/crio-7e982b8cb3ce97506e93176c7f1f82d3ee61fabdac2772bbf915b7cb95955971 WatchSource:0}: Error finding container 7e982b8cb3ce97506e93176c7f1f82d3ee61fabdac2772bbf915b7cb95955971: Status 404 returned error can't find the container with id 7e982b8cb3ce97506e93176c7f1f82d3ee61fabdac2772bbf915b7cb95955971
Aug 04 17:50:50.480998 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:50.480962    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c9857f644-6bxl2" event={"ID":"2c3615de-d486-481b-914f-23fce8aaf04d","Type":"ContainerStarted","Data":"56a762150bd4a07390b52b425ab5d693467f898fbbecd44f9635d97c71662061"}
Aug 04 17:50:50.481188 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:50.481077    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:50:50.481188 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:50.481137    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c9857f644-6bxl2" event={"ID":"2c3615de-d486-481b-914f-23fce8aaf04d","Type":"ContainerStarted","Data":"7e982b8cb3ce97506e93176c7f1f82d3ee61fabdac2772bbf915b7cb95955971"}
Aug 04 17:50:50.482132 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:50.482105    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk" event={"ID":"5b76b84a-d54e-4d20-81ca-2c09c28a073f","Type":"ContainerStarted","Data":"78d9ee0cbdb5bd089a41b0ceb8678d3cbcc4f949ff40e051f015deb0495a0bc9"}
Aug 04 17:50:50.483540 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:50.483521    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-555484c5bd-f27lq" event={"ID":"0e22064c-5296-4c38-8d82-dca1e4d6a209","Type":"ContainerStarted","Data":"54eb53de74a0e10383abc8f12e2fc0c92dedeccd4b03248aed57254359cd59db"}
Aug 04 17:50:50.483657 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:50.483550    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-555484c5bd-f27lq" event={"ID":"0e22064c-5296-4c38-8d82-dca1e4d6a209","Type":"ContainerStarted","Data":"65d132253b3c6de31a5c1d7d0667519c0b31144a8ad1010b802fb27b077a896a"}
Aug 04 17:50:50.497879 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:50.497840    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c9857f644-6bxl2" podStartSLOduration=16.497828092 podStartE2EDuration="16.497828092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:50:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:50:50.497096539 +0000 UTC m=+235.406986144" watchObservedRunningTime="2026-08-04 17:50:50.497828092 +0000 UTC m=+235.407717657"
Aug 04 17:50:50.512009 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:50.511974    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-555484c5bd-f27lq" podStartSLOduration=17.511962345 podStartE2EDuration="17.511962345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:50:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:50:50.511796894 +0000 UTC m=+235.421686508" watchObservedRunningTime="2026-08-04 17:50:50.511962345 +0000 UTC m=+235.421851933"
Aug 04 17:50:50.879448 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:50.879417    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:50.882111 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:50.882085    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:51.487424 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:51.487368    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:51.491438 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:51.489119    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-555484c5bd-f27lq"
Aug 04 17:50:52.492162 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:52.492134    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk" event={"ID":"5b76b84a-d54e-4d20-81ca-2c09c28a073f","Type":"ContainerStarted","Data":"ecd72427d49a533bd9e4cb6d691608e5880981d746b2fcb9a29fc8e9e536dd3c"}
Aug 04 17:50:52.492575 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:52.492182    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk" event={"ID":"5b76b84a-d54e-4d20-81ca-2c09c28a073f","Type":"ContainerStarted","Data":"b923f389eb56a4f69d334ec7a690e9d0c7b6b40f6dafa64e92d4d4a039013395"}
Aug 04 17:50:52.507524 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:52.507484    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-q5xqk" podStartSLOduration=16.32471188 podStartE2EDuration="18.507467851s" totalImagesPullingTime="2.182755971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:50:52.505960189 +0000 UTC m=+237.415849797" watchObservedRunningTime="2026-08-04 17:50:52.507467851 +0000 UTC m=+237.417357440"
Aug 04 17:50:54.293868 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:54.293810    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:54.293868 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:54.293875    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:54.294380 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:54.294359    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c69247c0-d792-4110-89f6-abd9b723d10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:54.296120 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:54.296096    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c69247c0-d792-4110-89f6-abd9b723d10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dbtk\" (UID: \"c69247c0-d792-4110-89f6-abd9b723d10a\") " pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:54.380230 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:54.380195    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6dbtk"
Aug 04 17:50:54.498120 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:54.498088    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6dbtk"]
Aug 04 17:50:54.501930 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:50:54.501892    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69247c0_d792_4110_89f6_abd9b723d10a.slice/crio-b89bf5a51cff61e6ebb13eb6232161743b80cdb5513c48ea83c6a6c205cf26f7 WatchSource:0}: Error finding container b89bf5a51cff61e6ebb13eb6232161743b80cdb5513c48ea83c6a6c205cf26f7: Status 404 returned error can't find the container with id b89bf5a51cff61e6ebb13eb6232161743b80cdb5513c48ea83c6a6c205cf26f7
Aug 04 17:50:55.504413 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:55.504383    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6dbtk" event={"ID":"c69247c0-d792-4110-89f6-abd9b723d10a","Type":"ContainerStarted","Data":"7c3bef6fdcce8d0363a35e5752a56f9a683a0fe2fd352c8208a0ab1944e5c70e"}
Aug 04 17:50:55.504770 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:55.504467    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6dbtk" event={"ID":"c69247c0-d792-4110-89f6-abd9b723d10a","Type":"ContainerStarted","Data":"03d3616ceb67defa117c68e0271c77d6ca3b626ef8e441aa02078a63e1d1ec77"}
Aug 04 17:50:55.504770 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:55.504488    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6dbtk" event={"ID":"c69247c0-d792-4110-89f6-abd9b723d10a","Type":"ContainerStarted","Data":"b89bf5a51cff61e6ebb13eb6232161743b80cdb5513c48ea83c6a6c205cf26f7"}
Aug 04 17:50:57.512900 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:57.512865    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6dbtk" event={"ID":"c69247c0-d792-4110-89f6-abd9b723d10a","Type":"ContainerStarted","Data":"647f01687e6bf1b4a8797a933a4156e7b990d9ed796144d00c04c97e2f78f775"}
Aug 04 17:50:57.530313 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:50:57.530270    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6dbtk" podStartSLOduration=17.45988174 podStartE2EDuration="19.530256845s" totalImagesPullingTime="2.070375105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:50:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:50:57.529053948 +0000 UTC m=+242.438943551" watchObservedRunningTime="2026-08-04 17:50:57.530256845 +0000 UTC m=+242.440146434"
Aug 04 17:51:03.158964 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:03.158935    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-skr89"]
Aug 04 17:51:03.162174 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:03.162147    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-skr89"
Aug 04 17:51:03.162763 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:03.162741    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c9857f644-6bxl2"]
Aug 04 17:51:03.164530 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:03.164510    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 04 17:51:03.164913 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:03.164897    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kv8x6\""
Aug 04 17:51:03.165267 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:03.165253    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 04 17:51:03.178305 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:03.178287    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-skr89"]
Aug 04 17:51:03.265417 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:03.265387    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-977gn\" (UniqueName: \"kubernetes.io/projected/8bf06a04-e3ab-4711-b939-f1495b47263f-kube-api-access-977gn\") pod \"downloads-77c974ffcf-skr89\" (UID: \"8bf06a04-e3ab-4711-b939-f1495b47263f\") " pod="openshift-console/downloads-77c974ffcf-skr89"
Aug 04 17:51:03.365734 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:03.365706    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-977gn\" (UniqueName: \"kubernetes.io/projected/8bf06a04-e3ab-4711-b939-f1495b47263f-kube-api-access-977gn\") pod \"downloads-77c974ffcf-skr89\" (UID: \"8bf06a04-e3ab-4711-b939-f1495b47263f\") " pod="openshift-console/downloads-77c974ffcf-skr89"
Aug 04 17:51:03.374663 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:03.374644    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-977gn\" (UniqueName: \"kubernetes.io/projected/8bf06a04-e3ab-4711-b939-f1495b47263f-kube-api-access-977gn\") pod \"downloads-77c974ffcf-skr89\" (UID: \"8bf06a04-e3ab-4711-b939-f1495b47263f\") " pod="openshift-console/downloads-77c974ffcf-skr89"
Aug 04 17:51:03.472352 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:03.472289    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-skr89"
Aug 04 17:51:03.591338 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:03.591306    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-skr89"]
Aug 04 17:51:03.594649 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:51:03.594621    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf06a04_e3ab_4711_b939_f1495b47263f.slice/crio-4a5c787bc1af423ec96c919cb83a5a00c344ef4b0946a6fb7b83cdf9307175e1 WatchSource:0}: Error finding container 4a5c787bc1af423ec96c919cb83a5a00c344ef4b0946a6fb7b83cdf9307175e1: Status 404 returned error can't find the container with id 4a5c787bc1af423ec96c919cb83a5a00c344ef4b0946a6fb7b83cdf9307175e1
Aug 04 17:51:04.537869 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:04.537841    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-skr89" event={"ID":"8bf06a04-e3ab-4711-b939-f1495b47263f","Type":"ContainerStarted","Data":"4a5c787bc1af423ec96c919cb83a5a00c344ef4b0946a6fb7b83cdf9307175e1"}
Aug 04 17:51:06.950712 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:06.950680    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69f67d444f-xpnjc"]
Aug 04 17:51:06.953888 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:06.953861    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:06.958606 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:06.957565    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 04 17:51:06.958606 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:06.957582    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7wk8b\""
Aug 04 17:51:06.958606 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:06.957587    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 04 17:51:06.959810 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:06.959626    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 04 17:51:06.959810 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:06.959790    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 04 17:51:06.961063 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:06.960830    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 04 17:51:06.965491 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:06.965468    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69f67d444f-xpnjc"]
Aug 04 17:51:07.098591 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.098555    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-oauth-config\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.098748 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.098617    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-config\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.098748 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.098688    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8vcq\" (UniqueName: \"kubernetes.io/projected/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-kube-api-access-j8vcq\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.098874 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.098753    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-serving-cert\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.098874 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.098784    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-oauth-serving-cert\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.098874 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.098829    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-service-ca\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.199691 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.199654    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-oauth-config\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.199867 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.199700    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-config\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.199867 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.199721    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8vcq\" (UniqueName: \"kubernetes.io/projected/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-kube-api-access-j8vcq\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.199867 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.199777    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-serving-cert\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.199867 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.199807    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-oauth-serving-cert\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.199867 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.199833    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-service-ca\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.200570 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.200529    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-config\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.200570 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.200529    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-service-ca\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.201208 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.201098    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-oauth-serving-cert\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.202654 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.202610    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-oauth-config\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.202748 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.202686    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-serving-cert\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.208061 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.208041    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8vcq\" (UniqueName: \"kubernetes.io/projected/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-kube-api-access-j8vcq\") pod \"console-69f67d444f-xpnjc\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") " pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.267907 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.267881    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:07.396421 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.396390    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69f67d444f-xpnjc"]
Aug 04 17:51:07.399222 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:51:07.399195    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5e19e5_fd11_4257_ab5e_63b5867b12ff.slice/crio-8f02276115fd7896021a755fee3f40b32c1d5b8a76c13bc300e26f11d19ea8cc WatchSource:0}: Error finding container 8f02276115fd7896021a755fee3f40b32c1d5b8a76c13bc300e26f11d19ea8cc: Status 404 returned error can't find the container with id 8f02276115fd7896021a755fee3f40b32c1d5b8a76c13bc300e26f11d19ea8cc
Aug 04 17:51:07.401224 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.401112    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs\") pod \"network-metrics-daemon-sftls\" (UID: \"7acf398c-a516-4d37-9792-38cf40564333\") " pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:51:07.403510 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.403491    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7acf398c-a516-4d37-9792-38cf40564333-metrics-certs\") pod \"network-metrics-daemon-sftls\" (UID: \"7acf398c-a516-4d37-9792-38cf40564333\") " pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:51:07.496564 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.496515    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wlqn\""
Aug 04 17:51:07.504781 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.504762    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sftls"
Aug 04 17:51:07.548863 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.548838    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f67d444f-xpnjc" event={"ID":"6e5e19e5-fd11-4257-ab5e-63b5867b12ff","Type":"ContainerStarted","Data":"8f02276115fd7896021a755fee3f40b32c1d5b8a76c13bc300e26f11d19ea8cc"}
Aug 04 17:51:07.641642 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:07.641613    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sftls"]
Aug 04 17:51:07.645243 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:51:07.645211    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7acf398c_a516_4d37_9792_38cf40564333.slice/crio-9b86826453dea42096c7f07ab33dc1d012f128fd8acbbe247fafb0f3dc7775e3 WatchSource:0}: Error finding container 9b86826453dea42096c7f07ab33dc1d012f128fd8acbbe247fafb0f3dc7775e3: Status 404 returned error can't find the container with id 9b86826453dea42096c7f07ab33dc1d012f128fd8acbbe247fafb0f3dc7775e3
Aug 04 17:51:08.554202 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:08.554158    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sftls" event={"ID":"7acf398c-a516-4d37-9792-38cf40564333","Type":"ContainerStarted","Data":"9b86826453dea42096c7f07ab33dc1d012f128fd8acbbe247fafb0f3dc7775e3"}
Aug 04 17:51:09.560600 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:09.560563    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sftls" event={"ID":"7acf398c-a516-4d37-9792-38cf40564333","Type":"ContainerStarted","Data":"ce3543d22799f2204fade72144b3fe6ce1bd6601ec5413e5ee9f7abee8c8e4c8"}
Aug 04 17:51:09.561085 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:09.560628    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sftls" event={"ID":"7acf398c-a516-4d37-9792-38cf40564333","Type":"ContainerStarted","Data":"88797a05af573a2d91664f1fc873d8fde9742eacf9e77185c5731d8221e22040"}
Aug 04 17:51:09.577817 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:09.577752    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sftls" podStartSLOduration=252.202309613 podStartE2EDuration="4m13.577736339s" totalImagesPullingTime="1.375426726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:09.577693452 +0000 UTC m=+254.487583055" watchObservedRunningTime="2026-08-04 17:51:09.577736339 +0000 UTC m=+254.487625926"
Aug 04 17:51:11.570834 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:11.570797    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f67d444f-xpnjc" event={"ID":"6e5e19e5-fd11-4257-ab5e-63b5867b12ff","Type":"ContainerStarted","Data":"3141e47e5e5b99702885c3338843297b3414f4a6df14b28f6f14e0cb6f9e5785"}
Aug 04 17:51:11.591053 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:11.590995    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69f67d444f-xpnjc" podStartSLOduration=2.222082888 podStartE2EDuration="5.590977952s" totalImagesPullingTime="3.368895064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:11.589652353 +0000 UTC m=+256.499541967" watchObservedRunningTime="2026-08-04 17:51:11.590977952 +0000 UTC m=+256.500867540"
Aug 04 17:51:13.168809 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:13.168763    2572 patch_prober.go:28] interesting pod/image-registry-6c9857f644-6bxl2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 04 17:51:13.169299 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:13.168822    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6c9857f644-6bxl2" podUID="2c3615de-d486-481b-914f-23fce8aaf04d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 17:51:14.528707 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.528668    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-687bcb67b5-2np84"]
Aug 04 17:51:14.533224 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.533202    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.541938 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.541512    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 04 17:51:14.542234 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.542212    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687bcb67b5-2np84"]
Aug 04 17:51:14.564932 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.564898    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-trusted-ca-bundle\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.565035 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.564947    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84886892-3736-46ed-8479-9709e1f5f8e1-console-oauth-config\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.565035 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.564972    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-service-ca\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.565035 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.564996    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84886892-3736-46ed-8479-9709e1f5f8e1-console-serving-cert\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.565035 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.565017    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-oauth-serving-cert\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.565203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.565066    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf7d7\" (UniqueName: \"kubernetes.io/projected/84886892-3736-46ed-8479-9709e1f5f8e1-kube-api-access-xf7d7\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.565203 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.565117    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-console-config\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.665849 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.665820    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-trusted-ca-bundle\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.665849 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.665853    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84886892-3736-46ed-8479-9709e1f5f8e1-console-oauth-config\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.666102 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.665870    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-service-ca\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.666102 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.665896    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84886892-3736-46ed-8479-9709e1f5f8e1-console-serving-cert\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.666102 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.666086    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-oauth-serving-cert\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.666315 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.666139    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf7d7\" (UniqueName: \"kubernetes.io/projected/84886892-3736-46ed-8479-9709e1f5f8e1-kube-api-access-xf7d7\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.666315 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.666181    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-console-config\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.666836 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.666807    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-service-ca\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.667047 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.667025    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-trusted-ca-bundle\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.667310 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.667282    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-oauth-serving-cert\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.667310 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.667296    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-console-config\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.668995 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.668975    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84886892-3736-46ed-8479-9709e1f5f8e1-console-serving-cert\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.669077 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.669036    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84886892-3736-46ed-8479-9709e1f5f8e1-console-oauth-config\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.674482 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.674460    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf7d7\" (UniqueName: \"kubernetes.io/projected/84886892-3736-46ed-8479-9709e1f5f8e1-kube-api-access-xf7d7\") pod \"console-687bcb67b5-2np84\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") " pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:14.845293 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:14.845248    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:17.268507 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:17.268418    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:17.268507 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:17.268483    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:17.270193 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:17.270166    2572 patch_prober.go:28] interesting pod/console-69f67d444f-xpnjc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body=
Aug 04 17:51:17.270338 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:17.270224    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-69f67d444f-xpnjc" podUID="6e5e19e5-fd11-4257-ab5e-63b5867b12ff" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused"
Aug 04 17:51:18.126078 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.126043    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"]
Aug 04 17:51:18.129632 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.129606    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"
Aug 04 17:51:18.132389 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.132211    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-l2jnn\""
Aug 04 17:51:18.132389 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.132212    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 17:51:18.132389 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.132311    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Aug 04 17:51:18.133420 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.133363    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 17:51:18.133420 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.133389    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Aug 04 17:51:18.133557 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.133494    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 17:51:18.140496 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.140428    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"]
Aug 04 17:51:18.152536 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.152514    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-szdrk"]
Aug 04 17:51:18.155819 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.155800    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.158013 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.157996    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 17:51:18.158399 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.158376    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 17:51:18.158701 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.158685    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 17:51:18.159602 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.159586    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hmd7r\""
Aug 04 17:51:18.190079 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.190056    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/442bbd6a-e4d9-4901-b3b0-0689a7537b12-metrics-client-ca\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.190184 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.190088    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-accelerators-collector-config\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.190184 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.190115    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0f1705b-dffb-42f1-8f4b-33a632a35088-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-z9k6g\" (UID: \"a0f1705b-dffb-42f1-8f4b-33a632a35088\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"
Aug 04 17:51:18.190311 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.190187    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/442bbd6a-e4d9-4901-b3b0-0689a7537b12-root\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.190311 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.190232    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/442bbd6a-e4d9-4901-b3b0-0689a7537b12-sys\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.190311 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.190269    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-tls\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.190425 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.190311    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-wtmp\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.190425 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.190345    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-textfile\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.190425 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.190389    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wff9\" (UniqueName: \"kubernetes.io/projected/a0f1705b-dffb-42f1-8f4b-33a632a35088-kube-api-access-5wff9\") pod \"openshift-state-metrics-6bb4d7b4dd-z9k6g\" (UID: \"a0f1705b-dffb-42f1-8f4b-33a632a35088\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"
Aug 04 17:51:18.190558 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.190439    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0f1705b-dffb-42f1-8f4b-33a632a35088-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-z9k6g\" (UID: \"a0f1705b-dffb-42f1-8f4b-33a632a35088\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"
Aug 04 17:51:18.190558 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.190461    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.190558 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.190485    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ghl2\" (UniqueName: \"kubernetes.io/projected/442bbd6a-e4d9-4901-b3b0-0689a7537b12-kube-api-access-7ghl2\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.190558 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.190506    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0f1705b-dffb-42f1-8f4b-33a632a35088-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-z9k6g\" (UID: \"a0f1705b-dffb-42f1-8f4b-33a632a35088\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"
Aug 04 17:51:18.290910 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.290875    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/442bbd6a-e4d9-4901-b3b0-0689a7537b12-root\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.291354 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.290941    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/442bbd6a-e4d9-4901-b3b0-0689a7537b12-sys\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.291354 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.290966    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-tls\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.291354 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.290985    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/442bbd6a-e4d9-4901-b3b0-0689a7537b12-root\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.291354 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.291012    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-wtmp\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.291354 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.291052    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-textfile\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.291354 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.291053    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/442bbd6a-e4d9-4901-b3b0-0689a7537b12-sys\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.291354 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.291092    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wff9\" (UniqueName: \"kubernetes.io/projected/a0f1705b-dffb-42f1-8f4b-33a632a35088-kube-api-access-5wff9\") pod \"openshift-state-metrics-6bb4d7b4dd-z9k6g\" (UID: \"a0f1705b-dffb-42f1-8f4b-33a632a35088\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"
Aug 04 17:51:18.291354 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:51:18.291101    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Aug 04 17:51:18.291354 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.291120    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0f1705b-dffb-42f1-8f4b-33a632a35088-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-z9k6g\" (UID: \"a0f1705b-dffb-42f1-8f4b-33a632a35088\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"
Aug 04 17:51:18.291354 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.291144    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.291354 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:51:18.291165    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-tls podName:442bbd6a-e4d9-4901-b3b0-0689a7537b12 nodeName:}" failed. No retries permitted until 2026-08-04 17:51:18.791147506 +0000 UTC m=+263.701037079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-tls") pod "node-exporter-szdrk" (UID: "442bbd6a-e4d9-4901-b3b0-0689a7537b12") : secret "node-exporter-tls" not found
Aug 04 17:51:18.291354 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.291195    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ghl2\" (UniqueName: \"kubernetes.io/projected/442bbd6a-e4d9-4901-b3b0-0689a7537b12-kube-api-access-7ghl2\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.291354 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.291204    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-wtmp\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.291354 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.291221    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0f1705b-dffb-42f1-8f4b-33a632a35088-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-z9k6g\" (UID: \"a0f1705b-dffb-42f1-8f4b-33a632a35088\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"
Aug 04 17:51:18.291354 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.291265    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/442bbd6a-e4d9-4901-b3b0-0689a7537b12-metrics-client-ca\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.291354 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.291296    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-accelerators-collector-config\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.292176 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.291326    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0f1705b-dffb-42f1-8f4b-33a632a35088-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-z9k6g\" (UID: \"a0f1705b-dffb-42f1-8f4b-33a632a35088\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"
Aug 04 17:51:18.292176 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.291391    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-textfile\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.292176 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.292073    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/442bbd6a-e4d9-4901-b3b0-0689a7537b12-metrics-client-ca\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.292303 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.292173    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0f1705b-dffb-42f1-8f4b-33a632a35088-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-z9k6g\" (UID: \"a0f1705b-dffb-42f1-8f4b-33a632a35088\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"
Aug 04 17:51:18.292303 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.292191    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-accelerators-collector-config\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.294122 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.294097    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0f1705b-dffb-42f1-8f4b-33a632a35088-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-z9k6g\" (UID: \"a0f1705b-dffb-42f1-8f4b-33a632a35088\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"
Aug 04 17:51:18.294122 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.294111    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.294296 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.294257    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0f1705b-dffb-42f1-8f4b-33a632a35088-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-z9k6g\" (UID: \"a0f1705b-dffb-42f1-8f4b-33a632a35088\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"
Aug 04 17:51:18.300486 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.300467    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wff9\" (UniqueName: \"kubernetes.io/projected/a0f1705b-dffb-42f1-8f4b-33a632a35088-kube-api-access-5wff9\") pod \"openshift-state-metrics-6bb4d7b4dd-z9k6g\" (UID: \"a0f1705b-dffb-42f1-8f4b-33a632a35088\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"
Aug 04 17:51:18.300581 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.300548    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ghl2\" (UniqueName: \"kubernetes.io/projected/442bbd6a-e4d9-4901-b3b0-0689a7537b12-kube-api-access-7ghl2\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.440716 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.440625    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"
Aug 04 17:51:18.795525 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.795448    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-tls\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:18.797908 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:18.797880    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/442bbd6a-e4d9-4901-b3b0-0689a7537b12-node-exporter-tls\") pod \"node-exporter-szdrk\" (UID: \"442bbd6a-e4d9-4901-b3b0-0689a7537b12\") " pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:19.065685 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.065656    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-szdrk"
Aug 04 17:51:19.193186 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.193154    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 17:51:19.196786 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.196765    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.199775 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.199175    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 17:51:19.199775 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.199190    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 17:51:19.199775 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.199235    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9sdfm\""
Aug 04 17:51:19.199775 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.199286    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 17:51:19.199775 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.199343    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 17:51:19.199775 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.199569    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 17:51:19.199775 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.199650    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 17:51:19.199775 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.199684    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 17:51:19.200255 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.199938    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 17:51:19.200255 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.199983    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 17:51:19.209671 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.209648    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 17:51:19.299326 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.299291    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c30f500c-b0a5-424b-9eff-6193992a748e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.299755 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.299344    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.299755 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.299372    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.299755 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.299431    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-config-volume\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.299755 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.299480    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-web-config\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.299755 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.299508    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.299755 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.299533    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpf2m\" (UniqueName: \"kubernetes.io/projected/c30f500c-b0a5-424b-9eff-6193992a748e-kube-api-access-lpf2m\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.299755 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.299596    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c30f500c-b0a5-424b-9eff-6193992a748e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.299755 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.299640    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.299755 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.299692    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c30f500c-b0a5-424b-9eff-6193992a748e-config-out\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.299755 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.299715    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.299755 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.299733    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c30f500c-b0a5-424b-9eff-6193992a748e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.299755 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.299753    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c30f500c-b0a5-424b-9eff-6193992a748e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.400450 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.400360    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.400450 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.400419    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.400450 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.400449    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-config-volume\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.400714 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.400485    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-web-config\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.400714 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.400511    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.400714 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.400539    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpf2m\" (UniqueName: \"kubernetes.io/projected/c30f500c-b0a5-424b-9eff-6193992a748e-kube-api-access-lpf2m\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.400714 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.400570    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c30f500c-b0a5-424b-9eff-6193992a748e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.400714 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:51:19.400584    2572 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Aug 04 17:51:19.400714 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.400592    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.400714 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:51:19.400656    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-secret-alertmanager-main-tls podName:c30f500c-b0a5-424b-9eff-6193992a748e nodeName:}" failed. No retries permitted until 2026-08-04 17:51:19.900636254 +0000 UTC m=+264.810525840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c30f500c-b0a5-424b-9eff-6193992a748e") : secret "alertmanager-main-tls" not found
Aug 04 17:51:19.400714 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.400652    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c30f500c-b0a5-424b-9eff-6193992a748e-config-out\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.400714 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.400685    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.400714 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.400719    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c30f500c-b0a5-424b-9eff-6193992a748e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.401241 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.400752    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c30f500c-b0a5-424b-9eff-6193992a748e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.401241 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.400783    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c30f500c-b0a5-424b-9eff-6193992a748e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.401535 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.401500    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c30f500c-b0a5-424b-9eff-6193992a748e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.402028 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.402000    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c30f500c-b0a5-424b-9eff-6193992a748e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.403004 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.402631    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c30f500c-b0a5-424b-9eff-6193992a748e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.403869 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.403553    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.403869 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.403577    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c30f500c-b0a5-424b-9eff-6193992a748e-config-out\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.403869 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.403661    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.404272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.404247    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-config-volume\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.404465 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.404444    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-web-config\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.405351 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.405333    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.405607 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.405583    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.405716 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.405696    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c30f500c-b0a5-424b-9eff-6193992a748e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.411657 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.411631    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpf2m\" (UniqueName: \"kubernetes.io/projected/c30f500c-b0a5-424b-9eff-6193992a748e-kube-api-access-lpf2m\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.905277 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.905244    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:19.907954 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:19.907912    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c30f500c-b0a5-424b-9eff-6193992a748e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c30f500c-b0a5-424b-9eff-6193992a748e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:20.107522 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:20.107490    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 17:51:21.144985 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:51:21.144955    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442bbd6a_e4d9_4901_b3b0_0689a7537b12.slice/crio-8d1aa10493837ca4b96db64312ee9c85953feea90e481cc8fee825585ff6e1c9 WatchSource:0}: Error finding container 8d1aa10493837ca4b96db64312ee9c85953feea90e481cc8fee825585ff6e1c9: Status 404 returned error can't find the container with id 8d1aa10493837ca4b96db64312ee9c85953feea90e481cc8fee825585ff6e1c9
Aug 04 17:51:21.293834 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:21.293808    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 17:51:21.300910 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:51:21.300882    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc30f500c_b0a5_424b_9eff_6193992a748e.slice/crio-bbc518fbe6a0206c7af262c211dafdd28318cff3437877748280e0c6bcb36cfb WatchSource:0}: Error finding container bbc518fbe6a0206c7af262c211dafdd28318cff3437877748280e0c6bcb36cfb: Status 404 returned error can't find the container with id bbc518fbe6a0206c7af262c211dafdd28318cff3437877748280e0c6bcb36cfb
Aug 04 17:51:21.316566 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:21.316505    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g"]
Aug 04 17:51:21.318478 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:51:21.318455    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f1705b_dffb_42f1_8f4b_33a632a35088.slice/crio-2000985439eebecb5bda92e99ca5c1048d66a9523a894b42b3257c05552fb01a WatchSource:0}: Error finding container 2000985439eebecb5bda92e99ca5c1048d66a9523a894b42b3257c05552fb01a: Status 404 returned error can't find the container with id 2000985439eebecb5bda92e99ca5c1048d66a9523a894b42b3257c05552fb01a
Aug 04 17:51:21.333529 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:21.333506    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687bcb67b5-2np84"]
Aug 04 17:51:21.337199 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:51:21.337174    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84886892_3736_46ed_8479_9709e1f5f8e1.slice/crio-e940e910e7fcbc62ef96c3d268971502169560872644636aff2eec0cd001a4c6 WatchSource:0}: Error finding container e940e910e7fcbc62ef96c3d268971502169560872644636aff2eec0cd001a4c6: Status 404 returned error can't find the container with id e940e910e7fcbc62ef96c3d268971502169560872644636aff2eec0cd001a4c6
Aug 04 17:51:21.606769 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:21.606734    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687bcb67b5-2np84" event={"ID":"84886892-3736-46ed-8479-9709e1f5f8e1","Type":"ContainerStarted","Data":"3586563eba613dfc4a6ff72b565dec0ae19e51ca0f3d5acc172540a9728f216d"}
Aug 04 17:51:21.606967 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:21.606948    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687bcb67b5-2np84" event={"ID":"84886892-3736-46ed-8479-9709e1f5f8e1","Type":"ContainerStarted","Data":"e940e910e7fcbc62ef96c3d268971502169560872644636aff2eec0cd001a4c6"}
Aug 04 17:51:21.608100 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:21.608072    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c30f500c-b0a5-424b-9eff-6193992a748e","Type":"ContainerStarted","Data":"bbc518fbe6a0206c7af262c211dafdd28318cff3437877748280e0c6bcb36cfb"}
Aug 04 17:51:21.610258 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:21.610230    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g" event={"ID":"a0f1705b-dffb-42f1-8f4b-33a632a35088","Type":"ContainerStarted","Data":"7aab3bdfe71dd2155407efb4ec73b941b47400562cebe4be8ab292f418ed0f97"}
Aug 04 17:51:21.610372 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:21.610281    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g" event={"ID":"a0f1705b-dffb-42f1-8f4b-33a632a35088","Type":"ContainerStarted","Data":"35d7094f3ab7ac6424bac041c18f5716b9df027ce751e0476eddea79c74d49cb"}
Aug 04 17:51:21.610372 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:21.610304    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g" event={"ID":"a0f1705b-dffb-42f1-8f4b-33a632a35088","Type":"ContainerStarted","Data":"2000985439eebecb5bda92e99ca5c1048d66a9523a894b42b3257c05552fb01a"}
Aug 04 17:51:21.611606 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:21.611581    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-szdrk" event={"ID":"442bbd6a-e4d9-4901-b3b0-0689a7537b12","Type":"ContainerStarted","Data":"8d1aa10493837ca4b96db64312ee9c85953feea90e481cc8fee825585ff6e1c9"}
Aug 04 17:51:21.613274 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:21.613244    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-skr89" event={"ID":"8bf06a04-e3ab-4711-b939-f1495b47263f","Type":"ContainerStarted","Data":"020a1829c7dbbb4ded7cc68bcaff780fb37c7e708655c3c8abddb16638dc46e6"}
Aug 04 17:51:21.613504 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:21.613484    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-skr89"
Aug 04 17:51:21.624340 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:21.624239    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-687bcb67b5-2np84" podStartSLOduration=7.624219293 podStartE2EDuration="7.624219293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:51:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:21.6234735 +0000 UTC m=+266.533363110" watchObservedRunningTime="2026-08-04 17:51:21.624219293 +0000 UTC m=+266.534108882"
Aug 04 17:51:21.627835 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:21.627813    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-skr89"
Aug 04 17:51:21.660226 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:21.659873    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-skr89" podStartSLOduration=1.019628632 podStartE2EDuration="18.659854735s" totalImagesPullingTime="17.640226103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:21.641337724 +0000 UTC m=+266.551227324" watchObservedRunningTime="2026-08-04 17:51:21.659854735 +0000 UTC m=+266.569744325"
Aug 04 17:51:23.168607 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:23.168564    2572 patch_prober.go:28] interesting pod/image-registry-6c9857f644-6bxl2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 04 17:51:23.169024 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:23.168623    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6c9857f644-6bxl2" podUID="2c3615de-d486-481b-914f-23fce8aaf04d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 17:51:23.625234 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:23.625196    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-szdrk" event={"ID":"442bbd6a-e4d9-4901-b3b0-0689a7537b12","Type":"ContainerStarted","Data":"16cad34a8a1867a035c950c5cd14dbb2d3a1c7843542e31fd9ffbdae1c6f35ed"}
Aug 04 17:51:23.627221 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:23.627191    2572 generic.go:356] "Generic (PLEG): container finished" podID="c30f500c-b0a5-424b-9eff-6193992a748e" containerID="026dfb787bfd46dfa3d8ce0cfe9ffd750f380d5c97f5ec941b96d5e00b7e4116" exitCode=0
Aug 04 17:51:23.627341 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:23.627271    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c30f500c-b0a5-424b-9eff-6193992a748e","Type":"ContainerDied","Data":"026dfb787bfd46dfa3d8ce0cfe9ffd750f380d5c97f5ec941b96d5e00b7e4116"}
Aug 04 17:51:23.630194 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:23.630171    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g" event={"ID":"a0f1705b-dffb-42f1-8f4b-33a632a35088","Type":"ContainerStarted","Data":"fbea4355fcd9730265cb2a049cc843794e4cdbfaddf77bc803768702a05fddb3"}
Aug 04 17:51:23.660189 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:23.660131    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-z9k6g" podStartSLOduration=3.682974151 podStartE2EDuration="5.660109605s" totalImagesPullingTime="1.977135454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:23.659685142 +0000 UTC m=+268.569574753" watchObservedRunningTime="2026-08-04 17:51:23.660109605 +0000 UTC m=+268.569999194"
Aug 04 17:51:24.150910 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.150869    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69f67d444f-xpnjc"]
Aug 04 17:51:24.179953 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.179907    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-679667d5b9-56db4"]
Aug 04 17:51:24.196103 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.196065    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-679667d5b9-56db4"]
Aug 04 17:51:24.196103 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.196099    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.248267 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.248219    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-service-ca\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.248267 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.248271    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-oauth-serving-cert\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.248474 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.248320    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-oauth-config\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.248474 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.248344    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-trusted-ca-bundle\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.248474 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.248437    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-serving-cert\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.248609 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.248520    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj4k8\" (UniqueName: \"kubernetes.io/projected/0b730bcc-22b1-4daf-ad49-7828cd5db405-kube-api-access-cj4k8\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.248609 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.248587    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-config\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.349398 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.349355    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-oauth-config\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.349398 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.349403    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-trusted-ca-bundle\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.349677 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.349532    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-serving-cert\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.349677 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.349611    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj4k8\" (UniqueName: \"kubernetes.io/projected/0b730bcc-22b1-4daf-ad49-7828cd5db405-kube-api-access-cj4k8\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.349792 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.349759    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-config\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.349845 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.349816    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-service-ca\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.349995 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.349864    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-oauth-serving-cert\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.350644 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.350495    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-trusted-ca-bundle\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.350799 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.350750    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-service-ca\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.351324 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.351267    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-oauth-serving-cert\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.351626 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.351579    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-config\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.353627 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.353605    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-serving-cert\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.353897 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.353873    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-oauth-config\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.359847 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.359803    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj4k8\" (UniqueName: \"kubernetes.io/projected/0b730bcc-22b1-4daf-ad49-7828cd5db405-kube-api-access-cj4k8\") pod \"console-679667d5b9-56db4\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") " pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.507478 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.507344    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:24.639798 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.639747    2572 generic.go:356] "Generic (PLEG): container finished" podID="442bbd6a-e4d9-4901-b3b0-0689a7537b12" containerID="16cad34a8a1867a035c950c5cd14dbb2d3a1c7843542e31fd9ffbdae1c6f35ed" exitCode=0
Aug 04 17:51:24.641289 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.641026    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-szdrk" event={"ID":"442bbd6a-e4d9-4901-b3b0-0689a7537b12","Type":"ContainerDied","Data":"16cad34a8a1867a035c950c5cd14dbb2d3a1c7843542e31fd9ffbdae1c6f35ed"}
Aug 04 17:51:24.697689 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.697596    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-679667d5b9-56db4"]
Aug 04 17:51:24.705224 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:51:24.703726    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b730bcc_22b1_4daf_ad49_7828cd5db405.slice/crio-35aa53c327b66057d162cc7788704d04819d6021dc0c3fe7f603afc8c672dd9b WatchSource:0}: Error finding container 35aa53c327b66057d162cc7788704d04819d6021dc0c3fe7f603afc8c672dd9b: Status 404 returned error can't find the container with id 35aa53c327b66057d162cc7788704d04819d6021dc0c3fe7f603afc8c672dd9b
Aug 04 17:51:24.846863 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.846840    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:24.847941 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.847891    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:51:24.848369 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.848165    2572 patch_prober.go:28] interesting pod/console-687bcb67b5-2np84 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body=
Aug 04 17:51:24.848369 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:24.848201    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-687bcb67b5-2np84" podUID="84886892-3736-46ed-8479-9709e1f5f8e1" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused"
Aug 04 17:51:25.646962 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:25.646899    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-szdrk" event={"ID":"442bbd6a-e4d9-4901-b3b0-0689a7537b12","Type":"ContainerStarted","Data":"d73a890a392609fcfbaf45a74a364c88cc06435a5343aa3c5e61fb7f3f797912"}
Aug 04 17:51:25.647418 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:25.646987    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-szdrk" event={"ID":"442bbd6a-e4d9-4901-b3b0-0689a7537b12","Type":"ContainerStarted","Data":"1472bdf68e99563053f7510850b45d73bff8c21daa1ad89d534a9655f975e47d"}
Aug 04 17:51:25.648781 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:25.648755    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679667d5b9-56db4" event={"ID":"0b730bcc-22b1-4daf-ad49-7828cd5db405","Type":"ContainerStarted","Data":"18958cce87e3dbe4641e4100b3792d1ceda3bf081403ecf1aeb40ba0716f1c31"}
Aug 04 17:51:25.648908 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:25.648801    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679667d5b9-56db4" event={"ID":"0b730bcc-22b1-4daf-ad49-7828cd5db405","Type":"ContainerStarted","Data":"35aa53c327b66057d162cc7788704d04819d6021dc0c3fe7f603afc8c672dd9b"}
Aug 04 17:51:25.666485 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:25.666435    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-szdrk" podStartSLOduration=5.339819479 podStartE2EDuration="7.66641668s" totalImagesPullingTime="2.2285239s" totalInitContainerRuntime="98.073301ms" isStatefulPod=true podCreationTimestamp="2026-08-04 17:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:25.664332018 +0000 UTC m=+270.574221627" watchObservedRunningTime="2026-08-04 17:51:25.66641668 +0000 UTC m=+270.576306269"
Aug 04 17:51:25.682015 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:25.681973    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-679667d5b9-56db4" podStartSLOduration=1.6819577909999999 podStartE2EDuration="1.681957791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:51:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:25.680229565 +0000 UTC m=+270.590119155" watchObservedRunningTime="2026-08-04 17:51:25.681957791 +0000 UTC m=+270.591847382"
Aug 04 17:51:26.662938 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:26.662889    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c30f500c-b0a5-424b-9eff-6193992a748e","Type":"ContainerStarted","Data":"d103de99825ec5b8ce1ee5bba3ae22609f3d5425be02f6d4312974722cb553bc"}
Aug 04 17:51:26.663401 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:26.663016    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c30f500c-b0a5-424b-9eff-6193992a748e","Type":"ContainerStarted","Data":"f123363269afcd7f22dd26d79dcd0ea8376b5a5219be37431b3df047b34da5ea"}
Aug 04 17:51:26.663401 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:26.663060    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c30f500c-b0a5-424b-9eff-6193992a748e","Type":"ContainerStarted","Data":"5f7cbd549330272f0eb352446ffae29cf90d940ff76f1ea97bb8b209a1225ed8"}
Aug 04 17:51:26.663401 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:26.663102    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c30f500c-b0a5-424b-9eff-6193992a748e","Type":"ContainerStarted","Data":"57c3573aa86fb7c1d0abc199484f63d963e92f4cd31d3417564c108a7d1dd8f8"}
Aug 04 17:51:26.663401 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:26.663141    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c30f500c-b0a5-424b-9eff-6193992a748e","Type":"ContainerStarted","Data":"4ab9ab1e34d3324a8cf73cff6e0b19bab887aff3a22b8c834cd76a78d6b0aa21"}
Aug 04 17:51:28.182271 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.182227    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6c9857f644-6bxl2" podUID="2c3615de-d486-481b-914f-23fce8aaf04d" containerName="registry" containerID="cri-o://56a762150bd4a07390b52b425ab5d693467f898fbbecd44f9635d97c71662061" gracePeriod=30
Aug 04 17:51:28.473076 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.473044    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:51:28.593900 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.593867    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c3615de-d486-481b-914f-23fce8aaf04d-image-registry-private-configuration\") pod \"2c3615de-d486-481b-914f-23fce8aaf04d\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") "
Aug 04 17:51:28.594096 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.593974    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-bound-sa-token\") pod \"2c3615de-d486-481b-914f-23fce8aaf04d\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") "
Aug 04 17:51:28.594096 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.594004    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c3615de-d486-481b-914f-23fce8aaf04d-installation-pull-secrets\") pod \"2c3615de-d486-481b-914f-23fce8aaf04d\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") "
Aug 04 17:51:28.594096 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.594041    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c3615de-d486-481b-914f-23fce8aaf04d-registry-certificates\") pod \"2c3615de-d486-481b-914f-23fce8aaf04d\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") "
Aug 04 17:51:28.594096 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.594090    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nstsp\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-kube-api-access-nstsp\") pod \"2c3615de-d486-481b-914f-23fce8aaf04d\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") "
Aug 04 17:51:28.594330 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.594123    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c3615de-d486-481b-914f-23fce8aaf04d-ca-trust-extracted\") pod \"2c3615de-d486-481b-914f-23fce8aaf04d\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") "
Aug 04 17:51:28.594330 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.594162    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls\") pod \"2c3615de-d486-481b-914f-23fce8aaf04d\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") "
Aug 04 17:51:28.594330 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.594184    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c3615de-d486-481b-914f-23fce8aaf04d-trusted-ca\") pod \"2c3615de-d486-481b-914f-23fce8aaf04d\" (UID: \"2c3615de-d486-481b-914f-23fce8aaf04d\") "
Aug 04 17:51:28.594770 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.594738    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c3615de-d486-481b-914f-23fce8aaf04d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2c3615de-d486-481b-914f-23fce8aaf04d" (UID: "2c3615de-d486-481b-914f-23fce8aaf04d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:51:28.595063 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.595022    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c3615de-d486-481b-914f-23fce8aaf04d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2c3615de-d486-481b-914f-23fce8aaf04d" (UID: "2c3615de-d486-481b-914f-23fce8aaf04d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:51:28.596854 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.596826    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c3615de-d486-481b-914f-23fce8aaf04d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2c3615de-d486-481b-914f-23fce8aaf04d" (UID: "2c3615de-d486-481b-914f-23fce8aaf04d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:51:28.596971 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.596832    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2c3615de-d486-481b-914f-23fce8aaf04d" (UID: "2c3615de-d486-481b-914f-23fce8aaf04d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:51:28.597157 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.597130    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-kube-api-access-nstsp" (OuterVolumeSpecName: "kube-api-access-nstsp") pod "2c3615de-d486-481b-914f-23fce8aaf04d" (UID: "2c3615de-d486-481b-914f-23fce8aaf04d"). InnerVolumeSpecName "kube-api-access-nstsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:51:28.597461 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.597436    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2c3615de-d486-481b-914f-23fce8aaf04d" (UID: "2c3615de-d486-481b-914f-23fce8aaf04d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:51:28.598155 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.598132    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c3615de-d486-481b-914f-23fce8aaf04d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2c3615de-d486-481b-914f-23fce8aaf04d" (UID: "2c3615de-d486-481b-914f-23fce8aaf04d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:51:28.605853 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.605828    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3615de-d486-481b-914f-23fce8aaf04d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2c3615de-d486-481b-914f-23fce8aaf04d" (UID: "2c3615de-d486-481b-914f-23fce8aaf04d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:51:28.676376 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.676336    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c30f500c-b0a5-424b-9eff-6193992a748e","Type":"ContainerStarted","Data":"ee8fa9485a11431fe75646c1e7dc3e4dc58cde1f380066669212a97ffdbb2028"}
Aug 04 17:51:28.678096 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.678069    2572 generic.go:356] "Generic (PLEG): container finished" podID="2c3615de-d486-481b-914f-23fce8aaf04d" containerID="56a762150bd4a07390b52b425ab5d693467f898fbbecd44f9635d97c71662061" exitCode=0
Aug 04 17:51:28.678216 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.678111    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c9857f644-6bxl2"
Aug 04 17:51:28.678216 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.678119    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c9857f644-6bxl2" event={"ID":"2c3615de-d486-481b-914f-23fce8aaf04d","Type":"ContainerDied","Data":"56a762150bd4a07390b52b425ab5d693467f898fbbecd44f9635d97c71662061"}
Aug 04 17:51:28.678216 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.678162    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c9857f644-6bxl2" event={"ID":"2c3615de-d486-481b-914f-23fce8aaf04d","Type":"ContainerDied","Data":"7e982b8cb3ce97506e93176c7f1f82d3ee61fabdac2772bbf915b7cb95955971"}
Aug 04 17:51:28.678216 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.678192    2572 scope.go:117] "RemoveContainer" containerID="56a762150bd4a07390b52b425ab5d693467f898fbbecd44f9635d97c71662061"
Aug 04 17:51:28.688115 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.688095    2572 scope.go:117] "RemoveContainer" containerID="56a762150bd4a07390b52b425ab5d693467f898fbbecd44f9635d97c71662061"
Aug 04 17:51:28.688414 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:51:28.688381    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56a762150bd4a07390b52b425ab5d693467f898fbbecd44f9635d97c71662061\": container with ID starting with 56a762150bd4a07390b52b425ab5d693467f898fbbecd44f9635d97c71662061 not found: ID does not exist" containerID="56a762150bd4a07390b52b425ab5d693467f898fbbecd44f9635d97c71662061"
Aug 04 17:51:28.688501 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.688422    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a762150bd4a07390b52b425ab5d693467f898fbbecd44f9635d97c71662061"} err="failed to get container status \"56a762150bd4a07390b52b425ab5d693467f898fbbecd44f9635d97c71662061\": rpc error: code = NotFound desc = could not find container \"56a762150bd4a07390b52b425ab5d693467f898fbbecd44f9635d97c71662061\": container with ID starting with 56a762150bd4a07390b52b425ab5d693467f898fbbecd44f9635d97c71662061 not found: ID does not exist"
Aug 04 17:51:28.694913 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.694893    2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c3615de-d486-481b-914f-23fce8aaf04d-image-registry-private-configuration\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:51:28.695040 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.694931    2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-bound-sa-token\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:51:28.695040 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.694947    2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c3615de-d486-481b-914f-23fce8aaf04d-installation-pull-secrets\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:51:28.695040 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.694959    2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c3615de-d486-481b-914f-23fce8aaf04d-registry-certificates\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:51:28.695040 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.694973    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nstsp\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-kube-api-access-nstsp\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:51:28.695040 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.694986    2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c3615de-d486-481b-914f-23fce8aaf04d-ca-trust-extracted\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:51:28.695040 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.694999    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c3615de-d486-481b-914f-23fce8aaf04d-registry-tls\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:51:28.695040 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.695010    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c3615de-d486-481b-914f-23fce8aaf04d-trusted-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:51:28.703090 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.703047    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.088328984 podStartE2EDuration="9.70303445s" totalImagesPullingTime="5.590363985s" totalInitContainerRuntime="24.341481ms" isStatefulPod=false podCreationTimestamp="2026-08-04 17:51:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:28.701874894 +0000 UTC m=+273.611764483" watchObservedRunningTime="2026-08-04 17:51:28.70303445 +0000 UTC m=+273.612924039"
Aug 04 17:51:28.717312 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.717287    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c9857f644-6bxl2"]
Aug 04 17:51:28.722398 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:28.722335    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6c9857f644-6bxl2"]
Aug 04 17:51:29.599684 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:29.599645    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c3615de-d486-481b-914f-23fce8aaf04d" path="/var/lib/kubelet/pods/2c3615de-d486-481b-914f-23fce8aaf04d/volumes"
Aug 04 17:51:34.508098 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:34.508065    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:34.508565 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:34.508121    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:34.512790 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:34.512771    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:34.707309 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:34.707282    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:51:34.751282 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:34.751253    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687bcb67b5-2np84"]
Aug 04 17:51:37.281490 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:51:37.281444    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9v6j5" podUID="9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9"
Aug 04 17:51:37.714545 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:37.714515    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:51:40.390912 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:40.390872    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:51:40.393245 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:40.393213    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9-metrics-tls\") pod \"dns-default-9v6j5\" (UID: \"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9\") " pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:51:40.418106 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:40.418079    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-56pss\""
Aug 04 17:51:40.425999 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:40.425979    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:51:40.584699 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:40.584660    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9v6j5"]
Aug 04 17:51:40.587323 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:51:40.587297    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fbc8f8f_1dfc_4cf1_8ecf_ad0e6a3e42d9.slice/crio-5f6adddc3ce702d5437ca54b9d32e2b3467c291a9c0dcc76bc39942c201acb0c WatchSource:0}: Error finding container 5f6adddc3ce702d5437ca54b9d32e2b3467c291a9c0dcc76bc39942c201acb0c: Status 404 returned error can't find the container with id 5f6adddc3ce702d5437ca54b9d32e2b3467c291a9c0dcc76bc39942c201acb0c
Aug 04 17:51:40.726106 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:40.726022    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9v6j5" event={"ID":"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9","Type":"ContainerStarted","Data":"5f6adddc3ce702d5437ca54b9d32e2b3467c291a9c0dcc76bc39942c201acb0c"}
Aug 04 17:51:43.740152 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:43.740116    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9v6j5" event={"ID":"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9","Type":"ContainerStarted","Data":"af3474a8bebbc41d08cece5b2dba1891d39c212a5f409848c7cd2ed016918df5"}
Aug 04 17:51:43.740501 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:43.740170    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9v6j5" event={"ID":"9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9","Type":"ContainerStarted","Data":"18971d09284b07159a1a2bcbc9dc87d1b6fb8c02fdc3ea819d240580b02aeaba"}
Aug 04 17:51:43.740501 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:43.740239    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:51:43.756084 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:43.755974    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9v6j5" podStartSLOduration=251.512822027 podStartE2EDuration="4m13.755957753s" totalImagesPullingTime="2.243135726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:43.755418708 +0000 UTC m=+288.665308315" watchObservedRunningTime="2026-08-04 17:51:43.755957753 +0000 UTC m=+288.665847341"
Aug 04 17:51:49.172537 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.172473    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69f67d444f-xpnjc" podUID="6e5e19e5-fd11-4257-ab5e-63b5867b12ff" containerName="console" containerID="cri-o://3141e47e5e5b99702885c3338843297b3414f4a6df14b28f6f14e0cb6f9e5785" gracePeriod=15
Aug 04 17:51:49.445928 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.445860    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:49.568901 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.568871    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-service-ca\") pod \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") "
Aug 04 17:51:49.568901 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.568907    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-serving-cert\") pod \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") "
Aug 04 17:51:49.569170 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.569053    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8vcq\" (UniqueName: \"kubernetes.io/projected/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-kube-api-access-j8vcq\") pod \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") "
Aug 04 17:51:49.569170 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.569090    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-oauth-serving-cert\") pod \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") "
Aug 04 17:51:49.569170 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.569129    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-oauth-config\") pod \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") "
Aug 04 17:51:49.569170 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.569163    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-config\") pod \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\" (UID: \"6e5e19e5-fd11-4257-ab5e-63b5867b12ff\") "
Aug 04 17:51:49.569400 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.569373    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-service-ca" (OuterVolumeSpecName: "service-ca") pod "6e5e19e5-fd11-4257-ab5e-63b5867b12ff" (UID: "6e5e19e5-fd11-4257-ab5e-63b5867b12ff"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:51:49.569549 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.569505    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6e5e19e5-fd11-4257-ab5e-63b5867b12ff" (UID: "6e5e19e5-fd11-4257-ab5e-63b5867b12ff"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:51:49.569682 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.569638    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-config" (OuterVolumeSpecName: "console-config") pod "6e5e19e5-fd11-4257-ab5e-63b5867b12ff" (UID: "6e5e19e5-fd11-4257-ab5e-63b5867b12ff"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:51:49.571297 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.571274    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6e5e19e5-fd11-4257-ab5e-63b5867b12ff" (UID: "6e5e19e5-fd11-4257-ab5e-63b5867b12ff"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:51:49.571376 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.571294    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6e5e19e5-fd11-4257-ab5e-63b5867b12ff" (UID: "6e5e19e5-fd11-4257-ab5e-63b5867b12ff"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:51:49.571376 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.571318    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-kube-api-access-j8vcq" (OuterVolumeSpecName: "kube-api-access-j8vcq") pod "6e5e19e5-fd11-4257-ab5e-63b5867b12ff" (UID: "6e5e19e5-fd11-4257-ab5e-63b5867b12ff"). InnerVolumeSpecName "kube-api-access-j8vcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:51:49.670138 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.670110    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8vcq\" (UniqueName: \"kubernetes.io/projected/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-kube-api-access-j8vcq\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:51:49.670138 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.670137    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-oauth-serving-cert\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:51:49.670138 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.670146    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-oauth-config\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:51:49.670337 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.670154    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-config\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:51:49.670337 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.670164    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:51:49.670337 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.670171    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e5e19e5-fd11-4257-ab5e-63b5867b12ff-console-serving-cert\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:51:49.763176 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.763084    2572 generic.go:356] "Generic (PLEG): container finished" podID="6e5e19e5-fd11-4257-ab5e-63b5867b12ff" containerID="3141e47e5e5b99702885c3338843297b3414f4a6df14b28f6f14e0cb6f9e5785" exitCode=0
Aug 04 17:51:49.763176 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.763133    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f67d444f-xpnjc"
Aug 04 17:51:49.763396 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.763174    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f67d444f-xpnjc" event={"ID":"6e5e19e5-fd11-4257-ab5e-63b5867b12ff","Type":"ContainerDied","Data":"3141e47e5e5b99702885c3338843297b3414f4a6df14b28f6f14e0cb6f9e5785"}
Aug 04 17:51:49.763396 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.763231    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f67d444f-xpnjc" event={"ID":"6e5e19e5-fd11-4257-ab5e-63b5867b12ff","Type":"ContainerDied","Data":"8f02276115fd7896021a755fee3f40b32c1d5b8a76c13bc300e26f11d19ea8cc"}
Aug 04 17:51:49.763396 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.763259    2572 scope.go:117] "RemoveContainer" containerID="3141e47e5e5b99702885c3338843297b3414f4a6df14b28f6f14e0cb6f9e5785"
Aug 04 17:51:49.771236 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.771220    2572 scope.go:117] "RemoveContainer" containerID="3141e47e5e5b99702885c3338843297b3414f4a6df14b28f6f14e0cb6f9e5785"
Aug 04 17:51:49.771491 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:51:49.771475    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3141e47e5e5b99702885c3338843297b3414f4a6df14b28f6f14e0cb6f9e5785\": container with ID starting with 3141e47e5e5b99702885c3338843297b3414f4a6df14b28f6f14e0cb6f9e5785 not found: ID does not exist" containerID="3141e47e5e5b99702885c3338843297b3414f4a6df14b28f6f14e0cb6f9e5785"
Aug 04 17:51:49.771588 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.771498    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3141e47e5e5b99702885c3338843297b3414f4a6df14b28f6f14e0cb6f9e5785"} err="failed to get container status \"3141e47e5e5b99702885c3338843297b3414f4a6df14b28f6f14e0cb6f9e5785\": rpc error: code = NotFound desc = could not find container \"3141e47e5e5b99702885c3338843297b3414f4a6df14b28f6f14e0cb6f9e5785\": container with ID starting with 3141e47e5e5b99702885c3338843297b3414f4a6df14b28f6f14e0cb6f9e5785 not found: ID does not exist"
Aug 04 17:51:49.782493 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.782472    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69f67d444f-xpnjc"]
Aug 04 17:51:49.787978 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:49.787955    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69f67d444f-xpnjc"]
Aug 04 17:51:51.597892 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:51.597859    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e5e19e5-fd11-4257-ab5e-63b5867b12ff" path="/var/lib/kubelet/pods/6e5e19e5-fd11-4257-ab5e-63b5867b12ff/volumes"
Aug 04 17:51:53.747479 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:53.747453    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9v6j5"
Aug 04 17:51:55.457210 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:55.457185    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 17:51:55.457637 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:55.457359    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 17:51:55.463716 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:55.463697    2572 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 17:51:57.795743 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:57.795665    2572 generic.go:356] "Generic (PLEG): container finished" podID="cb785aa2-a9a1-4501-ad29-0ec94b0675ca" containerID="a36f4e424e44b16efb922c497294b81f3a3f3f23faa831a662a3113f534576b0" exitCode=0
Aug 04 17:51:57.796127 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:57.795735    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-wxw48" event={"ID":"cb785aa2-a9a1-4501-ad29-0ec94b0675ca","Type":"ContainerDied","Data":"a36f4e424e44b16efb922c497294b81f3a3f3f23faa831a662a3113f534576b0"}
Aug 04 17:51:57.796127 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:57.796033    2572 scope.go:117] "RemoveContainer" containerID="a36f4e424e44b16efb922c497294b81f3a3f3f23faa831a662a3113f534576b0"
Aug 04 17:51:58.801227 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:58.801195    2572 generic.go:356] "Generic (PLEG): container finished" podID="a78b03fa-ab27-4065-915a-9b9658f59304" containerID="16e3689738cad5a26312d4aa49e71b786af224633c5e28db73ea91485eda91ab" exitCode=0
Aug 04 17:51:58.801619 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:58.801268    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr" event={"ID":"a78b03fa-ab27-4065-915a-9b9658f59304","Type":"ContainerDied","Data":"16e3689738cad5a26312d4aa49e71b786af224633c5e28db73ea91485eda91ab"}
Aug 04 17:51:58.801685 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:58.801618    2572 scope.go:117] "RemoveContainer" containerID="16e3689738cad5a26312d4aa49e71b786af224633c5e28db73ea91485eda91ab"
Aug 04 17:51:58.803124 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:58.803107    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-wxw48" event={"ID":"cb785aa2-a9a1-4501-ad29-0ec94b0675ca","Type":"ContainerStarted","Data":"1b9b965178ddc1b24eb95d251220eae579c0737831343d828ee7a159da0c98b5"}
Aug 04 17:51:59.769378 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:59.769334    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-687bcb67b5-2np84" podUID="84886892-3736-46ed-8479-9709e1f5f8e1" containerName="console" containerID="cri-o://3586563eba613dfc4a6ff72b565dec0ae19e51ca0f3d5acc172540a9728f216d" gracePeriod=15
Aug 04 17:51:59.809158 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:51:59.809135    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-v6nfr" event={"ID":"a78b03fa-ab27-4065-915a-9b9658f59304","Type":"ContainerStarted","Data":"644dbb5abefa8c7911d3d08d35908d90bb927f530057c2d9544fba6d78973982"}
Aug 04 17:52:00.041636 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.041572    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:52:00.164155 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.164119    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84886892-3736-46ed-8479-9709e1f5f8e1-console-serving-cert\") pod \"84886892-3736-46ed-8479-9709e1f5f8e1\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") "
Aug 04 17:52:00.164155 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.164163    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf7d7\" (UniqueName: \"kubernetes.io/projected/84886892-3736-46ed-8479-9709e1f5f8e1-kube-api-access-xf7d7\") pod \"84886892-3736-46ed-8479-9709e1f5f8e1\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") "
Aug 04 17:52:00.164371 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.164205    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-oauth-serving-cert\") pod \"84886892-3736-46ed-8479-9709e1f5f8e1\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") "
Aug 04 17:52:00.164371 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.164248    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-console-config\") pod \"84886892-3736-46ed-8479-9709e1f5f8e1\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") "
Aug 04 17:52:00.164371 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.164285    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-trusted-ca-bundle\") pod \"84886892-3736-46ed-8479-9709e1f5f8e1\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") "
Aug 04 17:52:00.164371 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.164313    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84886892-3736-46ed-8479-9709e1f5f8e1-console-oauth-config\") pod \"84886892-3736-46ed-8479-9709e1f5f8e1\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") "
Aug 04 17:52:00.164371 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.164345    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-service-ca\") pod \"84886892-3736-46ed-8479-9709e1f5f8e1\" (UID: \"84886892-3736-46ed-8479-9709e1f5f8e1\") "
Aug 04 17:52:00.164731 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.164660    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "84886892-3736-46ed-8479-9709e1f5f8e1" (UID: "84886892-3736-46ed-8479-9709e1f5f8e1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:52:00.164731 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.164669    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-console-config" (OuterVolumeSpecName: "console-config") pod "84886892-3736-46ed-8479-9709e1f5f8e1" (UID: "84886892-3736-46ed-8479-9709e1f5f8e1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:52:00.164893 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.164799    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "84886892-3736-46ed-8479-9709e1f5f8e1" (UID: "84886892-3736-46ed-8479-9709e1f5f8e1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:52:00.164893 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.164840    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-service-ca" (OuterVolumeSpecName: "service-ca") pod "84886892-3736-46ed-8479-9709e1f5f8e1" (UID: "84886892-3736-46ed-8479-9709e1f5f8e1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:52:00.166434 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.166402    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84886892-3736-46ed-8479-9709e1f5f8e1-kube-api-access-xf7d7" (OuterVolumeSpecName: "kube-api-access-xf7d7") pod "84886892-3736-46ed-8479-9709e1f5f8e1" (UID: "84886892-3736-46ed-8479-9709e1f5f8e1"). InnerVolumeSpecName "kube-api-access-xf7d7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:52:00.166687 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.166665    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84886892-3736-46ed-8479-9709e1f5f8e1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "84886892-3736-46ed-8479-9709e1f5f8e1" (UID: "84886892-3736-46ed-8479-9709e1f5f8e1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:52:00.166742 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.166726    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84886892-3736-46ed-8479-9709e1f5f8e1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "84886892-3736-46ed-8479-9709e1f5f8e1" (UID: "84886892-3736-46ed-8479-9709e1f5f8e1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:52:00.265319 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.265280    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-console-config\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:52:00.265319 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.265307    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-trusted-ca-bundle\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:52:00.265319 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.265317    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84886892-3736-46ed-8479-9709e1f5f8e1-console-oauth-config\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:52:00.265319 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.265327    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:52:00.265568 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.265338    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84886892-3736-46ed-8479-9709e1f5f8e1-console-serving-cert\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:52:00.265568 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.265346    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf7d7\" (UniqueName: \"kubernetes.io/projected/84886892-3736-46ed-8479-9709e1f5f8e1-kube-api-access-xf7d7\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:52:00.265568 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.265355    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84886892-3736-46ed-8479-9709e1f5f8e1-oauth-serving-cert\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:52:00.814180 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.814143    2572 generic.go:356] "Generic (PLEG): container finished" podID="84886892-3736-46ed-8479-9709e1f5f8e1" containerID="3586563eba613dfc4a6ff72b565dec0ae19e51ca0f3d5acc172540a9728f216d" exitCode=0
Aug 04 17:52:00.814646 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.814202    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687bcb67b5-2np84"
Aug 04 17:52:00.814646 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.814234    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687bcb67b5-2np84" event={"ID":"84886892-3736-46ed-8479-9709e1f5f8e1","Type":"ContainerDied","Data":"3586563eba613dfc4a6ff72b565dec0ae19e51ca0f3d5acc172540a9728f216d"}
Aug 04 17:52:00.814646 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.814309    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687bcb67b5-2np84" event={"ID":"84886892-3736-46ed-8479-9709e1f5f8e1","Type":"ContainerDied","Data":"e940e910e7fcbc62ef96c3d268971502169560872644636aff2eec0cd001a4c6"}
Aug 04 17:52:00.814646 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.814342    2572 scope.go:117] "RemoveContainer" containerID="3586563eba613dfc4a6ff72b565dec0ae19e51ca0f3d5acc172540a9728f216d"
Aug 04 17:52:00.822746 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.822729    2572 scope.go:117] "RemoveContainer" containerID="3586563eba613dfc4a6ff72b565dec0ae19e51ca0f3d5acc172540a9728f216d"
Aug 04 17:52:00.823026 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:52:00.823003    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3586563eba613dfc4a6ff72b565dec0ae19e51ca0f3d5acc172540a9728f216d\": container with ID starting with 3586563eba613dfc4a6ff72b565dec0ae19e51ca0f3d5acc172540a9728f216d not found: ID does not exist" containerID="3586563eba613dfc4a6ff72b565dec0ae19e51ca0f3d5acc172540a9728f216d"
Aug 04 17:52:00.823069 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.823035    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3586563eba613dfc4a6ff72b565dec0ae19e51ca0f3d5acc172540a9728f216d"} err="failed to get container status \"3586563eba613dfc4a6ff72b565dec0ae19e51ca0f3d5acc172540a9728f216d\": rpc error: code = NotFound desc = could not find container \"3586563eba613dfc4a6ff72b565dec0ae19e51ca0f3d5acc172540a9728f216d\": container with ID starting with 3586563eba613dfc4a6ff72b565dec0ae19e51ca0f3d5acc172540a9728f216d not found: ID does not exist"
Aug 04 17:52:00.833775 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.833753    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687bcb67b5-2np84"]
Aug 04 17:52:00.839604 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:00.839583    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-687bcb67b5-2np84"]
Aug 04 17:52:01.598262 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:01.598223    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84886892-3736-46ed-8479-9709e1f5f8e1" path="/var/lib/kubelet/pods/84886892-3736-46ed-8479-9709e1f5f8e1/volumes"
Aug 04 17:52:42.438748 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.438716    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"]
Aug 04 17:52:42.439234 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.438991    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e5e19e5-fd11-4257-ab5e-63b5867b12ff" containerName="console"
Aug 04 17:52:42.439234 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.439002    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e5e19e5-fd11-4257-ab5e-63b5867b12ff" containerName="console"
Aug 04 17:52:42.439234 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.439016    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c3615de-d486-481b-914f-23fce8aaf04d" containerName="registry"
Aug 04 17:52:42.439234 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.439023    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c3615de-d486-481b-914f-23fce8aaf04d" containerName="registry"
Aug 04 17:52:42.439234 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.439029    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84886892-3736-46ed-8479-9709e1f5f8e1" containerName="console"
Aug 04 17:52:42.439234 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.439034    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="84886892-3736-46ed-8479-9709e1f5f8e1" containerName="console"
Aug 04 17:52:42.439234 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.439087    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c3615de-d486-481b-914f-23fce8aaf04d" containerName="registry"
Aug 04 17:52:42.439234 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.439095    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="84886892-3736-46ed-8479-9709e1f5f8e1" containerName="console"
Aug 04 17:52:42.439234 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.439101    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e5e19e5-fd11-4257-ab5e-63b5867b12ff" containerName="console"
Aug 04 17:52:42.441518 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.441499    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.444249 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.444221    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8wt6g\""
Aug 04 17:52:42.444366 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.444275    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Aug 04 17:52:42.447018 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.444795    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Aug 04 17:52:42.447018 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.445065    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Aug 04 17:52:42.447018 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.445088    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Aug 04 17:52:42.447018 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.445880    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Aug 04 17:52:42.451438 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.451417    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Aug 04 17:52:42.457490 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.457466    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"]
Aug 04 17:52:42.576590 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.576543    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dstzt\" (UniqueName: \"kubernetes.io/projected/429255f8-4691-4e98-9f48-2e7241400012-kube-api-access-dstzt\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.576590 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.576592    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/429255f8-4691-4e98-9f48-2e7241400012-telemeter-client-tls\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.576798 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.576611    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/429255f8-4691-4e98-9f48-2e7241400012-federate-client-tls\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.576798 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.576652    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/429255f8-4691-4e98-9f48-2e7241400012-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.576798 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.576671    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/429255f8-4691-4e98-9f48-2e7241400012-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.576798 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.576692    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/429255f8-4691-4e98-9f48-2e7241400012-secret-telemeter-client\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.576798 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.576749    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/429255f8-4691-4e98-9f48-2e7241400012-serving-certs-ca-bundle\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.576798 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.576779    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/429255f8-4691-4e98-9f48-2e7241400012-metrics-client-ca\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.677425 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.677380    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/429255f8-4691-4e98-9f48-2e7241400012-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.677425 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.677431    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/429255f8-4691-4e98-9f48-2e7241400012-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.677621 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.677453    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/429255f8-4691-4e98-9f48-2e7241400012-secret-telemeter-client\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.677621 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.677480    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/429255f8-4691-4e98-9f48-2e7241400012-serving-certs-ca-bundle\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.677621 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.677495    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/429255f8-4691-4e98-9f48-2e7241400012-metrics-client-ca\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.677621 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.677538    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dstzt\" (UniqueName: \"kubernetes.io/projected/429255f8-4691-4e98-9f48-2e7241400012-kube-api-access-dstzt\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.677621 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.677574    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/429255f8-4691-4e98-9f48-2e7241400012-telemeter-client-tls\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.677621 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.677597    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/429255f8-4691-4e98-9f48-2e7241400012-federate-client-tls\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.678480 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.678450    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/429255f8-4691-4e98-9f48-2e7241400012-metrics-client-ca\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.678609 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.678464    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/429255f8-4691-4e98-9f48-2e7241400012-serving-certs-ca-bundle\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.678808 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.678780    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/429255f8-4691-4e98-9f48-2e7241400012-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.680213 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.680183    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/429255f8-4691-4e98-9f48-2e7241400012-telemeter-client-tls\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.680213 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.680203    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/429255f8-4691-4e98-9f48-2e7241400012-secret-telemeter-client\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.680372 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.680354    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/429255f8-4691-4e98-9f48-2e7241400012-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.680438 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.680413    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/429255f8-4691-4e98-9f48-2e7241400012-federate-client-tls\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.685535 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.685516    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dstzt\" (UniqueName: \"kubernetes.io/projected/429255f8-4691-4e98-9f48-2e7241400012-kube-api-access-dstzt\") pod \"telemeter-client-7b4f556ff6-frrkh\" (UID: \"429255f8-4691-4e98-9f48-2e7241400012\") " pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.752193 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.752119    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"
Aug 04 17:52:42.880527 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.880502    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b4f556ff6-frrkh"]
Aug 04 17:52:42.882400 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:52:42.882359    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod429255f8_4691_4e98_9f48_2e7241400012.slice/crio-0e85be1798d7c6dcd74b8c7f0f2e586b709afc58b08f7c8872599efc787b06f9 WatchSource:0}: Error finding container 0e85be1798d7c6dcd74b8c7f0f2e586b709afc58b08f7c8872599efc787b06f9: Status 404 returned error can't find the container with id 0e85be1798d7c6dcd74b8c7f0f2e586b709afc58b08f7c8872599efc787b06f9
Aug 04 17:52:42.884320 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.884302    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 17:52:42.969057 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:42.969018    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh" event={"ID":"429255f8-4691-4e98-9f48-2e7241400012","Type":"ContainerStarted","Data":"0e85be1798d7c6dcd74b8c7f0f2e586b709afc58b08f7c8872599efc787b06f9"}
Aug 04 17:52:45.984513 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:45.984480    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh" event={"ID":"429255f8-4691-4e98-9f48-2e7241400012","Type":"ContainerStarted","Data":"b255d68062b49f76e95bdb89406f58f795f89a7d0afb610f754354d2a62c447c"}
Aug 04 17:52:45.984880 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:45.984531    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh" event={"ID":"429255f8-4691-4e98-9f48-2e7241400012","Type":"ContainerStarted","Data":"0acf4499f8f39cf22098d5b9ee23ea17930ae2ff1afa57de42a9173c074cfa94"}
Aug 04 17:52:45.984880 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:45.984551    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh" event={"ID":"429255f8-4691-4e98-9f48-2e7241400012","Type":"ContainerStarted","Data":"97d28025d0ad07e3db4fe7824aa057a506d16f8ac79f6cd5105b110f4d51bd53"}
Aug 04 17:52:46.005132 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.005088    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7b4f556ff6-frrkh" podStartSLOduration=1.854817126 podStartE2EDuration="4.005074478s" totalImagesPullingTime="2.150257352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:52:46.00442159 +0000 UTC m=+350.914311198" watchObservedRunningTime="2026-08-04 17:52:46.005074478 +0000 UTC m=+350.914964066"
Aug 04 17:52:46.080974 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.080941    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-776f7897cf-5rf9p"]
Aug 04 17:52:46.084358 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.084328    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.093726 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.093702    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-776f7897cf-5rf9p"]
Aug 04 17:52:46.204107 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.204062    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-oauth-config\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.204300 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.204118    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-config\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.204300 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.204187    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-oauth-serving-cert\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.204300 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.204239    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg89q\" (UniqueName: \"kubernetes.io/projected/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-kube-api-access-xg89q\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.204300 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.204277    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-trusted-ca-bundle\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.204453 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.204305    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-serving-cert\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.204453 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.204386    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-service-ca\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.304870 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.304837    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-oauth-config\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.304870 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.304879    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-config\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.305159 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.304897    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-oauth-serving-cert\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.305159 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.305035    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg89q\" (UniqueName: \"kubernetes.io/projected/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-kube-api-access-xg89q\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.305159 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.305087    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-trusted-ca-bundle\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.305159 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.305120    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-serving-cert\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.305357 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.305162    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-service-ca\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.305777 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.305751    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-config\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.305890 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.305804    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-service-ca\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.305890 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.305812    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-oauth-serving-cert\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.306034 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.305912    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-trusted-ca-bundle\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.307549 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.307521    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-serving-cert\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.307645 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.307570    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-oauth-config\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.313848 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.313821    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg89q\" (UniqueName: \"kubernetes.io/projected/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-kube-api-access-xg89q\") pod \"console-776f7897cf-5rf9p\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") " pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.396575 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.396521    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:52:46.520624 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.520575    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-776f7897cf-5rf9p"]
Aug 04 17:52:46.522808 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:52:46.522784    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f21018d_8cb3_4d4c_87aa_a9d2573999f4.slice/crio-318edd63b6905ad01616ed61df3634cef72192865891d20b9417be37a745266e WatchSource:0}: Error finding container 318edd63b6905ad01616ed61df3634cef72192865891d20b9417be37a745266e: Status 404 returned error can't find the container with id 318edd63b6905ad01616ed61df3634cef72192865891d20b9417be37a745266e
Aug 04 17:52:46.990106 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.990022    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776f7897cf-5rf9p" event={"ID":"3f21018d-8cb3-4d4c-87aa-a9d2573999f4","Type":"ContainerStarted","Data":"7bd70a00b19e4dd249c8c6fd8a96f00b27d977837b351f7c925a58bcb5a81407"}
Aug 04 17:52:46.990106 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:46.990072    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776f7897cf-5rf9p" event={"ID":"3f21018d-8cb3-4d4c-87aa-a9d2573999f4","Type":"ContainerStarted","Data":"318edd63b6905ad01616ed61df3634cef72192865891d20b9417be37a745266e"}
Aug 04 17:52:47.008137 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:47.008091    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-776f7897cf-5rf9p" podStartSLOduration=1.008076724 podStartE2EDuration="1.008076724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:52:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:52:47.006386897 +0000 UTC m=+351.916276508" watchObservedRunningTime="2026-08-04 17:52:47.008076724 +0000 UTC m=+351.917966311"
Aug 04 17:52:53.307327 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.307287    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-776f7897cf-5rf9p"]
Aug 04 17:52:53.334651 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.334621    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64bcc54cf-6gfh4"]
Aug 04 17:52:53.336907 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.336890    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.349200 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.349176    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64bcc54cf-6gfh4"]
Aug 04 17:52:53.463373 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.463326    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-trusted-ca-bundle\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.463544 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.463424    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66ppc\" (UniqueName: \"kubernetes.io/projected/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-kube-api-access-66ppc\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.463544 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.463497    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-service-ca\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.463544 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.463528    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-serving-cert\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.463650 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.463548    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-oauth-config\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.463650 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.463574    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-oauth-serving-cert\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.463650 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.463599    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-config\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.564502 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.564419    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-trusted-ca-bundle\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.564502 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.564467    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66ppc\" (UniqueName: \"kubernetes.io/projected/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-kube-api-access-66ppc\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.564502 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.564500    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-service-ca\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.564764 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.564525    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-serving-cert\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.564764 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.564545    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-oauth-config\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.564764 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.564566    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-oauth-serving-cert\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.564764 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.564590    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-config\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.565369 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.565341    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-config\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.565485 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.565372    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-service-ca\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.565485 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.565412    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-oauth-serving-cert\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.565485 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.565411    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-trusted-ca-bundle\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.567047 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.567020    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-serving-cert\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.567130 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.567077    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-oauth-config\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.572545 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.572523    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66ppc\" (UniqueName: \"kubernetes.io/projected/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-kube-api-access-66ppc\") pod \"console-64bcc54cf-6gfh4\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") " pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.645866 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.645821    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:52:53.772978 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:53.772949    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64bcc54cf-6gfh4"]
Aug 04 17:52:53.775365 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:52:53.775337    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0dfd3e1_0b63_4ce6_9926_86ea16983e12.slice/crio-ed71ae316d7db2f89f9b29a831a1948cac2f2e906db7bad70da45f300917c14f WatchSource:0}: Error finding container ed71ae316d7db2f89f9b29a831a1948cac2f2e906db7bad70da45f300917c14f: Status 404 returned error can't find the container with id ed71ae316d7db2f89f9b29a831a1948cac2f2e906db7bad70da45f300917c14f
Aug 04 17:52:54.015685 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:54.015648    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64bcc54cf-6gfh4" event={"ID":"b0dfd3e1-0b63-4ce6-9926-86ea16983e12","Type":"ContainerStarted","Data":"532cf851174e4b4a1d89f204e940c35b913274b26d213ec58961888ffd8f3513"}
Aug 04 17:52:54.015841 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:54.015700    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64bcc54cf-6gfh4" event={"ID":"b0dfd3e1-0b63-4ce6-9926-86ea16983e12","Type":"ContainerStarted","Data":"ed71ae316d7db2f89f9b29a831a1948cac2f2e906db7bad70da45f300917c14f"}
Aug 04 17:52:54.033135 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:54.033089    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64bcc54cf-6gfh4" podStartSLOduration=1.033076332 podStartE2EDuration="1.033076332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:52:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:52:54.03195916 +0000 UTC m=+358.941848762" watchObservedRunningTime="2026-08-04 17:52:54.033076332 +0000 UTC m=+358.942965919"
Aug 04 17:52:56.397048 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:52:56.396997    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:53:03.646767 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:03.646734    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:53:03.647186 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:03.646788    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:53:03.651435 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:03.651414    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:53:04.059248 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:04.059219    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:53:04.105525 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:04.105491    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-679667d5b9-56db4"]
Aug 04 17:53:18.326075 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.326010    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-776f7897cf-5rf9p" podUID="3f21018d-8cb3-4d4c-87aa-a9d2573999f4" containerName="console" containerID="cri-o://7bd70a00b19e4dd249c8c6fd8a96f00b27d977837b351f7c925a58bcb5a81407" gracePeriod=15
Aug 04 17:53:18.561189 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.561166    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:53:18.575191 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.575172    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-oauth-serving-cert\") pod \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") "
Aug 04 17:53:18.575259 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.575213    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-trusted-ca-bundle\") pod \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") "
Aug 04 17:53:18.575259 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.575234    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-oauth-config\") pod \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") "
Aug 04 17:53:18.575323 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.575258    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-service-ca\") pod \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") "
Aug 04 17:53:18.575323 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.575315    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg89q\" (UniqueName: \"kubernetes.io/projected/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-kube-api-access-xg89q\") pod \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") "
Aug 04 17:53:18.575416 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.575339    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-serving-cert\") pod \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") "
Aug 04 17:53:18.575416 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.575377    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-config\") pod \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\" (UID: \"3f21018d-8cb3-4d4c-87aa-a9d2573999f4\") "
Aug 04 17:53:18.575743 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.575658    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-service-ca" (OuterVolumeSpecName: "service-ca") pod "3f21018d-8cb3-4d4c-87aa-a9d2573999f4" (UID: "3f21018d-8cb3-4d4c-87aa-a9d2573999f4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:53:18.575743 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.575663    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3f21018d-8cb3-4d4c-87aa-a9d2573999f4" (UID: "3f21018d-8cb3-4d4c-87aa-a9d2573999f4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:53:18.575743 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.575644    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3f21018d-8cb3-4d4c-87aa-a9d2573999f4" (UID: "3f21018d-8cb3-4d4c-87aa-a9d2573999f4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:53:18.575959 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.575812    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-config" (OuterVolumeSpecName: "console-config") pod "3f21018d-8cb3-4d4c-87aa-a9d2573999f4" (UID: "3f21018d-8cb3-4d4c-87aa-a9d2573999f4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:53:18.577411 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.577358    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-kube-api-access-xg89q" (OuterVolumeSpecName: "kube-api-access-xg89q") pod "3f21018d-8cb3-4d4c-87aa-a9d2573999f4" (UID: "3f21018d-8cb3-4d4c-87aa-a9d2573999f4"). InnerVolumeSpecName "kube-api-access-xg89q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:53:18.577411 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.577382    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3f21018d-8cb3-4d4c-87aa-a9d2573999f4" (UID: "3f21018d-8cb3-4d4c-87aa-a9d2573999f4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:53:18.577563 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.577466    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3f21018d-8cb3-4d4c-87aa-a9d2573999f4" (UID: "3f21018d-8cb3-4d4c-87aa-a9d2573999f4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:53:18.675995 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.675953    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-trusted-ca-bundle\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:53:18.675995 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.675983    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-oauth-config\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:53:18.675995 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.675992    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:53:18.675995 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.676002    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xg89q\" (UniqueName: \"kubernetes.io/projected/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-kube-api-access-xg89q\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:53:18.675995 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.676011    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-serving-cert\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:53:18.676320 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.676019    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-console-config\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:53:18.676320 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:18.676027    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f21018d-8cb3-4d4c-87aa-a9d2573999f4-oauth-serving-cert\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:53:19.112027 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:19.111987    2572 generic.go:356] "Generic (PLEG): container finished" podID="3f21018d-8cb3-4d4c-87aa-a9d2573999f4" containerID="7bd70a00b19e4dd249c8c6fd8a96f00b27d977837b351f7c925a58bcb5a81407" exitCode=0
Aug 04 17:53:19.112027 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:19.112030    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776f7897cf-5rf9p"
Aug 04 17:53:19.112223 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:19.112030    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776f7897cf-5rf9p" event={"ID":"3f21018d-8cb3-4d4c-87aa-a9d2573999f4","Type":"ContainerDied","Data":"7bd70a00b19e4dd249c8c6fd8a96f00b27d977837b351f7c925a58bcb5a81407"}
Aug 04 17:53:19.112223 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:19.112150    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776f7897cf-5rf9p" event={"ID":"3f21018d-8cb3-4d4c-87aa-a9d2573999f4","Type":"ContainerDied","Data":"318edd63b6905ad01616ed61df3634cef72192865891d20b9417be37a745266e"}
Aug 04 17:53:19.112223 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:19.112172    2572 scope.go:117] "RemoveContainer" containerID="7bd70a00b19e4dd249c8c6fd8a96f00b27d977837b351f7c925a58bcb5a81407"
Aug 04 17:53:19.120571 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:19.120555    2572 scope.go:117] "RemoveContainer" containerID="7bd70a00b19e4dd249c8c6fd8a96f00b27d977837b351f7c925a58bcb5a81407"
Aug 04 17:53:19.120847 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:53:19.120826    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bd70a00b19e4dd249c8c6fd8a96f00b27d977837b351f7c925a58bcb5a81407\": container with ID starting with 7bd70a00b19e4dd249c8c6fd8a96f00b27d977837b351f7c925a58bcb5a81407 not found: ID does not exist" containerID="7bd70a00b19e4dd249c8c6fd8a96f00b27d977837b351f7c925a58bcb5a81407"
Aug 04 17:53:19.120911 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:19.120854    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bd70a00b19e4dd249c8c6fd8a96f00b27d977837b351f7c925a58bcb5a81407"} err="failed to get container status \"7bd70a00b19e4dd249c8c6fd8a96f00b27d977837b351f7c925a58bcb5a81407\": rpc error: code = NotFound desc = could not find container \"7bd70a00b19e4dd249c8c6fd8a96f00b27d977837b351f7c925a58bcb5a81407\": container with ID starting with 7bd70a00b19e4dd249c8c6fd8a96f00b27d977837b351f7c925a58bcb5a81407 not found: ID does not exist"
Aug 04 17:53:19.132381 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:19.132347    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-776f7897cf-5rf9p"]
Aug 04 17:53:19.136039 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:19.136020    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-776f7897cf-5rf9p"]
Aug 04 17:53:19.597769 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:19.597738    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f21018d-8cb3-4d4c-87aa-a9d2573999f4" path="/var/lib/kubelet/pods/3f21018d-8cb3-4d4c-87aa-a9d2573999f4/volumes"
Aug 04 17:53:29.130827 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.130775    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-679667d5b9-56db4" podUID="0b730bcc-22b1-4daf-ad49-7828cd5db405" containerName="console" containerID="cri-o://18958cce87e3dbe4641e4100b3792d1ceda3bf081403ecf1aeb40ba0716f1c31" gracePeriod=15
Aug 04 17:53:29.371611 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.371586    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:53:29.456475 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.456396    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-serving-cert\") pod \"0b730bcc-22b1-4daf-ad49-7828cd5db405\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") "
Aug 04 17:53:29.456475 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.456441    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-trusted-ca-bundle\") pod \"0b730bcc-22b1-4daf-ad49-7828cd5db405\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") "
Aug 04 17:53:29.456694 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.456485    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-config\") pod \"0b730bcc-22b1-4daf-ad49-7828cd5db405\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") "
Aug 04 17:53:29.456694 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.456505    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-oauth-config\") pod \"0b730bcc-22b1-4daf-ad49-7828cd5db405\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") "
Aug 04 17:53:29.456694 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.456528    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj4k8\" (UniqueName: \"kubernetes.io/projected/0b730bcc-22b1-4daf-ad49-7828cd5db405-kube-api-access-cj4k8\") pod \"0b730bcc-22b1-4daf-ad49-7828cd5db405\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") "
Aug 04 17:53:29.456694 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.456563    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-oauth-serving-cert\") pod \"0b730bcc-22b1-4daf-ad49-7828cd5db405\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") "
Aug 04 17:53:29.456694 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.456596    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-service-ca\") pod \"0b730bcc-22b1-4daf-ad49-7828cd5db405\" (UID: \"0b730bcc-22b1-4daf-ad49-7828cd5db405\") "
Aug 04 17:53:29.456958 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.456893    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-config" (OuterVolumeSpecName: "console-config") pod "0b730bcc-22b1-4daf-ad49-7828cd5db405" (UID: "0b730bcc-22b1-4daf-ad49-7828cd5db405"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:53:29.457111 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.457081    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0b730bcc-22b1-4daf-ad49-7828cd5db405" (UID: "0b730bcc-22b1-4daf-ad49-7828cd5db405"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:53:29.457111 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.457100    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-service-ca" (OuterVolumeSpecName: "service-ca") pod "0b730bcc-22b1-4daf-ad49-7828cd5db405" (UID: "0b730bcc-22b1-4daf-ad49-7828cd5db405"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:53:29.457232 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.457147    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0b730bcc-22b1-4daf-ad49-7828cd5db405" (UID: "0b730bcc-22b1-4daf-ad49-7828cd5db405"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:53:29.458554 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.458530    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0b730bcc-22b1-4daf-ad49-7828cd5db405" (UID: "0b730bcc-22b1-4daf-ad49-7828cd5db405"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:53:29.458634 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.458579    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0b730bcc-22b1-4daf-ad49-7828cd5db405" (UID: "0b730bcc-22b1-4daf-ad49-7828cd5db405"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:53:29.458753 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.458733    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b730bcc-22b1-4daf-ad49-7828cd5db405-kube-api-access-cj4k8" (OuterVolumeSpecName: "kube-api-access-cj4k8") pod "0b730bcc-22b1-4daf-ad49-7828cd5db405" (UID: "0b730bcc-22b1-4daf-ad49-7828cd5db405"). InnerVolumeSpecName "kube-api-access-cj4k8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:53:29.557362 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.557310    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-serving-cert\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:53:29.557362 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.557355    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-trusted-ca-bundle\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:53:29.557362 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.557365    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-config\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:53:29.557362 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.557374    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b730bcc-22b1-4daf-ad49-7828cd5db405-console-oauth-config\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:53:29.557632 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.557383    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj4k8\" (UniqueName: \"kubernetes.io/projected/0b730bcc-22b1-4daf-ad49-7828cd5db405-kube-api-access-cj4k8\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:53:29.557632 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.557393    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-oauth-serving-cert\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:53:29.557632 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:29.557401    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b730bcc-22b1-4daf-ad49-7828cd5db405-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:53:30.154219 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:30.154186    2572 generic.go:356] "Generic (PLEG): container finished" podID="0b730bcc-22b1-4daf-ad49-7828cd5db405" containerID="18958cce87e3dbe4641e4100b3792d1ceda3bf081403ecf1aeb40ba0716f1c31" exitCode=0
Aug 04 17:53:30.154621 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:30.154227    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679667d5b9-56db4"
Aug 04 17:53:30.154621 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:30.154232    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679667d5b9-56db4" event={"ID":"0b730bcc-22b1-4daf-ad49-7828cd5db405","Type":"ContainerDied","Data":"18958cce87e3dbe4641e4100b3792d1ceda3bf081403ecf1aeb40ba0716f1c31"}
Aug 04 17:53:30.154621 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:30.154333    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679667d5b9-56db4" event={"ID":"0b730bcc-22b1-4daf-ad49-7828cd5db405","Type":"ContainerDied","Data":"35aa53c327b66057d162cc7788704d04819d6021dc0c3fe7f603afc8c672dd9b"}
Aug 04 17:53:30.154621 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:30.154353    2572 scope.go:117] "RemoveContainer" containerID="18958cce87e3dbe4641e4100b3792d1ceda3bf081403ecf1aeb40ba0716f1c31"
Aug 04 17:53:30.162400 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:30.162383    2572 scope.go:117] "RemoveContainer" containerID="18958cce87e3dbe4641e4100b3792d1ceda3bf081403ecf1aeb40ba0716f1c31"
Aug 04 17:53:30.162649 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:53:30.162630    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18958cce87e3dbe4641e4100b3792d1ceda3bf081403ecf1aeb40ba0716f1c31\": container with ID starting with 18958cce87e3dbe4641e4100b3792d1ceda3bf081403ecf1aeb40ba0716f1c31 not found: ID does not exist" containerID="18958cce87e3dbe4641e4100b3792d1ceda3bf081403ecf1aeb40ba0716f1c31"
Aug 04 17:53:30.162703 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:30.162658    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18958cce87e3dbe4641e4100b3792d1ceda3bf081403ecf1aeb40ba0716f1c31"} err="failed to get container status \"18958cce87e3dbe4641e4100b3792d1ceda3bf081403ecf1aeb40ba0716f1c31\": rpc error: code = NotFound desc = could not find container \"18958cce87e3dbe4641e4100b3792d1ceda3bf081403ecf1aeb40ba0716f1c31\": container with ID starting with 18958cce87e3dbe4641e4100b3792d1ceda3bf081403ecf1aeb40ba0716f1c31 not found: ID does not exist"
Aug 04 17:53:30.169645 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:30.169623    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-679667d5b9-56db4"]
Aug 04 17:53:30.173532 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:30.173509    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-679667d5b9-56db4"]
Aug 04 17:53:31.598487 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:53:31.598449    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b730bcc-22b1-4daf-ad49-7828cd5db405" path="/var/lib/kubelet/pods/0b730bcc-22b1-4daf-ad49-7828cd5db405/volumes"
Aug 04 17:54:28.753193 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.753111    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85"]
Aug 04 17:54:28.753619 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.753439    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f21018d-8cb3-4d4c-87aa-a9d2573999f4" containerName="console"
Aug 04 17:54:28.753619 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.753451    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f21018d-8cb3-4d4c-87aa-a9d2573999f4" containerName="console"
Aug 04 17:54:28.753619 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.753468    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b730bcc-22b1-4daf-ad49-7828cd5db405" containerName="console"
Aug 04 17:54:28.753619 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.753477    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b730bcc-22b1-4daf-ad49-7828cd5db405" containerName="console"
Aug 04 17:54:28.753619 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.753529    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b730bcc-22b1-4daf-ad49-7828cd5db405" containerName="console"
Aug 04 17:54:28.753619 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.753561    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f21018d-8cb3-4d4c-87aa-a9d2573999f4" containerName="console"
Aug 04 17:54:28.756503 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.756487    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85"
Aug 04 17:54:28.758980 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.758959    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 17:54:28.759789 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.759771    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2pdsf\""
Aug 04 17:54:28.759866 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.759828    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 17:54:28.765329 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.765303    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85"]
Aug 04 17:54:28.813964 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.813908    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4db9p\" (UniqueName: \"kubernetes.io/projected/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-kube-api-access-4db9p\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85\" (UID: \"2f50f595-31fd-43a7-8883-cddf0c3e6bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85"
Aug 04 17:54:28.814092 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.813981    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85\" (UID: \"2f50f595-31fd-43a7-8883-cddf0c3e6bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85"
Aug 04 17:54:28.814092 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.814003    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85\" (UID: \"2f50f595-31fd-43a7-8883-cddf0c3e6bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85"
Aug 04 17:54:28.915153 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.915117    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4db9p\" (UniqueName: \"kubernetes.io/projected/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-kube-api-access-4db9p\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85\" (UID: \"2f50f595-31fd-43a7-8883-cddf0c3e6bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85"
Aug 04 17:54:28.915293 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.915171    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85\" (UID: \"2f50f595-31fd-43a7-8883-cddf0c3e6bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85"
Aug 04 17:54:28.915293 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.915193    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85\" (UID: \"2f50f595-31fd-43a7-8883-cddf0c3e6bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85"
Aug 04 17:54:28.915491 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.915470    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85\" (UID: \"2f50f595-31fd-43a7-8883-cddf0c3e6bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85"
Aug 04 17:54:28.915527 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.915499    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85\" (UID: \"2f50f595-31fd-43a7-8883-cddf0c3e6bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85"
Aug 04 17:54:28.923406 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:28.923378    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4db9p\" (UniqueName: \"kubernetes.io/projected/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-kube-api-access-4db9p\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85\" (UID: \"2f50f595-31fd-43a7-8883-cddf0c3e6bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85"
Aug 04 17:54:29.066850 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:29.066824    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85"
Aug 04 17:54:29.192445 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:29.192416    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85"]
Aug 04 17:54:29.196228 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:54:29.196200    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f50f595_31fd_43a7_8883_cddf0c3e6bb2.slice/crio-69f0d6d7f246ddb430a2982c4a350c8a543d09f3aff782b6b95028120a990dbc WatchSource:0}: Error finding container 69f0d6d7f246ddb430a2982c4a350c8a543d09f3aff782b6b95028120a990dbc: Status 404 returned error can't find the container with id 69f0d6d7f246ddb430a2982c4a350c8a543d09f3aff782b6b95028120a990dbc
Aug 04 17:54:29.373048 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:29.372953    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85" event={"ID":"2f50f595-31fd-43a7-8883-cddf0c3e6bb2","Type":"ContainerStarted","Data":"69f0d6d7f246ddb430a2982c4a350c8a543d09f3aff782b6b95028120a990dbc"}
Aug 04 17:54:37.406726 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:37.406694    2572 generic.go:356] "Generic (PLEG): container finished" podID="2f50f595-31fd-43a7-8883-cddf0c3e6bb2" containerID="5e38d02d590d539b730594a9fb04534585f6a13147d48ea1419b63bce3d923ea" exitCode=0
Aug 04 17:54:37.407148 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:37.406775    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85" event={"ID":"2f50f595-31fd-43a7-8883-cddf0c3e6bb2","Type":"ContainerDied","Data":"5e38d02d590d539b730594a9fb04534585f6a13147d48ea1419b63bce3d923ea"}
Aug 04 17:54:40.421419 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:40.421386    2572 generic.go:356] "Generic (PLEG): container finished" podID="2f50f595-31fd-43a7-8883-cddf0c3e6bb2" containerID="3a2beb12a92c2042012f6df8093695965c6d7e330e7a77fbc720da22990d3721" exitCode=0
Aug 04 17:54:40.421782 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:40.421438    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85" event={"ID":"2f50f595-31fd-43a7-8883-cddf0c3e6bb2","Type":"ContainerDied","Data":"3a2beb12a92c2042012f6df8093695965c6d7e330e7a77fbc720da22990d3721"}
Aug 04 17:54:47.455585 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:47.455551    2572 generic.go:356] "Generic (PLEG): container finished" podID="2f50f595-31fd-43a7-8883-cddf0c3e6bb2" containerID="aceaffb146fe645fb60850e0d3671250f8a449b643853a6a11bf50ea959153d3" exitCode=0
Aug 04 17:54:47.456024 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:47.455635    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85" event={"ID":"2f50f595-31fd-43a7-8883-cddf0c3e6bb2","Type":"ContainerDied","Data":"aceaffb146fe645fb60850e0d3671250f8a449b643853a6a11bf50ea959153d3"}
Aug 04 17:54:48.578750 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:48.578726    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85"
Aug 04 17:54:48.683994 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:48.683969    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4db9p\" (UniqueName: \"kubernetes.io/projected/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-kube-api-access-4db9p\") pod \"2f50f595-31fd-43a7-8883-cddf0c3e6bb2\" (UID: \"2f50f595-31fd-43a7-8883-cddf0c3e6bb2\") "
Aug 04 17:54:48.684128 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:48.684018    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-util\") pod \"2f50f595-31fd-43a7-8883-cddf0c3e6bb2\" (UID: \"2f50f595-31fd-43a7-8883-cddf0c3e6bb2\") "
Aug 04 17:54:48.684128 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:48.684039    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-bundle\") pod \"2f50f595-31fd-43a7-8883-cddf0c3e6bb2\" (UID: \"2f50f595-31fd-43a7-8883-cddf0c3e6bb2\") "
Aug 04 17:54:48.684692 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:48.684667    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-bundle" (OuterVolumeSpecName: "bundle") pod "2f50f595-31fd-43a7-8883-cddf0c3e6bb2" (UID: "2f50f595-31fd-43a7-8883-cddf0c3e6bb2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:54:48.686181 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:48.686151    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-kube-api-access-4db9p" (OuterVolumeSpecName: "kube-api-access-4db9p") pod "2f50f595-31fd-43a7-8883-cddf0c3e6bb2" (UID: "2f50f595-31fd-43a7-8883-cddf0c3e6bb2"). InnerVolumeSpecName "kube-api-access-4db9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:54:48.688546 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:48.688523    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-util" (OuterVolumeSpecName: "util") pod "2f50f595-31fd-43a7-8883-cddf0c3e6bb2" (UID: "2f50f595-31fd-43a7-8883-cddf0c3e6bb2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:54:48.784943 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:48.784852    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-util\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:54:48.784943 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:48.784889    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-bundle\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:54:48.784943 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:48.784899    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4db9p\" (UniqueName: \"kubernetes.io/projected/2f50f595-31fd-43a7-8883-cddf0c3e6bb2-kube-api-access-4db9p\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:54:49.464951 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:49.464905    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85"
Aug 04 17:54:49.464951 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:49.464932    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n6t85" event={"ID":"2f50f595-31fd-43a7-8883-cddf0c3e6bb2","Type":"ContainerDied","Data":"69f0d6d7f246ddb430a2982c4a350c8a543d09f3aff782b6b95028120a990dbc"}
Aug 04 17:54:49.465210 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:49.464972    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69f0d6d7f246ddb430a2982c4a350c8a543d09f3aff782b6b95028120a990dbc"
Aug 04 17:54:57.114628 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.114590    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fd6hr"]
Aug 04 17:54:57.115017 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.114866    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f50f595-31fd-43a7-8883-cddf0c3e6bb2" containerName="pull"
Aug 04 17:54:57.115017 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.114876    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f50f595-31fd-43a7-8883-cddf0c3e6bb2" containerName="pull"
Aug 04 17:54:57.115017 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.114884    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f50f595-31fd-43a7-8883-cddf0c3e6bb2" containerName="util"
Aug 04 17:54:57.115017 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.114889    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f50f595-31fd-43a7-8883-cddf0c3e6bb2" containerName="util"
Aug 04 17:54:57.115017 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.114907    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f50f595-31fd-43a7-8883-cddf0c3e6bb2" containerName="extract"
Aug 04 17:54:57.115017 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.114912    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f50f595-31fd-43a7-8883-cddf0c3e6bb2" containerName="extract"
Aug 04 17:54:57.115017 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.114975    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f50f595-31fd-43a7-8883-cddf0c3e6bb2" containerName="extract"
Aug 04 17:54:57.118069 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.118052    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fd6hr"
Aug 04 17:54:57.120613 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.120589    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Aug 04 17:54:57.120866 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.120846    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Aug 04 17:54:57.121010 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.120986    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-x7rwx\""
Aug 04 17:54:57.133901 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.133882    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fd6hr"]
Aug 04 17:54:57.250115 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.250077    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54884e0b-aa31-4e85-acf0-b72fae4f656f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fd6hr\" (UID: \"54884e0b-aa31-4e85-acf0-b72fae4f656f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fd6hr"
Aug 04 17:54:57.250287 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.250161    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwqd5\" (UniqueName: \"kubernetes.io/projected/54884e0b-aa31-4e85-acf0-b72fae4f656f-kube-api-access-nwqd5\") pod \"cert-manager-operator-controller-manager-55c444bf86-fd6hr\" (UID: \"54884e0b-aa31-4e85-acf0-b72fae4f656f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fd6hr"
Aug 04 17:54:57.351349 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.351304    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwqd5\" (UniqueName: \"kubernetes.io/projected/54884e0b-aa31-4e85-acf0-b72fae4f656f-kube-api-access-nwqd5\") pod \"cert-manager-operator-controller-manager-55c444bf86-fd6hr\" (UID: \"54884e0b-aa31-4e85-acf0-b72fae4f656f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fd6hr"
Aug 04 17:54:57.351457 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.351368    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54884e0b-aa31-4e85-acf0-b72fae4f656f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fd6hr\" (UID: \"54884e0b-aa31-4e85-acf0-b72fae4f656f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fd6hr"
Aug 04 17:54:57.351681 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.351664    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54884e0b-aa31-4e85-acf0-b72fae4f656f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fd6hr\" (UID: \"54884e0b-aa31-4e85-acf0-b72fae4f656f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fd6hr"
Aug 04 17:54:57.359386 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.359359    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwqd5\" (UniqueName: \"kubernetes.io/projected/54884e0b-aa31-4e85-acf0-b72fae4f656f-kube-api-access-nwqd5\") pod \"cert-manager-operator-controller-manager-55c444bf86-fd6hr\" (UID: \"54884e0b-aa31-4e85-acf0-b72fae4f656f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fd6hr"
Aug 04 17:54:57.426743 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.426656    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fd6hr"
Aug 04 17:54:57.555769 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:57.555740    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fd6hr"]
Aug 04 17:54:57.558475 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:54:57.558449    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54884e0b_aa31_4e85_acf0_b72fae4f656f.slice/crio-2f86e1568ed067e6b7564a7e7d140424857ab16caa5775a2b7a6c8a175a18059 WatchSource:0}: Error finding container 2f86e1568ed067e6b7564a7e7d140424857ab16caa5775a2b7a6c8a175a18059: Status 404 returned error can't find the container with id 2f86e1568ed067e6b7564a7e7d140424857ab16caa5775a2b7a6c8a175a18059
Aug 04 17:54:58.501068 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:54:58.501035    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fd6hr" event={"ID":"54884e0b-aa31-4e85-acf0-b72fae4f656f","Type":"ContainerStarted","Data":"2f86e1568ed067e6b7564a7e7d140424857ab16caa5775a2b7a6c8a175a18059"}
Aug 04 17:55:00.511092 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:00.511051    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fd6hr" event={"ID":"54884e0b-aa31-4e85-acf0-b72fae4f656f","Type":"ContainerStarted","Data":"bb85826094478a905ba614046dad4a55184db70b2bda0f091f85eedf5a57166c"}
Aug 04 17:55:00.532937 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:00.532875    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fd6hr" podStartSLOduration=1.461471273 podStartE2EDuration="3.532861861s" totalImagesPullingTime="2.071390588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:54:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:55:00.531839997 +0000 UTC m=+485.441729609" watchObservedRunningTime="2026-08-04 17:55:00.532861861 +0000 UTC m=+485.442751449"
Aug 04 17:55:01.473578 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.473541    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w"]
Aug 04 17:55:01.475989 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.475972    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w"
Aug 04 17:55:01.478266 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.478241    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 17:55:01.478394 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.478377    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 17:55:01.478450 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.478415    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2pdsf\""
Aug 04 17:55:01.485597 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.485572    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w"]
Aug 04 17:55:01.586521 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.586484    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aca9f4f6-9e4d-4e95-8996-9c496742f55a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w\" (UID: \"aca9f4f6-9e4d-4e95-8996-9c496742f55a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w"
Aug 04 17:55:01.586892 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.586564    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aca9f4f6-9e4d-4e95-8996-9c496742f55a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w\" (UID: \"aca9f4f6-9e4d-4e95-8996-9c496742f55a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w"
Aug 04 17:55:01.586892 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.586592    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqs8s\" (UniqueName: \"kubernetes.io/projected/aca9f4f6-9e4d-4e95-8996-9c496742f55a-kube-api-access-qqs8s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w\" (UID: \"aca9f4f6-9e4d-4e95-8996-9c496742f55a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w"
Aug 04 17:55:01.687350 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.687316    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aca9f4f6-9e4d-4e95-8996-9c496742f55a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w\" (UID: \"aca9f4f6-9e4d-4e95-8996-9c496742f55a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w"
Aug 04 17:55:01.687537 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.687405    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aca9f4f6-9e4d-4e95-8996-9c496742f55a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w\" (UID: \"aca9f4f6-9e4d-4e95-8996-9c496742f55a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w"
Aug 04 17:55:01.687537 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.687433    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqs8s\" (UniqueName: \"kubernetes.io/projected/aca9f4f6-9e4d-4e95-8996-9c496742f55a-kube-api-access-qqs8s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w\" (UID: \"aca9f4f6-9e4d-4e95-8996-9c496742f55a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w"
Aug 04 17:55:01.687753 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.687731    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aca9f4f6-9e4d-4e95-8996-9c496742f55a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w\" (UID: \"aca9f4f6-9e4d-4e95-8996-9c496742f55a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w"
Aug 04 17:55:01.687810 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.687750    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aca9f4f6-9e4d-4e95-8996-9c496742f55a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w\" (UID: \"aca9f4f6-9e4d-4e95-8996-9c496742f55a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w"
Aug 04 17:55:01.694960 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.694909    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqs8s\" (UniqueName: \"kubernetes.io/projected/aca9f4f6-9e4d-4e95-8996-9c496742f55a-kube-api-access-qqs8s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w\" (UID: \"aca9f4f6-9e4d-4e95-8996-9c496742f55a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w"
Aug 04 17:55:01.785571 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.785493    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w"
Aug 04 17:55:01.911292 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:01.911266    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w"]
Aug 04 17:55:01.913276 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:55:01.913243    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca9f4f6_9e4d_4e95_8996_9c496742f55a.slice/crio-641b2e8c3a53ecf73f6a5d5e564b90101fec66e022a9a06f1993e7bcc307fec9 WatchSource:0}: Error finding container 641b2e8c3a53ecf73f6a5d5e564b90101fec66e022a9a06f1993e7bcc307fec9: Status 404 returned error can't find the container with id 641b2e8c3a53ecf73f6a5d5e564b90101fec66e022a9a06f1993e7bcc307fec9
Aug 04 17:55:02.520031 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:02.519994    2572 generic.go:356] "Generic (PLEG): container finished" podID="aca9f4f6-9e4d-4e95-8996-9c496742f55a" containerID="9a3347b72fa00d1d58988a7854ad6d3d3315eab8e0f6e9e4c1e2c6073c6c3978" exitCode=0
Aug 04 17:55:02.520230 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:02.520057    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w" event={"ID":"aca9f4f6-9e4d-4e95-8996-9c496742f55a","Type":"ContainerDied","Data":"9a3347b72fa00d1d58988a7854ad6d3d3315eab8e0f6e9e4c1e2c6073c6c3978"}
Aug 04 17:55:02.520230 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:02.520090    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w" event={"ID":"aca9f4f6-9e4d-4e95-8996-9c496742f55a","Type":"ContainerStarted","Data":"641b2e8c3a53ecf73f6a5d5e564b90101fec66e022a9a06f1993e7bcc307fec9"}
Aug 04 17:55:04.170169 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:04.170131    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6jblr"]
Aug 04 17:55:04.175846 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:04.175825    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6jblr"
Aug 04 17:55:04.178641 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:04.178618    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 04 17:55:04.178738 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:04.178685    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vxrfq\""
Aug 04 17:55:04.179543 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:04.179522    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 04 17:55:04.183509 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:04.183489    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6jblr"]
Aug 04 17:55:04.311007 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:04.310965    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj69q\" (UniqueName: \"kubernetes.io/projected/8472893c-7d46-462c-ba40-6726e803106f-kube-api-access-zj69q\") pod \"cert-manager-cainjector-559cdd8c87-6jblr\" (UID: \"8472893c-7d46-462c-ba40-6726e803106f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6jblr"
Aug 04 17:55:04.311180 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:04.311096    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8472893c-7d46-462c-ba40-6726e803106f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6jblr\" (UID: \"8472893c-7d46-462c-ba40-6726e803106f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6jblr"
Aug 04 17:55:04.411973 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:04.411940    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj69q\" (UniqueName: \"kubernetes.io/projected/8472893c-7d46-462c-ba40-6726e803106f-kube-api-access-zj69q\") pod \"cert-manager-cainjector-559cdd8c87-6jblr\" (UID: \"8472893c-7d46-462c-ba40-6726e803106f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6jblr"
Aug 04 17:55:04.412143 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:04.412037    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8472893c-7d46-462c-ba40-6726e803106f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6jblr\" (UID: \"8472893c-7d46-462c-ba40-6726e803106f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6jblr"
Aug 04 17:55:04.420663 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:04.420603    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8472893c-7d46-462c-ba40-6726e803106f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6jblr\" (UID: \"8472893c-7d46-462c-ba40-6726e803106f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6jblr"
Aug 04 17:55:04.420765 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:04.420752    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj69q\" (UniqueName: \"kubernetes.io/projected/8472893c-7d46-462c-ba40-6726e803106f-kube-api-access-zj69q\") pod \"cert-manager-cainjector-559cdd8c87-6jblr\" (UID: \"8472893c-7d46-462c-ba40-6726e803106f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6jblr"
Aug 04 17:55:04.495570 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:04.495528    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6jblr"
Aug 04 17:55:04.698099 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:04.698069    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6jblr"]
Aug 04 17:55:04.699262 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:55:04.699236    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8472893c_7d46_462c_ba40_6726e803106f.slice/crio-37e2d1b6be3a6864f871582ec9c6a0f6dadba27a2e46316207f3b26b14325fab WatchSource:0}: Error finding container 37e2d1b6be3a6864f871582ec9c6a0f6dadba27a2e46316207f3b26b14325fab: Status 404 returned error can't find the container with id 37e2d1b6be3a6864f871582ec9c6a0f6dadba27a2e46316207f3b26b14325fab
Aug 04 17:55:05.535597 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:05.535564    2572 generic.go:356] "Generic (PLEG): container finished" podID="aca9f4f6-9e4d-4e95-8996-9c496742f55a" containerID="bb3a26d18850ef04e4ad5eebf79252641a06012aa031eaf7914ad7a3535bb6fb" exitCode=0
Aug 04 17:55:05.535980 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:05.535643    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w" event={"ID":"aca9f4f6-9e4d-4e95-8996-9c496742f55a","Type":"ContainerDied","Data":"bb3a26d18850ef04e4ad5eebf79252641a06012aa031eaf7914ad7a3535bb6fb"}
Aug 04 17:55:05.536961 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:05.536938    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6jblr" event={"ID":"8472893c-7d46-462c-ba40-6726e803106f","Type":"ContainerStarted","Data":"37e2d1b6be3a6864f871582ec9c6a0f6dadba27a2e46316207f3b26b14325fab"}
Aug 04 17:55:06.544196 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:06.544163    2572 generic.go:356] "Generic (PLEG): container finished" podID="aca9f4f6-9e4d-4e95-8996-9c496742f55a" containerID="5748863ba3137bc0b96b4bf929fffa151ca5484bccd29cfd6250976c3ae87256" exitCode=0
Aug 04 17:55:06.544583 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:06.544254    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w" event={"ID":"aca9f4f6-9e4d-4e95-8996-9c496742f55a","Type":"ContainerDied","Data":"5748863ba3137bc0b96b4bf929fffa151ca5484bccd29cfd6250976c3ae87256"}
Aug 04 17:55:07.826988 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:07.826965    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w"
Aug 04 17:55:07.945527 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:07.945503    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aca9f4f6-9e4d-4e95-8996-9c496742f55a-bundle\") pod \"aca9f4f6-9e4d-4e95-8996-9c496742f55a\" (UID: \"aca9f4f6-9e4d-4e95-8996-9c496742f55a\") "
Aug 04 17:55:07.945637 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:07.945563    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aca9f4f6-9e4d-4e95-8996-9c496742f55a-util\") pod \"aca9f4f6-9e4d-4e95-8996-9c496742f55a\" (UID: \"aca9f4f6-9e4d-4e95-8996-9c496742f55a\") "
Aug 04 17:55:07.945637 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:07.945609    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqs8s\" (UniqueName: \"kubernetes.io/projected/aca9f4f6-9e4d-4e95-8996-9c496742f55a-kube-api-access-qqs8s\") pod \"aca9f4f6-9e4d-4e95-8996-9c496742f55a\" (UID: \"aca9f4f6-9e4d-4e95-8996-9c496742f55a\") "
Aug 04 17:55:07.945890 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:07.945863    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aca9f4f6-9e4d-4e95-8996-9c496742f55a-bundle" (OuterVolumeSpecName: "bundle") pod "aca9f4f6-9e4d-4e95-8996-9c496742f55a" (UID: "aca9f4f6-9e4d-4e95-8996-9c496742f55a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:55:07.947491 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:07.947467    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aca9f4f6-9e4d-4e95-8996-9c496742f55a-kube-api-access-qqs8s" (OuterVolumeSpecName: "kube-api-access-qqs8s") pod "aca9f4f6-9e4d-4e95-8996-9c496742f55a" (UID: "aca9f4f6-9e4d-4e95-8996-9c496742f55a"). InnerVolumeSpecName "kube-api-access-qqs8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:55:07.952847 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:07.952823    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aca9f4f6-9e4d-4e95-8996-9c496742f55a-util" (OuterVolumeSpecName: "util") pod "aca9f4f6-9e4d-4e95-8996-9c496742f55a" (UID: "aca9f4f6-9e4d-4e95-8996-9c496742f55a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:55:08.047164 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.047125    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aca9f4f6-9e4d-4e95-8996-9c496742f55a-util\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:55:08.047164 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.047164    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqs8s\" (UniqueName: \"kubernetes.io/projected/aca9f4f6-9e4d-4e95-8996-9c496742f55a-kube-api-access-qqs8s\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:55:08.047356 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.047178    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aca9f4f6-9e4d-4e95-8996-9c496742f55a-bundle\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:55:08.554822 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.554789    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w" event={"ID":"aca9f4f6-9e4d-4e95-8996-9c496742f55a","Type":"ContainerDied","Data":"641b2e8c3a53ecf73f6a5d5e564b90101fec66e022a9a06f1993e7bcc307fec9"}
Aug 04 17:55:08.554998 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.554842    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="641b2e8c3a53ecf73f6a5d5e564b90101fec66e022a9a06f1993e7bcc307fec9"
Aug 04 17:55:08.554998 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.554801    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9sc4w"
Aug 04 17:55:08.556435 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.556402    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6jblr" event={"ID":"8472893c-7d46-462c-ba40-6726e803106f","Type":"ContainerStarted","Data":"1a486b70b349c0b2c36c755146aa4ee0f932e0d7dd7c9e08687c831d108c086e"}
Aug 04 17:55:08.570530 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.570485    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6jblr" podStartSLOduration=1.396700593 podStartE2EDuration="4.570471156s" totalImagesPullingTime="3.173770563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:55:08.569967209 +0000 UTC m=+493.479856797" watchObservedRunningTime="2026-08-04 17:55:08.570471156 +0000 UTC m=+493.480360744"
Aug 04 17:55:08.753541 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.753507    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hb52j"]
Aug 04 17:55:08.753809 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.753798    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aca9f4f6-9e4d-4e95-8996-9c496742f55a" containerName="util"
Aug 04 17:55:08.753866 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.753811    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aca9f4f6-9e4d-4e95-8996-9c496742f55a" containerName="util"
Aug 04 17:55:08.753866 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.753827    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aca9f4f6-9e4d-4e95-8996-9c496742f55a" containerName="extract"
Aug 04 17:55:08.753866 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.753833    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aca9f4f6-9e4d-4e95-8996-9c496742f55a" containerName="extract"
Aug 04 17:55:08.753866 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.753842    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aca9f4f6-9e4d-4e95-8996-9c496742f55a" containerName="pull"
Aug 04 17:55:08.753866 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.753847    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aca9f4f6-9e4d-4e95-8996-9c496742f55a" containerName="pull"
Aug 04 17:55:08.754026 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.753888    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aca9f4f6-9e4d-4e95-8996-9c496742f55a" containerName="extract"
Aug 04 17:55:08.756848 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.756827    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hb52j"
Aug 04 17:55:08.759108 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.759091    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lmvk9\""
Aug 04 17:55:08.767755 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.767734    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hb52j"]
Aug 04 17:55:08.853699 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.853608    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97d45\" (UniqueName: \"kubernetes.io/projected/c3f5c9ad-8128-456a-8492-b3403ee3c297-kube-api-access-97d45\") pod \"cert-manager-webhook-6486ffd997-hb52j\" (UID: \"c3f5c9ad-8128-456a-8492-b3403ee3c297\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hb52j"
Aug 04 17:55:08.853699 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.853679    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3f5c9ad-8128-456a-8492-b3403ee3c297-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hb52j\" (UID: \"c3f5c9ad-8128-456a-8492-b3403ee3c297\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hb52j"
Aug 04 17:55:08.954943 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.954893    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3f5c9ad-8128-456a-8492-b3403ee3c297-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hb52j\" (UID: \"c3f5c9ad-8128-456a-8492-b3403ee3c297\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hb52j"
Aug 04 17:55:08.955094 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.955042    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97d45\" (UniqueName: \"kubernetes.io/projected/c3f5c9ad-8128-456a-8492-b3403ee3c297-kube-api-access-97d45\") pod \"cert-manager-webhook-6486ffd997-hb52j\" (UID: \"c3f5c9ad-8128-456a-8492-b3403ee3c297\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hb52j"
Aug 04 17:55:08.963652 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.963616    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3f5c9ad-8128-456a-8492-b3403ee3c297-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hb52j\" (UID: \"c3f5c9ad-8128-456a-8492-b3403ee3c297\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hb52j"
Aug 04 17:55:08.963822 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:08.963802    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97d45\" (UniqueName: \"kubernetes.io/projected/c3f5c9ad-8128-456a-8492-b3403ee3c297-kube-api-access-97d45\") pod \"cert-manager-webhook-6486ffd997-hb52j\" (UID: \"c3f5c9ad-8128-456a-8492-b3403ee3c297\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hb52j"
Aug 04 17:55:09.065994 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:09.065957    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hb52j"
Aug 04 17:55:09.188514 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:09.188487    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hb52j"]
Aug 04 17:55:09.190868 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:55:09.190834    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3f5c9ad_8128_456a_8492_b3403ee3c297.slice/crio-1561d6e427d4b14e85ed1eaad11aa0a0a67b2d2bd2381a74d860e3a1a9805e47 WatchSource:0}: Error finding container 1561d6e427d4b14e85ed1eaad11aa0a0a67b2d2bd2381a74d860e3a1a9805e47: Status 404 returned error can't find the container with id 1561d6e427d4b14e85ed1eaad11aa0a0a67b2d2bd2381a74d860e3a1a9805e47
Aug 04 17:55:09.562074 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:09.562042    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hb52j" event={"ID":"c3f5c9ad-8128-456a-8492-b3403ee3c297","Type":"ContainerStarted","Data":"85d6c8a48e2f09e55561688dba0b8ceed194e5daa654debd40912a8c6f9f52cb"}
Aug 04 17:55:09.562215 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:09.562085    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hb52j" event={"ID":"c3f5c9ad-8128-456a-8492-b3403ee3c297","Type":"ContainerStarted","Data":"1561d6e427d4b14e85ed1eaad11aa0a0a67b2d2bd2381a74d860e3a1a9805e47"}
Aug 04 17:55:09.578568 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:09.578523    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-hb52j" podStartSLOduration=1.578510087 podStartE2EDuration="1.578510087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:55:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:55:09.577440542 +0000 UTC m=+494.487330133" watchObservedRunningTime="2026-08-04 17:55:09.578510087 +0000 UTC m=+494.488399675"
Aug 04 17:55:10.566646 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:10.566613    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hb52j"
Aug 04 17:55:10.864496 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:10.864422    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d5vgr"]
Aug 04 17:55:10.867597 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:10.867583    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-d5vgr"
Aug 04 17:55:10.870249 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:10.870226    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mn47j\""
Aug 04 17:55:10.878817 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:10.878797    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d5vgr"]
Aug 04 17:55:10.970493 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:10.970465    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d18f3241-a077-41ec-87b9-92052f901da4-bound-sa-token\") pod \"cert-manager-55b4d954d5-d5vgr\" (UID: \"d18f3241-a077-41ec-87b9-92052f901da4\") " pod="cert-manager/cert-manager-55b4d954d5-d5vgr"
Aug 04 17:55:10.970627 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:10.970542    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcg69\" (UniqueName: \"kubernetes.io/projected/d18f3241-a077-41ec-87b9-92052f901da4-kube-api-access-zcg69\") pod \"cert-manager-55b4d954d5-d5vgr\" (UID: \"d18f3241-a077-41ec-87b9-92052f901da4\") " pod="cert-manager/cert-manager-55b4d954d5-d5vgr"
Aug 04 17:55:11.071190 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:11.071157    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcg69\" (UniqueName: \"kubernetes.io/projected/d18f3241-a077-41ec-87b9-92052f901da4-kube-api-access-zcg69\") pod \"cert-manager-55b4d954d5-d5vgr\" (UID: \"d18f3241-a077-41ec-87b9-92052f901da4\") " pod="cert-manager/cert-manager-55b4d954d5-d5vgr"
Aug 04 17:55:11.071339 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:11.071198    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d18f3241-a077-41ec-87b9-92052f901da4-bound-sa-token\") pod \"cert-manager-55b4d954d5-d5vgr\" (UID: \"d18f3241-a077-41ec-87b9-92052f901da4\") " pod="cert-manager/cert-manager-55b4d954d5-d5vgr"
Aug 04 17:55:11.079712 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:11.079680    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcg69\" (UniqueName: \"kubernetes.io/projected/d18f3241-a077-41ec-87b9-92052f901da4-kube-api-access-zcg69\") pod \"cert-manager-55b4d954d5-d5vgr\" (UID: \"d18f3241-a077-41ec-87b9-92052f901da4\") " pod="cert-manager/cert-manager-55b4d954d5-d5vgr"
Aug 04 17:55:11.079890 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:11.079872    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d18f3241-a077-41ec-87b9-92052f901da4-bound-sa-token\") pod \"cert-manager-55b4d954d5-d5vgr\" (UID: \"d18f3241-a077-41ec-87b9-92052f901da4\") " pod="cert-manager/cert-manager-55b4d954d5-d5vgr"
Aug 04 17:55:11.177180 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:11.177095    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-d5vgr"
Aug 04 17:55:11.299491 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:11.299464    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d5vgr"]
Aug 04 17:55:11.301911 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:55:11.301879    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd18f3241_a077_41ec_87b9_92052f901da4.slice/crio-9298ccd1b9bd6e11664fd380b82584c570c02364535c595056ea3224609c2327 WatchSource:0}: Error finding container 9298ccd1b9bd6e11664fd380b82584c570c02364535c595056ea3224609c2327: Status 404 returned error can't find the container with id 9298ccd1b9bd6e11664fd380b82584c570c02364535c595056ea3224609c2327
Aug 04 17:55:11.571740 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:11.571701    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-d5vgr" event={"ID":"d18f3241-a077-41ec-87b9-92052f901da4","Type":"ContainerStarted","Data":"9e8a37bc724e437aa3e3c4f5fdc13badd639160aac0cf32f8db9d1585d1dfe20"}
Aug 04 17:55:11.571740 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:11.571746    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-d5vgr" event={"ID":"d18f3241-a077-41ec-87b9-92052f901da4","Type":"ContainerStarted","Data":"9298ccd1b9bd6e11664fd380b82584c570c02364535c595056ea3224609c2327"}
Aug 04 17:55:11.586775 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:11.586731    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-d5vgr" podStartSLOduration=1.586717996 podStartE2EDuration="1.586717996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:55:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:55:11.585831161 +0000 UTC m=+496.495720750" watchObservedRunningTime="2026-08-04 17:55:11.586717996 +0000 UTC m=+496.496607583"
Aug 04 17:55:16.574196 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:16.574155    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hb52j"
Aug 04 17:55:22.762020 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:22.761982    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86"]
Aug 04 17:55:22.764534 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:22.764512    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86"
Aug 04 17:55:22.766673 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:22.766649    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 17:55:22.766792 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:22.766768    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2pdsf\""
Aug 04 17:55:22.767609 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:22.767593    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 17:55:22.773160 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:22.773140    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86"]
Aug 04 17:55:22.864206 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:22.864164    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4tg5\" (UniqueName: \"kubernetes.io/projected/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-kube-api-access-c4tg5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86\" (UID: \"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86"
Aug 04 17:55:22.864379 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:22.864219    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86\" (UID: \"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86"
Aug 04 17:55:22.864379 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:22.864302    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86\" (UID: \"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86"
Aug 04 17:55:22.965417 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:22.965384    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86\" (UID: \"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86"
Aug 04 17:55:22.965622 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:22.965474    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4tg5\" (UniqueName: \"kubernetes.io/projected/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-kube-api-access-c4tg5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86\" (UID: \"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86"
Aug 04 17:55:22.965622 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:22.965515    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86\" (UID: \"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86"
Aug 04 17:55:22.965784 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:22.965763    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86\" (UID: \"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86"
Aug 04 17:55:22.965861 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:22.965839    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86\" (UID: \"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86"
Aug 04 17:55:22.973671 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:22.973641    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4tg5\" (UniqueName: \"kubernetes.io/projected/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-kube-api-access-c4tg5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86\" (UID: \"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86"
Aug 04 17:55:23.074647 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:23.074612    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86"
Aug 04 17:55:23.200452 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:23.200427    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86"]
Aug 04 17:55:23.202389 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:55:23.202361    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdbf0101_cb1c_46ba_a56a_d05d709c3bb6.slice/crio-43de91d323e1bb8acb163bbfac73fee19be7ea04b47e3c5fe057788f911a8581 WatchSource:0}: Error finding container 43de91d323e1bb8acb163bbfac73fee19be7ea04b47e3c5fe057788f911a8581: Status 404 returned error can't find the container with id 43de91d323e1bb8acb163bbfac73fee19be7ea04b47e3c5fe057788f911a8581
Aug 04 17:55:23.622284 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:23.622252    2572 generic.go:356] "Generic (PLEG): container finished" podID="bdbf0101-cb1c-46ba-a56a-d05d709c3bb6" containerID="38a403c3090e0f51a243684c206d513711e222a722278a3bd7b303e2774dea1d" exitCode=0
Aug 04 17:55:23.622483 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:23.622330    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86" event={"ID":"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6","Type":"ContainerDied","Data":"38a403c3090e0f51a243684c206d513711e222a722278a3bd7b303e2774dea1d"}
Aug 04 17:55:23.622483 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:23.622372    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86" event={"ID":"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6","Type":"ContainerStarted","Data":"43de91d323e1bb8acb163bbfac73fee19be7ea04b47e3c5fe057788f911a8581"}
Aug 04 17:55:24.628078 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:24.628043    2572 generic.go:356] "Generic (PLEG): container finished" podID="bdbf0101-cb1c-46ba-a56a-d05d709c3bb6" containerID="5d678de84a14b7f571f037ce994eaff22f6a09883eec5baf8a5fcc6547cc2b4d" exitCode=0
Aug 04 17:55:24.628490 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:24.628130    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86" event={"ID":"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6","Type":"ContainerDied","Data":"5d678de84a14b7f571f037ce994eaff22f6a09883eec5baf8a5fcc6547cc2b4d"}
Aug 04 17:55:25.634280 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:25.634247    2572 generic.go:356] "Generic (PLEG): container finished" podID="bdbf0101-cb1c-46ba-a56a-d05d709c3bb6" containerID="9aef1993cbdb7056490109e666dc8e7648f31e3c8f7a9e29974daf68b8823260" exitCode=0
Aug 04 17:55:25.634637 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:25.634300    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86" event={"ID":"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6","Type":"ContainerDied","Data":"9aef1993cbdb7056490109e666dc8e7648f31e3c8f7a9e29974daf68b8823260"}
Aug 04 17:55:26.756250 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:26.756227    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86"
Aug 04 17:55:26.796087 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:26.796061    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-bundle\") pod \"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6\" (UID: \"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6\") "
Aug 04 17:55:26.796224 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:26.796105    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-util\") pod \"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6\" (UID: \"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6\") "
Aug 04 17:55:26.796224 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:26.796128    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4tg5\" (UniqueName: \"kubernetes.io/projected/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-kube-api-access-c4tg5\") pod \"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6\" (UID: \"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6\") "
Aug 04 17:55:26.796758 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:26.796721    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-bundle" (OuterVolumeSpecName: "bundle") pod "bdbf0101-cb1c-46ba-a56a-d05d709c3bb6" (UID: "bdbf0101-cb1c-46ba-a56a-d05d709c3bb6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:55:26.798232 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:26.798210    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-kube-api-access-c4tg5" (OuterVolumeSpecName: "kube-api-access-c4tg5") pod "bdbf0101-cb1c-46ba-a56a-d05d709c3bb6" (UID: "bdbf0101-cb1c-46ba-a56a-d05d709c3bb6"). InnerVolumeSpecName "kube-api-access-c4tg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:55:26.805460 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:26.805418    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-util" (OuterVolumeSpecName: "util") pod "bdbf0101-cb1c-46ba-a56a-d05d709c3bb6" (UID: "bdbf0101-cb1c-46ba-a56a-d05d709c3bb6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:55:26.897027 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:26.896974    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4tg5\" (UniqueName: \"kubernetes.io/projected/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-kube-api-access-c4tg5\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:55:26.897027 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:26.896997    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-bundle\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:55:26.897027 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:26.897007    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdbf0101-cb1c-46ba-a56a-d05d709c3bb6-util\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:55:27.644436 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:27.644400    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86" event={"ID":"bdbf0101-cb1c-46ba-a56a-d05d709c3bb6","Type":"ContainerDied","Data":"43de91d323e1bb8acb163bbfac73fee19be7ea04b47e3c5fe057788f911a8581"}
Aug 04 17:55:27.644436 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:27.644428    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft5l86"
Aug 04 17:55:27.644619 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:27.644454    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43de91d323e1bb8acb163bbfac73fee19be7ea04b47e3c5fe057788f911a8581"
Aug 04 17:55:36.052851 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.052814    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"]
Aug 04 17:55:36.053289 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.053162    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdbf0101-cb1c-46ba-a56a-d05d709c3bb6" containerName="util"
Aug 04 17:55:36.053289 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.053173    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdbf0101-cb1c-46ba-a56a-d05d709c3bb6" containerName="util"
Aug 04 17:55:36.053289 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.053181    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdbf0101-cb1c-46ba-a56a-d05d709c3bb6" containerName="extract"
Aug 04 17:55:36.053289 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.053189    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdbf0101-cb1c-46ba-a56a-d05d709c3bb6" containerName="extract"
Aug 04 17:55:36.053289 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.053203    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdbf0101-cb1c-46ba-a56a-d05d709c3bb6" containerName="pull"
Aug 04 17:55:36.053289 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.053209    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdbf0101-cb1c-46ba-a56a-d05d709c3bb6" containerName="pull"
Aug 04 17:55:36.053289 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.053266    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdbf0101-cb1c-46ba-a56a-d05d709c3bb6" containerName="extract"
Aug 04 17:55:36.058962 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.058941    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.064208 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.064184    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6m798\""
Aug 04 17:55:36.064500 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.064482    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 17:55:36.064604 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.064551    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 17:55:36.064658 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.064615    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 17:55:36.064700 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.064656    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 17:55:36.114254 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.114216    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"]
Aug 04 17:55:36.174513 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.174481    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad213a4a-2bf0-4e0f-a21d-73d0e880de31-webhook-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-znjr5\" (UID: \"ad213a4a-2bf0-4e0f-a21d-73d0e880de31\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.174513 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.174513    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7nwk\" (UniqueName: \"kubernetes.io/projected/ad213a4a-2bf0-4e0f-a21d-73d0e880de31-kube-api-access-b7nwk\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-znjr5\" (UID: \"ad213a4a-2bf0-4e0f-a21d-73d0e880de31\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.174703 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.174563    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad213a4a-2bf0-4e0f-a21d-73d0e880de31-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-znjr5\" (UID: \"ad213a4a-2bf0-4e0f-a21d-73d0e880de31\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.174703 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.174592    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad213a4a-2bf0-4e0f-a21d-73d0e880de31-manifests\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-znjr5\" (UID: \"ad213a4a-2bf0-4e0f-a21d-73d0e880de31\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.174703 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.174628    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad213a4a-2bf0-4e0f-a21d-73d0e880de31-tmp\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-znjr5\" (UID: \"ad213a4a-2bf0-4e0f-a21d-73d0e880de31\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.275681 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.275649    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad213a4a-2bf0-4e0f-a21d-73d0e880de31-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-znjr5\" (UID: \"ad213a4a-2bf0-4e0f-a21d-73d0e880de31\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.275843 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.275688    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad213a4a-2bf0-4e0f-a21d-73d0e880de31-manifests\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-znjr5\" (UID: \"ad213a4a-2bf0-4e0f-a21d-73d0e880de31\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.275901 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.275885    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad213a4a-2bf0-4e0f-a21d-73d0e880de31-tmp\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-znjr5\" (UID: \"ad213a4a-2bf0-4e0f-a21d-73d0e880de31\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.276013 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.275994    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad213a4a-2bf0-4e0f-a21d-73d0e880de31-webhook-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-znjr5\" (UID: \"ad213a4a-2bf0-4e0f-a21d-73d0e880de31\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.276081 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.276026    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7nwk\" (UniqueName: \"kubernetes.io/projected/ad213a4a-2bf0-4e0f-a21d-73d0e880de31-kube-api-access-b7nwk\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-znjr5\" (UID: \"ad213a4a-2bf0-4e0f-a21d-73d0e880de31\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.276202 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.276180    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad213a4a-2bf0-4e0f-a21d-73d0e880de31-manifests\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-znjr5\" (UID: \"ad213a4a-2bf0-4e0f-a21d-73d0e880de31\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.277984 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.277957    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad213a4a-2bf0-4e0f-a21d-73d0e880de31-tmp\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-znjr5\" (UID: \"ad213a4a-2bf0-4e0f-a21d-73d0e880de31\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.278215 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.278195    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad213a4a-2bf0-4e0f-a21d-73d0e880de31-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-znjr5\" (UID: \"ad213a4a-2bf0-4e0f-a21d-73d0e880de31\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.278347 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.278326    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad213a4a-2bf0-4e0f-a21d-73d0e880de31-webhook-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-znjr5\" (UID: \"ad213a4a-2bf0-4e0f-a21d-73d0e880de31\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.285084 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.285058    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7nwk\" (UniqueName: \"kubernetes.io/projected/ad213a4a-2bf0-4e0f-a21d-73d0e880de31-kube-api-access-b7nwk\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-znjr5\" (UID: \"ad213a4a-2bf0-4e0f-a21d-73d0e880de31\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.369045 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.369015    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:36.512370 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.512334    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"]
Aug 04 17:55:36.515681 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:55:36.515649    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad213a4a_2bf0_4e0f_a21d_73d0e880de31.slice/crio-763951faf427da83df8e1e0d20a1d59eb19c918a8acc50c3dcc66b5f8ebd1d81 WatchSource:0}: Error finding container 763951faf427da83df8e1e0d20a1d59eb19c918a8acc50c3dcc66b5f8ebd1d81: Status 404 returned error can't find the container with id 763951faf427da83df8e1e0d20a1d59eb19c918a8acc50c3dcc66b5f8ebd1d81
Aug 04 17:55:36.685607 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:36.685510    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5" event={"ID":"ad213a4a-2bf0-4e0f-a21d-73d0e880de31","Type":"ContainerStarted","Data":"763951faf427da83df8e1e0d20a1d59eb19c918a8acc50c3dcc66b5f8ebd1d81"}
Aug 04 17:55:40.706401 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:40.706366    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5" event={"ID":"ad213a4a-2bf0-4e0f-a21d-73d0e880de31","Type":"ContainerStarted","Data":"c830d47c50355b59f8bb2ebff01d78ad109cfbf204dee11ed7d93709e85dcf5c"}
Aug 04 17:55:41.711803 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:41.711768    2572 generic.go:356] "Generic (PLEG): container finished" podID="ad213a4a-2bf0-4e0f-a21d-73d0e880de31" containerID="c830d47c50355b59f8bb2ebff01d78ad109cfbf204dee11ed7d93709e85dcf5c" exitCode=0
Aug 04 17:55:41.712240 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:41.711857    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5" event={"ID":"ad213a4a-2bf0-4e0f-a21d-73d0e880de31","Type":"ContainerDied","Data":"c830d47c50355b59f8bb2ebff01d78ad109cfbf204dee11ed7d93709e85dcf5c"}
Aug 04 17:55:44.727975 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:44.727931    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5" event={"ID":"ad213a4a-2bf0-4e0f-a21d-73d0e880de31","Type":"ContainerStarted","Data":"bcfed08b72394cbc85a98cc178f3f6dd55d5ab1e7c3eac7982a83ae26c1df56a"}
Aug 04 17:55:44.728419 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:44.728071    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:44.752542 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:44.752485    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5" podStartSLOduration=2.37061397 podStartE2EDuration="8.752468851s" totalImagesPullingTime="5.299144851s" totalInitContainerRuntime="1.08271003s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:55:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:55:44.751547463 +0000 UTC m=+529.661437074" watchObservedRunningTime="2026-08-04 17:55:44.752468851 +0000 UTC m=+529.662358438"
Aug 04 17:55:55.735116 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:55.735050    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-znjr5"
Aug 04 17:55:57.788422 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:57.788390    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2"]
Aug 04 17:55:57.793972 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:57.793951    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2"
Aug 04 17:55:57.796658 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:57.796635    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 04 17:55:57.796775 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:57.796758    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 04 17:55:57.797771 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:57.797752    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-krbfz\""
Aug 04 17:55:57.807205 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:57.807185    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2"]
Aug 04 17:55:57.964290 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:57.964265    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlzl9\" (UniqueName: \"kubernetes.io/projected/6fbcadd4-7b82-47fb-9eeb-87d54670157d-kube-api-access-tlzl9\") pod \"kube-auth-proxy-99b5d7fdc-grwv2\" (UID: \"6fbcadd4-7b82-47fb-9eeb-87d54670157d\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2"
Aug 04 17:55:57.964423 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:57.964316    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fbcadd4-7b82-47fb-9eeb-87d54670157d-tmp\") pod \"kube-auth-proxy-99b5d7fdc-grwv2\" (UID: \"6fbcadd4-7b82-47fb-9eeb-87d54670157d\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2"
Aug 04 17:55:57.964423 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:57.964335    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fbcadd4-7b82-47fb-9eeb-87d54670157d-tls-certs\") pod \"kube-auth-proxy-99b5d7fdc-grwv2\" (UID: \"6fbcadd4-7b82-47fb-9eeb-87d54670157d\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2"
Aug 04 17:55:58.065138 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.065112    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fbcadd4-7b82-47fb-9eeb-87d54670157d-tmp\") pod \"kube-auth-proxy-99b5d7fdc-grwv2\" (UID: \"6fbcadd4-7b82-47fb-9eeb-87d54670157d\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2"
Aug 04 17:55:58.065292 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.065142    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fbcadd4-7b82-47fb-9eeb-87d54670157d-tls-certs\") pod \"kube-auth-proxy-99b5d7fdc-grwv2\" (UID: \"6fbcadd4-7b82-47fb-9eeb-87d54670157d\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2"
Aug 04 17:55:58.065292 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.065199    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlzl9\" (UniqueName: \"kubernetes.io/projected/6fbcadd4-7b82-47fb-9eeb-87d54670157d-kube-api-access-tlzl9\") pod \"kube-auth-proxy-99b5d7fdc-grwv2\" (UID: \"6fbcadd4-7b82-47fb-9eeb-87d54670157d\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2"
Aug 04 17:55:58.067407 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.067386    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fbcadd4-7b82-47fb-9eeb-87d54670157d-tmp\") pod \"kube-auth-proxy-99b5d7fdc-grwv2\" (UID: \"6fbcadd4-7b82-47fb-9eeb-87d54670157d\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2"
Aug 04 17:55:58.067650 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.067627    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fbcadd4-7b82-47fb-9eeb-87d54670157d-tls-certs\") pod \"kube-auth-proxy-99b5d7fdc-grwv2\" (UID: \"6fbcadd4-7b82-47fb-9eeb-87d54670157d\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2"
Aug 04 17:55:58.078294 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.078248    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlzl9\" (UniqueName: \"kubernetes.io/projected/6fbcadd4-7b82-47fb-9eeb-87d54670157d-kube-api-access-tlzl9\") pod \"kube-auth-proxy-99b5d7fdc-grwv2\" (UID: \"6fbcadd4-7b82-47fb-9eeb-87d54670157d\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2"
Aug 04 17:55:58.103708 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.103469    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2"
Aug 04 17:55:58.234531 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.234503    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2"]
Aug 04 17:55:58.236335 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:55:58.236308    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fbcadd4_7b82_47fb_9eeb_87d54670157d.slice/crio-0de773b8a1a8dc2444b446d0a2e7b5aa2d752ce8bc5ff046c83a5e88f44d30a8 WatchSource:0}: Error finding container 0de773b8a1a8dc2444b446d0a2e7b5aa2d752ce8bc5ff046c83a5e88f44d30a8: Status 404 returned error can't find the container with id 0de773b8a1a8dc2444b446d0a2e7b5aa2d752ce8bc5ff046c83a5e88f44d30a8
Aug 04 17:55:58.656690 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.656654    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-k6x85"]
Aug 04 17:55:58.661099 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.661083    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-k6x85"
Aug 04 17:55:58.663435 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.663415    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Aug 04 17:55:58.663681 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.663664    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-lctbn\""
Aug 04 17:55:58.671527 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.671506    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-k6x85"]
Aug 04 17:55:58.771189 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.771151    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4d9x\" (UniqueName: \"kubernetes.io/projected/e80ca94a-bea1-469d-88b5-fb74e601de0c-kube-api-access-j4d9x\") pod \"model-serving-api-54d89bd5fc-k6x85\" (UID: \"e80ca94a-bea1-469d-88b5-fb74e601de0c\") " pod="opendatahub/model-serving-api-54d89bd5fc-k6x85"
Aug 04 17:55:58.771354 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.771280    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e80ca94a-bea1-469d-88b5-fb74e601de0c-tls-certs\") pod \"model-serving-api-54d89bd5fc-k6x85\" (UID: \"e80ca94a-bea1-469d-88b5-fb74e601de0c\") " pod="opendatahub/model-serving-api-54d89bd5fc-k6x85"
Aug 04 17:55:58.791991 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.791963    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2" event={"ID":"6fbcadd4-7b82-47fb-9eeb-87d54670157d","Type":"ContainerStarted","Data":"0de773b8a1a8dc2444b446d0a2e7b5aa2d752ce8bc5ff046c83a5e88f44d30a8"}
Aug 04 17:55:58.872305 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.872283    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e80ca94a-bea1-469d-88b5-fb74e601de0c-tls-certs\") pod \"model-serving-api-54d89bd5fc-k6x85\" (UID: \"e80ca94a-bea1-469d-88b5-fb74e601de0c\") " pod="opendatahub/model-serving-api-54d89bd5fc-k6x85"
Aug 04 17:55:58.872441 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.872316    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4d9x\" (UniqueName: \"kubernetes.io/projected/e80ca94a-bea1-469d-88b5-fb74e601de0c-kube-api-access-j4d9x\") pod \"model-serving-api-54d89bd5fc-k6x85\" (UID: \"e80ca94a-bea1-469d-88b5-fb74e601de0c\") " pod="opendatahub/model-serving-api-54d89bd5fc-k6x85"
Aug 04 17:55:58.872495 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:55:58.872449    2572 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Aug 04 17:55:58.872530 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:55:58.872521    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e80ca94a-bea1-469d-88b5-fb74e601de0c-tls-certs podName:e80ca94a-bea1-469d-88b5-fb74e601de0c nodeName:}" failed. No retries permitted until 2026-08-04 17:55:59.372499835 +0000 UTC m=+544.282389417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/e80ca94a-bea1-469d-88b5-fb74e601de0c-tls-certs") pod "model-serving-api-54d89bd5fc-k6x85" (UID: "e80ca94a-bea1-469d-88b5-fb74e601de0c") : secret "model-serving-api-tls" not found
Aug 04 17:55:58.883985 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:58.883963    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4d9x\" (UniqueName: \"kubernetes.io/projected/e80ca94a-bea1-469d-88b5-fb74e601de0c-kube-api-access-j4d9x\") pod \"model-serving-api-54d89bd5fc-k6x85\" (UID: \"e80ca94a-bea1-469d-88b5-fb74e601de0c\") " pod="opendatahub/model-serving-api-54d89bd5fc-k6x85"
Aug 04 17:55:59.089751 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.089716    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"]
Aug 04 17:55:59.093184 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.093162    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.096488 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.096466    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 17:55:59.097632 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.097601    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 04 17:55:59.097735 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.097600    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 04 17:55:59.097949 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.097906    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 04 17:55:59.097949 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.097938    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vp6rf\""
Aug 04 17:55:59.126945 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.126893    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"]
Aug 04 17:55:59.276015 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.275972    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0faca49-ff20-4d77-b312-b2c79111a29f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.276192 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.276058    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.276192 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.276103    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.276192 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.276126    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.276192 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.276158    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.276406 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.276191    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cxqg\" (UniqueName: \"kubernetes.io/projected/c0faca49-ff20-4d77-b312-b2c79111a29f-kube-api-access-5cxqg\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.276406 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.276239    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.377628 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.376705    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.377628 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.376789    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.377628 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.376839    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.377628 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.376876    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.377628 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.376911    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cxqg\" (UniqueName: \"kubernetes.io/projected/c0faca49-ff20-4d77-b312-b2c79111a29f-kube-api-access-5cxqg\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.377628 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.376975    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e80ca94a-bea1-469d-88b5-fb74e601de0c-tls-certs\") pod \"model-serving-api-54d89bd5fc-k6x85\" (UID: \"e80ca94a-bea1-469d-88b5-fb74e601de0c\") " pod="opendatahub/model-serving-api-54d89bd5fc-k6x85"
Aug 04 17:55:59.377628 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.377032    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.377628 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.377081    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0faca49-ff20-4d77-b312-b2c79111a29f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.377628 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.377537    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.380017 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.379988    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0faca49-ff20-4d77-b312-b2c79111a29f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.380320 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.380299    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.381098 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.381059    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.382049 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.382012    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.382303 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.382265    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e80ca94a-bea1-469d-88b5-fb74e601de0c-tls-certs\") pod \"model-serving-api-54d89bd5fc-k6x85\" (UID: \"e80ca94a-bea1-469d-88b5-fb74e601de0c\") " pod="opendatahub/model-serving-api-54d89bd5fc-k6x85"
Aug 04 17:55:59.385798 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.385776    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.386277 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.386251    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cxqg\" (UniqueName: \"kubernetes.io/projected/c0faca49-ff20-4d77-b312-b2c79111a29f-kube-api-access-5cxqg\") pod \"istiod-openshift-gateway-7b7995d5cd-dt9rt\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.404301 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.404276    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:55:59.554199 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.554159    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"]
Aug 04 17:55:59.557088 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:55:59.557054    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0faca49_ff20_4d77_b312_b2c79111a29f.slice/crio-26655fc5af0b81b92b6b483eadbee548b7661bcbf0f83e385b22031cb03bd3e8 WatchSource:0}: Error finding container 26655fc5af0b81b92b6b483eadbee548b7661bcbf0f83e385b22031cb03bd3e8: Status 404 returned error can't find the container with id 26655fc5af0b81b92b6b483eadbee548b7661bcbf0f83e385b22031cb03bd3e8
Aug 04 17:55:59.572360 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.572339    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-k6x85"
Aug 04 17:55:59.711205 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.711170    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-k6x85"]
Aug 04 17:55:59.715210 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:55:59.715174    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80ca94a_bea1_469d_88b5_fb74e601de0c.slice/crio-101dc17d7d3643bc773f80d5e8dbe6713e295230577cdba8c9d8e0e24a956c79 WatchSource:0}: Error finding container 101dc17d7d3643bc773f80d5e8dbe6713e295230577cdba8c9d8e0e24a956c79: Status 404 returned error can't find the container with id 101dc17d7d3643bc773f80d5e8dbe6713e295230577cdba8c9d8e0e24a956c79
Aug 04 17:55:59.799408 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.799363    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-k6x85" event={"ID":"e80ca94a-bea1-469d-88b5-fb74e601de0c","Type":"ContainerStarted","Data":"101dc17d7d3643bc773f80d5e8dbe6713e295230577cdba8c9d8e0e24a956c79"}
Aug 04 17:55:59.800950 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:55:59.800899    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt" event={"ID":"c0faca49-ff20-4d77-b312-b2c79111a29f","Type":"ContainerStarted","Data":"26655fc5af0b81b92b6b483eadbee548b7661bcbf0f83e385b22031cb03bd3e8"}
Aug 04 17:56:01.822210 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:01.822157    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2" event={"ID":"6fbcadd4-7b82-47fb-9eeb-87d54670157d","Type":"ContainerStarted","Data":"567727419a991d9e3fc0ade157b1b80aa16e7744b6ccd450a334814b1d15ae5b"}
Aug 04 17:56:01.841990 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:01.841928    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-grwv2" podStartSLOduration=1.845925996 podStartE2EDuration="4.84189286s" totalImagesPullingTime="2.995966864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:55:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:56:01.839195607 +0000 UTC m=+546.749085212" watchObservedRunningTime="2026-08-04 17:56:01.84189286 +0000 UTC m=+546.751782451"
Aug 04 17:56:03.410031 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:03.409996    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 17:56:03.410324 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:03.410062    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 17:56:03.835549 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:03.835503    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt" event={"ID":"c0faca49-ff20-4d77-b312-b2c79111a29f","Type":"ContainerStarted","Data":"c9d68f61006d9b248b67d68335d1cdc60d8622db967c134ecac1063c6640004a"}
Aug 04 17:56:03.835748 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:03.835576    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:56:03.837156 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:03.837133    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-k6x85" event={"ID":"e80ca94a-bea1-469d-88b5-fb74e601de0c","Type":"ContainerStarted","Data":"1fd2a6de4724ce97ddc6c32cb2a1fd953849a621a53c0dd6878838f2d66503e4"}
Aug 04 17:56:03.837296 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:03.837254    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-k6x85"
Aug 04 17:56:03.861639 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:03.861594    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt" podStartSLOduration=1.011535047 podStartE2EDuration="4.861578992s" totalImagesPullingTime="3.850043945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:56:03.859849635 +0000 UTC m=+548.769739243" watchObservedRunningTime="2026-08-04 17:56:03.861578992 +0000 UTC m=+548.771468579"
Aug 04 17:56:03.878704 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:03.878659    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-k6x85" podStartSLOduration=2.186208192 podStartE2EDuration="5.878647702s" totalImagesPullingTime="3.69243951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:55:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:56:03.877578948 +0000 UTC m=+548.787468537" watchObservedRunningTime="2026-08-04 17:56:03.878647702 +0000 UTC m=+548.788537289"
Aug 04 17:56:04.843857 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:04.843827    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:56:07.808821 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.808785    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk"]
Aug 04 17:56:07.812467 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.812445    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk"
Aug 04 17:56:07.816243 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.816223    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-frzpk\""
Aug 04 17:56:07.816324 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.816223    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Aug 04 17:56:07.820164 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.820143    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c"]
Aug 04 17:56:07.823645 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.823624    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk"]
Aug 04 17:56:07.823761 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.823719    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c"
Aug 04 17:56:07.826225 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.826201    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-g6t7l\""
Aug 04 17:56:07.826325 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.826214    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Aug 04 17:56:07.831768 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.831748    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c"]
Aug 04 17:56:07.857008 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.856978    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jfq7\" (UniqueName: \"kubernetes.io/projected/4b8dc637-4e77-4f3e-9194-771eb05bdae7-kube-api-access-8jfq7\") pod \"kserve-controller-manager-d6f4b65b8-9gdvk\" (UID: \"4b8dc637-4e77-4f3e-9194-771eb05bdae7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk"
Aug 04 17:56:07.857140 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.857037    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6lmr\" (UniqueName: \"kubernetes.io/projected/653c2e36-9ae7-4881-bdda-e13d02a7c77e-kube-api-access-j6lmr\") pod \"llmisvc-controller-manager-777c6bd7d5-zbh6c\" (UID: \"653c2e36-9ae7-4881-bdda-e13d02a7c77e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c"
Aug 04 17:56:07.857140 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.857104    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b8dc637-4e77-4f3e-9194-771eb05bdae7-cert\") pod \"kserve-controller-manager-d6f4b65b8-9gdvk\" (UID: \"4b8dc637-4e77-4f3e-9194-771eb05bdae7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk"
Aug 04 17:56:07.857231 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.857154    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/653c2e36-9ae7-4881-bdda-e13d02a7c77e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zbh6c\" (UID: \"653c2e36-9ae7-4881-bdda-e13d02a7c77e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c"
Aug 04 17:56:07.957780 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.957748    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b8dc637-4e77-4f3e-9194-771eb05bdae7-cert\") pod \"kserve-controller-manager-d6f4b65b8-9gdvk\" (UID: \"4b8dc637-4e77-4f3e-9194-771eb05bdae7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk"
Aug 04 17:56:07.957980 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.957789    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/653c2e36-9ae7-4881-bdda-e13d02a7c77e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zbh6c\" (UID: \"653c2e36-9ae7-4881-bdda-e13d02a7c77e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c"
Aug 04 17:56:07.957980 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:56:07.957901    2572 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Aug 04 17:56:07.957980 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:56:07.957905    2572 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Aug 04 17:56:07.957980 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.957968    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jfq7\" (UniqueName: \"kubernetes.io/projected/4b8dc637-4e77-4f3e-9194-771eb05bdae7-kube-api-access-8jfq7\") pod \"kserve-controller-manager-d6f4b65b8-9gdvk\" (UID: \"4b8dc637-4e77-4f3e-9194-771eb05bdae7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk"
Aug 04 17:56:07.958154 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:56:07.957986    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/653c2e36-9ae7-4881-bdda-e13d02a7c77e-cert podName:653c2e36-9ae7-4881-bdda-e13d02a7c77e nodeName:}" failed. No retries permitted until 2026-08-04 17:56:08.457966332 +0000 UTC m=+553.367855903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/653c2e36-9ae7-4881-bdda-e13d02a7c77e-cert") pod "llmisvc-controller-manager-777c6bd7d5-zbh6c" (UID: "653c2e36-9ae7-4881-bdda-e13d02a7c77e") : secret "llmisvc-webhook-server-cert" not found
Aug 04 17:56:07.958154 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:56:07.958008    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8dc637-4e77-4f3e-9194-771eb05bdae7-cert podName:4b8dc637-4e77-4f3e-9194-771eb05bdae7 nodeName:}" failed. No retries permitted until 2026-08-04 17:56:08.458002596 +0000 UTC m=+553.367892161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4b8dc637-4e77-4f3e-9194-771eb05bdae7-cert") pod "kserve-controller-manager-d6f4b65b8-9gdvk" (UID: "4b8dc637-4e77-4f3e-9194-771eb05bdae7") : secret "kserve-webhook-server-cert" not found
Aug 04 17:56:07.958154 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.958055    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6lmr\" (UniqueName: \"kubernetes.io/projected/653c2e36-9ae7-4881-bdda-e13d02a7c77e-kube-api-access-j6lmr\") pod \"llmisvc-controller-manager-777c6bd7d5-zbh6c\" (UID: \"653c2e36-9ae7-4881-bdda-e13d02a7c77e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c"
Aug 04 17:56:07.980089 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.980069    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6lmr\" (UniqueName: \"kubernetes.io/projected/653c2e36-9ae7-4881-bdda-e13d02a7c77e-kube-api-access-j6lmr\") pod \"llmisvc-controller-manager-777c6bd7d5-zbh6c\" (UID: \"653c2e36-9ae7-4881-bdda-e13d02a7c77e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c"
Aug 04 17:56:07.980204 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:07.980185    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jfq7\" (UniqueName: \"kubernetes.io/projected/4b8dc637-4e77-4f3e-9194-771eb05bdae7-kube-api-access-8jfq7\") pod \"kserve-controller-manager-d6f4b65b8-9gdvk\" (UID: \"4b8dc637-4e77-4f3e-9194-771eb05bdae7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk"
Aug 04 17:56:08.463549 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:08.463508    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b8dc637-4e77-4f3e-9194-771eb05bdae7-cert\") pod \"kserve-controller-manager-d6f4b65b8-9gdvk\" (UID: \"4b8dc637-4e77-4f3e-9194-771eb05bdae7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk"
Aug 04 17:56:08.463756 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:08.463572    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/653c2e36-9ae7-4881-bdda-e13d02a7c77e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zbh6c\" (UID: \"653c2e36-9ae7-4881-bdda-e13d02a7c77e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c"
Aug 04 17:56:08.463756 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:56:08.463661    2572 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Aug 04 17:56:08.463756 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:56:08.463726    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8dc637-4e77-4f3e-9194-771eb05bdae7-cert podName:4b8dc637-4e77-4f3e-9194-771eb05bdae7 nodeName:}" failed. No retries permitted until 2026-08-04 17:56:09.463709608 +0000 UTC m=+554.373599175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4b8dc637-4e77-4f3e-9194-771eb05bdae7-cert") pod "kserve-controller-manager-d6f4b65b8-9gdvk" (UID: "4b8dc637-4e77-4f3e-9194-771eb05bdae7") : secret "kserve-webhook-server-cert" not found
Aug 04 17:56:08.466033 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:08.466006    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/653c2e36-9ae7-4881-bdda-e13d02a7c77e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zbh6c\" (UID: \"653c2e36-9ae7-4881-bdda-e13d02a7c77e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c"
Aug 04 17:56:08.735339 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:08.735255    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c"
Aug 04 17:56:08.872385 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:08.872361    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c"]
Aug 04 17:56:08.874788 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:56:08.874759    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod653c2e36_9ae7_4881_bdda_e13d02a7c77e.slice/crio-7b4791fb628f27102c2cecc940365aaed4b35d2211943c435fc9dca52d49fb74 WatchSource:0}: Error finding container 7b4791fb628f27102c2cecc940365aaed4b35d2211943c435fc9dca52d49fb74: Status 404 returned error can't find the container with id 7b4791fb628f27102c2cecc940365aaed4b35d2211943c435fc9dca52d49fb74
Aug 04 17:56:08.923447 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:08.923417    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b546b58cd-p6wnc"]
Aug 04 17:56:08.927827 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:08.927809    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:08.945613 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:08.945586    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b546b58cd-p6wnc"]
Aug 04 17:56:08.967132 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:08.967110    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8e4f148-7c4a-421b-8091-e41bc99fa874-oauth-serving-cert\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:08.967239 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:08.967143    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8e4f148-7c4a-421b-8091-e41bc99fa874-console-oauth-config\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:08.967239 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:08.967175    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h58lw\" (UniqueName: \"kubernetes.io/projected/c8e4f148-7c4a-421b-8091-e41bc99fa874-kube-api-access-h58lw\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:08.967312 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:08.967244    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8e4f148-7c4a-421b-8091-e41bc99fa874-console-serving-cert\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:08.967312 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:08.967274    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8e4f148-7c4a-421b-8091-e41bc99fa874-console-config\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:08.967376 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:08.967352    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8e4f148-7c4a-421b-8091-e41bc99fa874-service-ca\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:08.967410 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:08.967376    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8e4f148-7c4a-421b-8091-e41bc99fa874-trusted-ca-bundle\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:09.068062 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.068018    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8e4f148-7c4a-421b-8091-e41bc99fa874-trusted-ca-bundle\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:09.069317 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.069233    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8e4f148-7c4a-421b-8091-e41bc99fa874-trusted-ca-bundle\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:09.069473 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.069355    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8e4f148-7c4a-421b-8091-e41bc99fa874-oauth-serving-cert\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:09.069473 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.069393    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8e4f148-7c4a-421b-8091-e41bc99fa874-console-oauth-config\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:09.069473 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.069424    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h58lw\" (UniqueName: \"kubernetes.io/projected/c8e4f148-7c4a-421b-8091-e41bc99fa874-kube-api-access-h58lw\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:09.069632 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.069473    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8e4f148-7c4a-421b-8091-e41bc99fa874-console-serving-cert\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:09.069632 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.069498    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8e4f148-7c4a-421b-8091-e41bc99fa874-console-config\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:09.069632 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.069594    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8e4f148-7c4a-421b-8091-e41bc99fa874-service-ca\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:09.070174 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.070138    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8e4f148-7c4a-421b-8091-e41bc99fa874-oauth-serving-cert\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:09.070357 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.070330    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8e4f148-7c4a-421b-8091-e41bc99fa874-service-ca\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:09.070718 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.070697    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8e4f148-7c4a-421b-8091-e41bc99fa874-console-config\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:09.072223 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.072202    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8e4f148-7c4a-421b-8091-e41bc99fa874-console-oauth-config\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:09.072418 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.072399    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8e4f148-7c4a-421b-8091-e41bc99fa874-console-serving-cert\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:09.080684 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.080661    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h58lw\" (UniqueName: \"kubernetes.io/projected/c8e4f148-7c4a-421b-8091-e41bc99fa874-kube-api-access-h58lw\") pod \"console-5b546b58cd-p6wnc\" (UID: \"c8e4f148-7c4a-421b-8091-e41bc99fa874\") " pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:09.237077 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.237046    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:09.369493 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.369469    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b546b58cd-p6wnc"]
Aug 04 17:56:09.371161 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:56:09.371130    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e4f148_7c4a_421b_8091_e41bc99fa874.slice/crio-b79132f00d0498e0f1a0ccf41226b9f55839a360685b7a6e32889ebcd277ff14 WatchSource:0}: Error finding container b79132f00d0498e0f1a0ccf41226b9f55839a360685b7a6e32889ebcd277ff14: Status 404 returned error can't find the container with id b79132f00d0498e0f1a0ccf41226b9f55839a360685b7a6e32889ebcd277ff14
Aug 04 17:56:09.472895 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.472853    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b8dc637-4e77-4f3e-9194-771eb05bdae7-cert\") pod \"kserve-controller-manager-d6f4b65b8-9gdvk\" (UID: \"4b8dc637-4e77-4f3e-9194-771eb05bdae7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk"
Aug 04 17:56:09.475197 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.475146    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b8dc637-4e77-4f3e-9194-771eb05bdae7-cert\") pod \"kserve-controller-manager-d6f4b65b8-9gdvk\" (UID: \"4b8dc637-4e77-4f3e-9194-771eb05bdae7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk"
Aug 04 17:56:09.623023 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.622935    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk"
Aug 04 17:56:09.869962 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.869910    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b546b58cd-p6wnc" event={"ID":"c8e4f148-7c4a-421b-8091-e41bc99fa874","Type":"ContainerStarted","Data":"feba044f45c72ff9e0646669206177d6b9261a34a35fec25d9dfb749342c0bfa"}
Aug 04 17:56:09.870144 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.869986    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b546b58cd-p6wnc" event={"ID":"c8e4f148-7c4a-421b-8091-e41bc99fa874","Type":"ContainerStarted","Data":"b79132f00d0498e0f1a0ccf41226b9f55839a360685b7a6e32889ebcd277ff14"}
Aug 04 17:56:09.871284 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.871254    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c" event={"ID":"653c2e36-9ae7-4881-bdda-e13d02a7c77e","Type":"ContainerStarted","Data":"7b4791fb628f27102c2cecc940365aaed4b35d2211943c435fc9dca52d49fb74"}
Aug 04 17:56:09.911982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:09.911860    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b546b58cd-p6wnc" podStartSLOduration=1.911839276 podStartE2EDuration="1.911839276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:56:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:56:09.910410309 +0000 UTC m=+554.820299930" watchObservedRunningTime="2026-08-04 17:56:09.911839276 +0000 UTC m=+554.821728864"
Aug 04 17:56:10.280661 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:10.280629    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk"]
Aug 04 17:56:10.284335 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:56:10.284305    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b8dc637_4e77_4f3e_9194_771eb05bdae7.slice/crio-e9b59624affd4cbb17a57500937a40be5d9e23ab685da6b73db99be60abb98c6 WatchSource:0}: Error finding container e9b59624affd4cbb17a57500937a40be5d9e23ab685da6b73db99be60abb98c6: Status 404 returned error can't find the container with id e9b59624affd4cbb17a57500937a40be5d9e23ab685da6b73db99be60abb98c6
Aug 04 17:56:10.877259 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:10.877224    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk" event={"ID":"4b8dc637-4e77-4f3e-9194-771eb05bdae7","Type":"ContainerStarted","Data":"e9b59624affd4cbb17a57500937a40be5d9e23ab685da6b73db99be60abb98c6"}
Aug 04 17:56:11.250196 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:11.250109    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"]
Aug 04 17:56:11.250684 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:11.250335    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt" podUID="c0faca49-ff20-4d77-b312-b2c79111a29f" containerName="discovery" containerID="cri-o://c9d68f61006d9b248b67d68335d1cdc60d8622db967c134ecac1063c6640004a" gracePeriod=30
Aug 04 17:56:11.883485 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:11.883452    2572 generic.go:356] "Generic (PLEG): container finished" podID="c0faca49-ff20-4d77-b312-b2c79111a29f" containerID="c9d68f61006d9b248b67d68335d1cdc60d8622db967c134ecac1063c6640004a" exitCode=0
Aug 04 17:56:11.883641 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:11.883518    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt" event={"ID":"c0faca49-ff20-4d77-b312-b2c79111a29f","Type":"ContainerDied","Data":"c9d68f61006d9b248b67d68335d1cdc60d8622db967c134ecac1063c6640004a"}
Aug 04 17:56:12.023218 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.023179    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:56:12.097255 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.097182    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0faca49-ff20-4d77-b312-b2c79111a29f-local-certs\") pod \"c0faca49-ff20-4d77-b312-b2c79111a29f\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") "
Aug 04 17:56:12.097255 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.097250    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-cacerts\") pod \"c0faca49-ff20-4d77-b312-b2c79111a29f\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") "
Aug 04 17:56:12.097480 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.097276    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-csr-dns-cert\") pod \"c0faca49-ff20-4d77-b312-b2c79111a29f\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") "
Aug 04 17:56:12.097480 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.097325    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-kubeconfig\") pod \"c0faca49-ff20-4d77-b312-b2c79111a29f\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") "
Aug 04 17:56:12.097480 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.097357    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-token\") pod \"c0faca49-ff20-4d77-b312-b2c79111a29f\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") "
Aug 04 17:56:12.097480 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.097381    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cxqg\" (UniqueName: \"kubernetes.io/projected/c0faca49-ff20-4d77-b312-b2c79111a29f-kube-api-access-5cxqg\") pod \"c0faca49-ff20-4d77-b312-b2c79111a29f\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") "
Aug 04 17:56:12.097480 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.097417    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-csr-ca-configmap\") pod \"c0faca49-ff20-4d77-b312-b2c79111a29f\" (UID: \"c0faca49-ff20-4d77-b312-b2c79111a29f\") "
Aug 04 17:56:12.098094 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.098052    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c0faca49-ff20-4d77-b312-b2c79111a29f" (UID: "c0faca49-ff20-4d77-b312-b2c79111a29f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:56:12.100321 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.100275    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c0faca49-ff20-4d77-b312-b2c79111a29f" (UID: "c0faca49-ff20-4d77-b312-b2c79111a29f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:56:12.100321 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.100276    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0faca49-ff20-4d77-b312-b2c79111a29f" (UID: "c0faca49-ff20-4d77-b312-b2c79111a29f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:56:12.100321 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.100294    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0faca49-ff20-4d77-b312-b2c79111a29f-kube-api-access-5cxqg" (OuterVolumeSpecName: "kube-api-access-5cxqg") pod "c0faca49-ff20-4d77-b312-b2c79111a29f" (UID: "c0faca49-ff20-4d77-b312-b2c79111a29f"). InnerVolumeSpecName "kube-api-access-5cxqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:56:12.100541 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.100434    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0faca49-ff20-4d77-b312-b2c79111a29f-local-certs" (OuterVolumeSpecName: "local-certs") pod "c0faca49-ff20-4d77-b312-b2c79111a29f" (UID: "c0faca49-ff20-4d77-b312-b2c79111a29f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:56:12.100541 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.100470    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-cacerts" (OuterVolumeSpecName: "cacerts") pod "c0faca49-ff20-4d77-b312-b2c79111a29f" (UID: "c0faca49-ff20-4d77-b312-b2c79111a29f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:56:12.100732 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.100703    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c0faca49-ff20-4d77-b312-b2c79111a29f" (UID: "c0faca49-ff20-4d77-b312-b2c79111a29f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:56:12.199050 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.199016    2572 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0faca49-ff20-4d77-b312-b2c79111a29f-local-certs\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:56:12.199050 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.199050    2572 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-cacerts\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:56:12.199255 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.199065    2572 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-csr-dns-cert\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:56:12.199255 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.199080    2572 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-kubeconfig\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:56:12.199255 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.199091    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-token\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:56:12.199255 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.199103    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cxqg\" (UniqueName: \"kubernetes.io/projected/c0faca49-ff20-4d77-b312-b2c79111a29f-kube-api-access-5cxqg\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:56:12.199255 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.199118    2572 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0faca49-ff20-4d77-b312-b2c79111a29f-istio-csr-ca-configmap\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:56:12.889646 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.889613    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk" event={"ID":"4b8dc637-4e77-4f3e-9194-771eb05bdae7","Type":"ContainerStarted","Data":"54c329819e246efdf8ef128ee8184e134688f734ee759659241cb38af18ff5a8"}
Aug 04 17:56:12.890167 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.889730    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk"
Aug 04 17:56:12.890940 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.890907    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt" event={"ID":"c0faca49-ff20-4d77-b312-b2c79111a29f","Type":"ContainerDied","Data":"26655fc5af0b81b92b6b483eadbee548b7661bcbf0f83e385b22031cb03bd3e8"}
Aug 04 17:56:12.891039 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.890947    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"
Aug 04 17:56:12.891039 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.890969    2572 scope.go:117] "RemoveContainer" containerID="c9d68f61006d9b248b67d68335d1cdc60d8622db967c134ecac1063c6640004a"
Aug 04 17:56:12.892500 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.892474    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c" event={"ID":"653c2e36-9ae7-4881-bdda-e13d02a7c77e","Type":"ContainerStarted","Data":"6e5111121dbb7722fdb90805016e83c0524dccc36686ad082fb184aeb15d6b5b"}
Aug 04 17:56:12.892580 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.892536    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c"
Aug 04 17:56:12.909007 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.908967    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk" podStartSLOduration=3.531262548 podStartE2EDuration="5.908952304s" totalImagesPullingTime="2.377689756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:56:12.906544007 +0000 UTC m=+557.816433595" watchObservedRunningTime="2026-08-04 17:56:12.908952304 +0000 UTC m=+557.818841891"
Aug 04 17:56:12.920914 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.920891    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"]
Aug 04 17:56:12.924972 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.924947    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dt9rt"]
Aug 04 17:56:12.941644 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:12.941606    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c" podStartSLOduration=2.175997406 podStartE2EDuration="5.941592911s" totalImagesPullingTime="3.765595505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:56:12.941146558 +0000 UTC m=+557.851036165" watchObservedRunningTime="2026-08-04 17:56:12.941592911 +0000 UTC m=+557.851482509"
Aug 04 17:56:13.598370 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:13.598337    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0faca49-ff20-4d77-b312-b2c79111a29f" path="/var/lib/kubelet/pods/c0faca49-ff20-4d77-b312-b2c79111a29f/volumes"
Aug 04 17:56:14.846244 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:14.846214    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-k6x85"
Aug 04 17:56:19.237469 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:19.237430    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:19.237873 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:19.237489    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:19.242579 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:19.242556    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:19.931536 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:19.931504    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b546b58cd-p6wnc"
Aug 04 17:56:19.978037 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:19.977993    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64bcc54cf-6gfh4"]
Aug 04 17:56:43.900053 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:43.900022    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zbh6c"
Aug 04 17:56:43.903030 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:43.903005    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gdvk"
Aug 04 17:56:45.003712 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.003673    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64bcc54cf-6gfh4" podUID="b0dfd3e1-0b63-4ce6-9926-86ea16983e12" containerName="console" containerID="cri-o://532cf851174e4b4a1d89f204e940c35b913274b26d213ec58961888ffd8f3513" gracePeriod=15
Aug 04 17:56:45.252825 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.252802    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:56:45.380270 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.380231    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-service-ca\") pod \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") "
Aug 04 17:56:45.380270 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.380277    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-oauth-serving-cert\") pod \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") "
Aug 04 17:56:45.380480 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.380304    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-oauth-config\") pod \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") "
Aug 04 17:56:45.380480 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.380340    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-trusted-ca-bundle\") pod \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") "
Aug 04 17:56:45.380480 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.380384    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66ppc\" (UniqueName: \"kubernetes.io/projected/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-kube-api-access-66ppc\") pod \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") "
Aug 04 17:56:45.380480 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.380473    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-config\") pod \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") "
Aug 04 17:56:45.380674 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.380515    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-serving-cert\") pod \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\" (UID: \"b0dfd3e1-0b63-4ce6-9926-86ea16983e12\") "
Aug 04 17:56:45.380740 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.380718    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b0dfd3e1-0b63-4ce6-9926-86ea16983e12" (UID: "b0dfd3e1-0b63-4ce6-9926-86ea16983e12"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:56:45.380801 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.380757    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-service-ca" (OuterVolumeSpecName: "service-ca") pod "b0dfd3e1-0b63-4ce6-9926-86ea16983e12" (UID: "b0dfd3e1-0b63-4ce6-9926-86ea16983e12"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:56:45.380909 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.380880    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b0dfd3e1-0b63-4ce6-9926-86ea16983e12" (UID: "b0dfd3e1-0b63-4ce6-9926-86ea16983e12"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:56:45.380909 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.380903    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:56:45.381047 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.380909    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-config" (OuterVolumeSpecName: "console-config") pod "b0dfd3e1-0b63-4ce6-9926-86ea16983e12" (UID: "b0dfd3e1-0b63-4ce6-9926-86ea16983e12"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:56:45.381047 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.380949    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-oauth-serving-cert\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:56:45.382685 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.382660    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b0dfd3e1-0b63-4ce6-9926-86ea16983e12" (UID: "b0dfd3e1-0b63-4ce6-9926-86ea16983e12"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:56:45.382781 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.382701    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b0dfd3e1-0b63-4ce6-9926-86ea16983e12" (UID: "b0dfd3e1-0b63-4ce6-9926-86ea16983e12"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:56:45.382819 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.382771    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-kube-api-access-66ppc" (OuterVolumeSpecName: "kube-api-access-66ppc") pod "b0dfd3e1-0b63-4ce6-9926-86ea16983e12" (UID: "b0dfd3e1-0b63-4ce6-9926-86ea16983e12"). InnerVolumeSpecName "kube-api-access-66ppc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:56:45.482177 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.482129    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-serving-cert\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:56:45.482177 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.482172    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-oauth-config\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:56:45.482177 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.482184    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-trusted-ca-bundle\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:56:45.482177 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.482200    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66ppc\" (UniqueName: \"kubernetes.io/projected/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-kube-api-access-66ppc\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:56:45.482455 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:45.482211    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0dfd3e1-0b63-4ce6-9926-86ea16983e12-console-config\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:56:46.056248 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:46.056209    2572 generic.go:356] "Generic (PLEG): container finished" podID="b0dfd3e1-0b63-4ce6-9926-86ea16983e12" containerID="532cf851174e4b4a1d89f204e940c35b913274b26d213ec58961888ffd8f3513" exitCode=0
Aug 04 17:56:46.056726 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:46.056261    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64bcc54cf-6gfh4"
Aug 04 17:56:46.056726 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:46.056290    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64bcc54cf-6gfh4" event={"ID":"b0dfd3e1-0b63-4ce6-9926-86ea16983e12","Type":"ContainerDied","Data":"532cf851174e4b4a1d89f204e940c35b913274b26d213ec58961888ffd8f3513"}
Aug 04 17:56:46.056726 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:46.056340    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64bcc54cf-6gfh4" event={"ID":"b0dfd3e1-0b63-4ce6-9926-86ea16983e12","Type":"ContainerDied","Data":"ed71ae316d7db2f89f9b29a831a1948cac2f2e906db7bad70da45f300917c14f"}
Aug 04 17:56:46.056726 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:46.056362    2572 scope.go:117] "RemoveContainer" containerID="532cf851174e4b4a1d89f204e940c35b913274b26d213ec58961888ffd8f3513"
Aug 04 17:56:46.064928 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:46.064899    2572 scope.go:117] "RemoveContainer" containerID="532cf851174e4b4a1d89f204e940c35b913274b26d213ec58961888ffd8f3513"
Aug 04 17:56:46.065192 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:56:46.065174    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"532cf851174e4b4a1d89f204e940c35b913274b26d213ec58961888ffd8f3513\": container with ID starting with 532cf851174e4b4a1d89f204e940c35b913274b26d213ec58961888ffd8f3513 not found: ID does not exist" containerID="532cf851174e4b4a1d89f204e940c35b913274b26d213ec58961888ffd8f3513"
Aug 04 17:56:46.065245 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:46.065203    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"532cf851174e4b4a1d89f204e940c35b913274b26d213ec58961888ffd8f3513"} err="failed to get container status \"532cf851174e4b4a1d89f204e940c35b913274b26d213ec58961888ffd8f3513\": rpc error: code = NotFound desc = could not find container \"532cf851174e4b4a1d89f204e940c35b913274b26d213ec58961888ffd8f3513\": container with ID starting with 532cf851174e4b4a1d89f204e940c35b913274b26d213ec58961888ffd8f3513 not found: ID does not exist"
Aug 04 17:56:46.072174 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:46.072151    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64bcc54cf-6gfh4"]
Aug 04 17:56:46.075244 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:46.075221    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64bcc54cf-6gfh4"]
Aug 04 17:56:47.598238 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:47.598205    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0dfd3e1-0b63-4ce6-9926-86ea16983e12" path="/var/lib/kubelet/pods/b0dfd3e1-0b63-4ce6-9926-86ea16983e12/volumes"
Aug 04 17:56:55.490537 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:55.490510    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 17:56:55.492364 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:56:55.492338    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 17:57:02.610321 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.610280    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v"]
Aug 04 17:57:02.612839 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.610670    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0faca49-ff20-4d77-b312-b2c79111a29f" containerName="discovery"
Aug 04 17:57:02.612839 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.610681    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0faca49-ff20-4d77-b312-b2c79111a29f" containerName="discovery"
Aug 04 17:57:02.612839 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.610698    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0dfd3e1-0b63-4ce6-9926-86ea16983e12" containerName="console"
Aug 04 17:57:02.612839 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.610703    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0dfd3e1-0b63-4ce6-9926-86ea16983e12" containerName="console"
Aug 04 17:57:02.612839 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.610761    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0faca49-ff20-4d77-b312-b2c79111a29f" containerName="discovery"
Aug 04 17:57:02.612839 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.610769    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0dfd3e1-0b63-4ce6-9926-86ea16983e12" containerName="console"
Aug 04 17:57:02.613953 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.613939    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v"
Aug 04 17:57:02.616317 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.616294    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 17:57:02.617148 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.617130    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 17:57:02.617215 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.617179    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2pdsf\""
Aug 04 17:57:02.622575 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.622555    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v"]
Aug 04 17:57:02.707246 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.707211    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k"]
Aug 04 17:57:02.710971 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.710954    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k"
Aug 04 17:57:02.718032 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.717988    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k"]
Aug 04 17:57:02.737408 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.737382    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3008b79-1828-47a9-bcd4-ed723d813600-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v\" (UID: \"d3008b79-1828-47a9-bcd4-ed723d813600\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v"
Aug 04 17:57:02.737516 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.737419    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xttjv\" (UniqueName: \"kubernetes.io/projected/d3008b79-1828-47a9-bcd4-ed723d813600-kube-api-access-xttjv\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v\" (UID: \"d3008b79-1828-47a9-bcd4-ed723d813600\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v"
Aug 04 17:57:02.737516 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.737500    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3008b79-1828-47a9-bcd4-ed723d813600-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v\" (UID: \"d3008b79-1828-47a9-bcd4-ed723d813600\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v"
Aug 04 17:57:02.809386 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.809355    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg"]
Aug 04 17:57:02.812851 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.812836    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg"
Aug 04 17:57:02.820803 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.820779    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg"]
Aug 04 17:57:02.838780 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.838756    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3008b79-1828-47a9-bcd4-ed723d813600-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v\" (UID: \"d3008b79-1828-47a9-bcd4-ed723d813600\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v"
Aug 04 17:57:02.838904 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.838792    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzfdk\" (UniqueName: \"kubernetes.io/projected/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-kube-api-access-fzfdk\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k\" (UID: \"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k"
Aug 04 17:57:02.838904 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.838840    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k\" (UID: \"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k"
Aug 04 17:57:02.838904 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.838869    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3008b79-1828-47a9-bcd4-ed723d813600-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v\" (UID: \"d3008b79-1828-47a9-bcd4-ed723d813600\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v"
Aug 04 17:57:02.838904 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.838899    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xttjv\" (UniqueName: \"kubernetes.io/projected/d3008b79-1828-47a9-bcd4-ed723d813600-kube-api-access-xttjv\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v\" (UID: \"d3008b79-1828-47a9-bcd4-ed723d813600\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v"
Aug 04 17:57:02.839060 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.838955    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k\" (UID: \"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k"
Aug 04 17:57:02.839156 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.839138    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3008b79-1828-47a9-bcd4-ed723d813600-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v\" (UID: \"d3008b79-1828-47a9-bcd4-ed723d813600\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v"
Aug 04 17:57:02.839193 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.839168    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3008b79-1828-47a9-bcd4-ed723d813600-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v\" (UID: \"d3008b79-1828-47a9-bcd4-ed723d813600\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v"
Aug 04 17:57:02.846263 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.846236    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xttjv\" (UniqueName: \"kubernetes.io/projected/d3008b79-1828-47a9-bcd4-ed723d813600-kube-api-access-xttjv\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v\" (UID: \"d3008b79-1828-47a9-bcd4-ed723d813600\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v"
Aug 04 17:57:02.908789 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.908724    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds"]
Aug 04 17:57:02.912558 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.912542    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds"
Aug 04 17:57:02.921432 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.921409    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds"]
Aug 04 17:57:02.923590 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.923571    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v"
Aug 04 17:57:02.939576 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.939554    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k\" (UID: \"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k"
Aug 04 17:57:02.939692 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.939599    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0570e6d8-49e5-4512-95c9-2788acb36497-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg\" (UID: \"0570e6d8-49e5-4512-95c9-2788acb36497\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg"
Aug 04 17:57:02.939692 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.939656    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k\" (UID: \"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k"
Aug 04 17:57:02.939815 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.939694    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0570e6d8-49e5-4512-95c9-2788acb36497-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg\" (UID: \"0570e6d8-49e5-4512-95c9-2788acb36497\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg"
Aug 04 17:57:02.939815 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.939727    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp44z\" (UniqueName: \"kubernetes.io/projected/0570e6d8-49e5-4512-95c9-2788acb36497-kube-api-access-pp44z\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg\" (UID: \"0570e6d8-49e5-4512-95c9-2788acb36497\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg"
Aug 04 17:57:02.939815 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.939769    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzfdk\" (UniqueName: \"kubernetes.io/projected/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-kube-api-access-fzfdk\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k\" (UID: \"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k"
Aug 04 17:57:02.940004 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.939982    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k\" (UID: \"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k"
Aug 04 17:57:02.940066 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.940011    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k\" (UID: \"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k"
Aug 04 17:57:02.947390 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:02.947369    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzfdk\" (UniqueName: \"kubernetes.io/projected/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-kube-api-access-fzfdk\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k\" (UID: \"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k"
Aug 04 17:57:03.021340 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.021299    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k"
Aug 04 17:57:03.040641 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.040613    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/296858fe-218a-4f38-99cf-f795c87c7e96-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds\" (UID: \"296858fe-218a-4f38-99cf-f795c87c7e96\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds"
Aug 04 17:57:03.040702 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.040670    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfnbp\" (UniqueName: \"kubernetes.io/projected/296858fe-218a-4f38-99cf-f795c87c7e96-kube-api-access-wfnbp\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds\" (UID: \"296858fe-218a-4f38-99cf-f795c87c7e96\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds"
Aug 04 17:57:03.040788 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.040771    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0570e6d8-49e5-4512-95c9-2788acb36497-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg\" (UID: \"0570e6d8-49e5-4512-95c9-2788acb36497\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg"
Aug 04 17:57:03.040865 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.040850    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/296858fe-218a-4f38-99cf-f795c87c7e96-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds\" (UID: \"296858fe-218a-4f38-99cf-f795c87c7e96\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds"
Aug 04 17:57:03.040900 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.040886    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0570e6d8-49e5-4512-95c9-2788acb36497-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg\" (UID: \"0570e6d8-49e5-4512-95c9-2788acb36497\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg"
Aug 04 17:57:03.040973 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.040938    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp44z\" (UniqueName: \"kubernetes.io/projected/0570e6d8-49e5-4512-95c9-2788acb36497-kube-api-access-pp44z\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg\" (UID: \"0570e6d8-49e5-4512-95c9-2788acb36497\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg"
Aug 04 17:57:03.041219 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.041187    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0570e6d8-49e5-4512-95c9-2788acb36497-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg\" (UID: \"0570e6d8-49e5-4512-95c9-2788acb36497\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg"
Aug 04 17:57:03.041331 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.041256    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0570e6d8-49e5-4512-95c9-2788acb36497-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg\" (UID: \"0570e6d8-49e5-4512-95c9-2788acb36497\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg"
Aug 04 17:57:03.048184 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.048161    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp44z\" (UniqueName: \"kubernetes.io/projected/0570e6d8-49e5-4512-95c9-2788acb36497-kube-api-access-pp44z\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg\" (UID: \"0570e6d8-49e5-4512-95c9-2788acb36497\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg"
Aug 04 17:57:03.056866 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.056831    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v"]
Aug 04 17:57:03.057196 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:57:03.057156    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3008b79_1828_47a9_bcd4_ed723d813600.slice/crio-89efb56f1a755bf6161ff4358d26d4e48c6cc33646c9483b5e0f1e705a726da6 WatchSource:0}: Error finding container 89efb56f1a755bf6161ff4358d26d4e48c6cc33646c9483b5e0f1e705a726da6: Status 404 returned error can't find the container with id 89efb56f1a755bf6161ff4358d26d4e48c6cc33646c9483b5e0f1e705a726da6
Aug 04 17:57:03.122813 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.122787    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg"
Aug 04 17:57:03.141546 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.141507    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/296858fe-218a-4f38-99cf-f795c87c7e96-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds\" (UID: \"296858fe-218a-4f38-99cf-f795c87c7e96\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds"
Aug 04 17:57:03.141673 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.141578    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/296858fe-218a-4f38-99cf-f795c87c7e96-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds\" (UID: \"296858fe-218a-4f38-99cf-f795c87c7e96\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds"
Aug 04 17:57:03.141673 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.141613    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfnbp\" (UniqueName: \"kubernetes.io/projected/296858fe-218a-4f38-99cf-f795c87c7e96-kube-api-access-wfnbp\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds\" (UID: \"296858fe-218a-4f38-99cf-f795c87c7e96\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds"
Aug 04 17:57:03.142020 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.141990    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/296858fe-218a-4f38-99cf-f795c87c7e96-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds\" (UID: \"296858fe-218a-4f38-99cf-f795c87c7e96\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds"
Aug 04 17:57:03.142224 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.142204    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/296858fe-218a-4f38-99cf-f795c87c7e96-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds\" (UID: \"296858fe-218a-4f38-99cf-f795c87c7e96\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds"
Aug 04 17:57:03.158592 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.158545    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v" event={"ID":"d3008b79-1828-47a9-bcd4-ed723d813600","Type":"ContainerStarted","Data":"04191a17ad949d7eda7988ee431401231e3db11b70204201b22f668dbabe9f1c"}
Aug 04 17:57:03.158756 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.158677    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v" event={"ID":"d3008b79-1828-47a9-bcd4-ed723d813600","Type":"ContainerStarted","Data":"89efb56f1a755bf6161ff4358d26d4e48c6cc33646c9483b5e0f1e705a726da6"}
Aug 04 17:57:03.159973 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.159832    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfnbp\" (UniqueName: \"kubernetes.io/projected/296858fe-218a-4f38-99cf-f795c87c7e96-kube-api-access-wfnbp\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds\" (UID: \"296858fe-218a-4f38-99cf-f795c87c7e96\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds"
Aug 04 17:57:03.175743 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.175716    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k"]
Aug 04 17:57:03.203252 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:57:03.203222    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c6a8bd_796e_4f1c_9c3a_274cc3053f3f.slice/crio-a813930c374ca9b6b5dbf1f7fc238ebca81bb9280a4181b715ad52c9164535c7 WatchSource:0}: Error finding container a813930c374ca9b6b5dbf1f7fc238ebca81bb9280a4181b715ad52c9164535c7: Status 404 returned error can't find the container with id a813930c374ca9b6b5dbf1f7fc238ebca81bb9280a4181b715ad52c9164535c7
Aug 04 17:57:03.223257 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.223231    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds"
Aug 04 17:57:03.272661 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.272623    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg"]
Aug 04 17:57:03.276234 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:57:03.276196    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0570e6d8_49e5_4512_95c9_2788acb36497.slice/crio-71e9b373b35c7618f8bc559399c8883092b09fce8b35ef2b573ba9f1559ab036 WatchSource:0}: Error finding container 71e9b373b35c7618f8bc559399c8883092b09fce8b35ef2b573ba9f1559ab036: Status 404 returned error can't find the container with id 71e9b373b35c7618f8bc559399c8883092b09fce8b35ef2b573ba9f1559ab036
Aug 04 17:57:03.370893 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:03.370866    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds"]
Aug 04 17:57:03.394815 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:57:03.394784    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod296858fe_218a_4f38_99cf_f795c87c7e96.slice/crio-ccdd3169dc1c3d404364a7eb74efaf94838f7e9f46ae3c331c57bf26e9f7ce83 WatchSource:0}: Error finding container ccdd3169dc1c3d404364a7eb74efaf94838f7e9f46ae3c331c57bf26e9f7ce83: Status 404 returned error can't find the container with id ccdd3169dc1c3d404364a7eb74efaf94838f7e9f46ae3c331c57bf26e9f7ce83
Aug 04 17:57:04.165391 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:04.165356    2572 generic.go:356] "Generic (PLEG): container finished" podID="296858fe-218a-4f38-99cf-f795c87c7e96" containerID="7b34b785cd99b2c366df96eb4710776df33b20ec8e89f0dcb077678adfa991b4" exitCode=0
Aug 04 17:57:04.165862 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:04.165447    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds" event={"ID":"296858fe-218a-4f38-99cf-f795c87c7e96","Type":"ContainerDied","Data":"7b34b785cd99b2c366df96eb4710776df33b20ec8e89f0dcb077678adfa991b4"}
Aug 04 17:57:04.165862 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:04.165511    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds" event={"ID":"296858fe-218a-4f38-99cf-f795c87c7e96","Type":"ContainerStarted","Data":"ccdd3169dc1c3d404364a7eb74efaf94838f7e9f46ae3c331c57bf26e9f7ce83"}
Aug 04 17:57:04.167071 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:04.166985    2572 generic.go:356] "Generic (PLEG): container finished" podID="99c6a8bd-796e-4f1c-9c3a-274cc3053f3f" containerID="313a6b0ad9550d3211358fe6a9144f6965116f55ee4d3f086df948f2da056f8b" exitCode=0
Aug 04 17:57:04.167071 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:04.167019    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k" event={"ID":"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f","Type":"ContainerDied","Data":"313a6b0ad9550d3211358fe6a9144f6965116f55ee4d3f086df948f2da056f8b"}
Aug 04 17:57:04.167178 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:04.167083    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k" event={"ID":"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f","Type":"ContainerStarted","Data":"a813930c374ca9b6b5dbf1f7fc238ebca81bb9280a4181b715ad52c9164535c7"}
Aug 04 17:57:04.168600 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:04.168576    2572 generic.go:356] "Generic (PLEG): container finished" podID="0570e6d8-49e5-4512-95c9-2788acb36497" containerID="f41cd79c918172d5f33f1c7522be3a597593dac3eb18bcb0c23ebcecbf97e119" exitCode=0
Aug 04 17:57:04.168711 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:04.168606    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg" event={"ID":"0570e6d8-49e5-4512-95c9-2788acb36497","Type":"ContainerDied","Data":"f41cd79c918172d5f33f1c7522be3a597593dac3eb18bcb0c23ebcecbf97e119"}
Aug 04 17:57:04.168711 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:04.168651    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg" event={"ID":"0570e6d8-49e5-4512-95c9-2788acb36497","Type":"ContainerStarted","Data":"71e9b373b35c7618f8bc559399c8883092b09fce8b35ef2b573ba9f1559ab036"}
Aug 04 17:57:04.170458 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:04.170435    2572 generic.go:356] "Generic (PLEG): container finished" podID="d3008b79-1828-47a9-bcd4-ed723d813600" containerID="04191a17ad949d7eda7988ee431401231e3db11b70204201b22f668dbabe9f1c" exitCode=0
Aug 04 17:57:04.170562 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:04.170495    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v" event={"ID":"d3008b79-1828-47a9-bcd4-ed723d813600","Type":"ContainerDied","Data":"04191a17ad949d7eda7988ee431401231e3db11b70204201b22f668dbabe9f1c"}
Aug 04 17:57:05.177400 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:05.177373    2572 generic.go:356] "Generic (PLEG): container finished" podID="296858fe-218a-4f38-99cf-f795c87c7e96" containerID="d861aa233e38e927ea832ed0a8222f94df9fe6e8727cc89046a4d3d3d992e0f8" exitCode=0
Aug 04 17:57:05.177756 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:05.177453    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds" event={"ID":"296858fe-218a-4f38-99cf-f795c87c7e96","Type":"ContainerDied","Data":"d861aa233e38e927ea832ed0a8222f94df9fe6e8727cc89046a4d3d3d992e0f8"}
Aug 04 17:57:05.179437 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:05.179417    2572 generic.go:356] "Generic (PLEG): container finished" podID="d3008b79-1828-47a9-bcd4-ed723d813600" containerID="fa4988b6457c29136276b85e2cb0e74bd29967a608da8db56432a389076548d9" exitCode=0
Aug 04 17:57:05.179527 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:05.179444    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v" event={"ID":"d3008b79-1828-47a9-bcd4-ed723d813600","Type":"ContainerDied","Data":"fa4988b6457c29136276b85e2cb0e74bd29967a608da8db56432a389076548d9"}
Aug 04 17:57:06.186614 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:06.186537    2572 generic.go:356] "Generic (PLEG): container finished" podID="296858fe-218a-4f38-99cf-f795c87c7e96" containerID="0966ece50f65f837cc262ddbee928b96a7f2941ec9378b54aca3219440b3a367" exitCode=0
Aug 04 17:57:06.187121 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:06.186613    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds" event={"ID":"296858fe-218a-4f38-99cf-f795c87c7e96","Type":"ContainerDied","Data":"0966ece50f65f837cc262ddbee928b96a7f2941ec9378b54aca3219440b3a367"}
Aug 04 17:57:06.188294 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:06.188267    2572 generic.go:356] "Generic (PLEG): container finished" podID="99c6a8bd-796e-4f1c-9c3a-274cc3053f3f" containerID="f9ad9051bf4d0ba1f21b5fcfbab100e0813c8c06eade331220b84303795b5a6d" exitCode=0
Aug 04 17:57:06.188396 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:06.188340    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k" event={"ID":"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f","Type":"ContainerDied","Data":"f9ad9051bf4d0ba1f21b5fcfbab100e0813c8c06eade331220b84303795b5a6d"}
Aug 04 17:57:06.190522 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:06.190499    2572 generic.go:356] "Generic (PLEG): container finished" podID="d3008b79-1828-47a9-bcd4-ed723d813600" containerID="774b7200b184e4b0c483f582a834134365b38da7d0a618a536f839f767a0b08d" exitCode=0
Aug 04 17:57:06.190607 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:06.190527    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v" event={"ID":"d3008b79-1828-47a9-bcd4-ed723d813600","Type":"ContainerDied","Data":"774b7200b184e4b0c483f582a834134365b38da7d0a618a536f839f767a0b08d"}
Aug 04 17:57:07.199040 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.199004    2572 generic.go:356] "Generic (PLEG): container finished" podID="99c6a8bd-796e-4f1c-9c3a-274cc3053f3f" containerID="64846bc16de00f951cd065534d5bba65c676818563ef0345f095d2d47318234e" exitCode=0
Aug 04 17:57:07.199442 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.199094    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k" event={"ID":"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f","Type":"ContainerDied","Data":"64846bc16de00f951cd065534d5bba65c676818563ef0345f095d2d47318234e"}
Aug 04 17:57:07.200643 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.200622    2572 generic.go:356] "Generic (PLEG): container finished" podID="0570e6d8-49e5-4512-95c9-2788acb36497" containerID="44c627781321144e16387dfbfead61b040cca198faf41a0a35a6652960a9adfd" exitCode=0
Aug 04 17:57:07.200768 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.200704    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg" event={"ID":"0570e6d8-49e5-4512-95c9-2788acb36497","Type":"ContainerDied","Data":"44c627781321144e16387dfbfead61b040cca198faf41a0a35a6652960a9adfd"}
Aug 04 17:57:07.362154 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.362131    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v"
Aug 04 17:57:07.433595 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.433570    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds"
Aug 04 17:57:07.481490 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.481436    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/296858fe-218a-4f38-99cf-f795c87c7e96-bundle\") pod \"296858fe-218a-4f38-99cf-f795c87c7e96\" (UID: \"296858fe-218a-4f38-99cf-f795c87c7e96\") "
Aug 04 17:57:07.481490 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.481479    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/296858fe-218a-4f38-99cf-f795c87c7e96-util\") pod \"296858fe-218a-4f38-99cf-f795c87c7e96\" (UID: \"296858fe-218a-4f38-99cf-f795c87c7e96\") "
Aug 04 17:57:07.481637 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.481536    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3008b79-1828-47a9-bcd4-ed723d813600-util\") pod \"d3008b79-1828-47a9-bcd4-ed723d813600\" (UID: \"d3008b79-1828-47a9-bcd4-ed723d813600\") "
Aug 04 17:57:07.481637 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.481559    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3008b79-1828-47a9-bcd4-ed723d813600-bundle\") pod \"d3008b79-1828-47a9-bcd4-ed723d813600\" (UID: \"d3008b79-1828-47a9-bcd4-ed723d813600\") "
Aug 04 17:57:07.481637 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.481577    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xttjv\" (UniqueName: \"kubernetes.io/projected/d3008b79-1828-47a9-bcd4-ed723d813600-kube-api-access-xttjv\") pod \"d3008b79-1828-47a9-bcd4-ed723d813600\" (UID: \"d3008b79-1828-47a9-bcd4-ed723d813600\") "
Aug 04 17:57:07.481637 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.481601    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfnbp\" (UniqueName: \"kubernetes.io/projected/296858fe-218a-4f38-99cf-f795c87c7e96-kube-api-access-wfnbp\") pod \"296858fe-218a-4f38-99cf-f795c87c7e96\" (UID: \"296858fe-218a-4f38-99cf-f795c87c7e96\") "
Aug 04 17:57:07.482162 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.482132    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3008b79-1828-47a9-bcd4-ed723d813600-bundle" (OuterVolumeSpecName: "bundle") pod "d3008b79-1828-47a9-bcd4-ed723d813600" (UID: "d3008b79-1828-47a9-bcd4-ed723d813600"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:57:07.482275 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.482214    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/296858fe-218a-4f38-99cf-f795c87c7e96-bundle" (OuterVolumeSpecName: "bundle") pod "296858fe-218a-4f38-99cf-f795c87c7e96" (UID: "296858fe-218a-4f38-99cf-f795c87c7e96"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:57:07.483674 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.483645    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/296858fe-218a-4f38-99cf-f795c87c7e96-kube-api-access-wfnbp" (OuterVolumeSpecName: "kube-api-access-wfnbp") pod "296858fe-218a-4f38-99cf-f795c87c7e96" (UID: "296858fe-218a-4f38-99cf-f795c87c7e96"). InnerVolumeSpecName "kube-api-access-wfnbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:57:07.483674 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.483662    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3008b79-1828-47a9-bcd4-ed723d813600-kube-api-access-xttjv" (OuterVolumeSpecName: "kube-api-access-xttjv") pod "d3008b79-1828-47a9-bcd4-ed723d813600" (UID: "d3008b79-1828-47a9-bcd4-ed723d813600"). InnerVolumeSpecName "kube-api-access-xttjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:57:07.490222 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.490194    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/296858fe-218a-4f38-99cf-f795c87c7e96-util" (OuterVolumeSpecName: "util") pod "296858fe-218a-4f38-99cf-f795c87c7e96" (UID: "296858fe-218a-4f38-99cf-f795c87c7e96"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:57:07.490799 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.490782    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3008b79-1828-47a9-bcd4-ed723d813600-util" (OuterVolumeSpecName: "util") pod "d3008b79-1828-47a9-bcd4-ed723d813600" (UID: "d3008b79-1828-47a9-bcd4-ed723d813600"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:57:07.583033 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.583010    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3008b79-1828-47a9-bcd4-ed723d813600-bundle\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:57:07.583033 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.583030    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xttjv\" (UniqueName: \"kubernetes.io/projected/d3008b79-1828-47a9-bcd4-ed723d813600-kube-api-access-xttjv\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:57:07.583155 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.583040    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfnbp\" (UniqueName: \"kubernetes.io/projected/296858fe-218a-4f38-99cf-f795c87c7e96-kube-api-access-wfnbp\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:57:07.583155 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.583050    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/296858fe-218a-4f38-99cf-f795c87c7e96-bundle\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:57:07.583155 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.583057    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/296858fe-218a-4f38-99cf-f795c87c7e96-util\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:57:07.583155 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:07.583066    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3008b79-1828-47a9-bcd4-ed723d813600-util\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:57:08.207838 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.207798    2572 generic.go:356] "Generic (PLEG): container finished" podID="0570e6d8-49e5-4512-95c9-2788acb36497" containerID="72f79f061a4978ac2823a51cf39faff9e4d7d2a1b847246b945a88254e712dcc" exitCode=0
Aug 04 17:57:08.208264 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.207840    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg" event={"ID":"0570e6d8-49e5-4512-95c9-2788acb36497","Type":"ContainerDied","Data":"72f79f061a4978ac2823a51cf39faff9e4d7d2a1b847246b945a88254e712dcc"}
Aug 04 17:57:08.209642 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.209623    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v"
Aug 04 17:57:08.209762 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.209664    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6276v" event={"ID":"d3008b79-1828-47a9-bcd4-ed723d813600","Type":"ContainerDied","Data":"89efb56f1a755bf6161ff4358d26d4e48c6cc33646c9483b5e0f1e705a726da6"}
Aug 04 17:57:08.209762 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.209705    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89efb56f1a755bf6161ff4358d26d4e48c6cc33646c9483b5e0f1e705a726da6"
Aug 04 17:57:08.211563 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.211529    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds" event={"ID":"296858fe-218a-4f38-99cf-f795c87c7e96","Type":"ContainerDied","Data":"ccdd3169dc1c3d404364a7eb74efaf94838f7e9f46ae3c331c57bf26e9f7ce83"}
Aug 04 17:57:08.211563 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.211571    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccdd3169dc1c3d404364a7eb74efaf94838f7e9f46ae3c331c57bf26e9f7ce83"
Aug 04 17:57:08.211749 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.211734    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053h4vds"
Aug 04 17:57:08.337303 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.337279    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k"
Aug 04 17:57:08.389791 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.389758    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-bundle\") pod \"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f\" (UID: \"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f\") "
Aug 04 17:57:08.390005 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.389806    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-util\") pod \"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f\" (UID: \"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f\") "
Aug 04 17:57:08.390005 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.389874    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzfdk\" (UniqueName: \"kubernetes.io/projected/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-kube-api-access-fzfdk\") pod \"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f\" (UID: \"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f\") "
Aug 04 17:57:08.390265 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.390241    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-bundle" (OuterVolumeSpecName: "bundle") pod "99c6a8bd-796e-4f1c-9c3a-274cc3053f3f" (UID: "99c6a8bd-796e-4f1c-9c3a-274cc3053f3f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:57:08.391948 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.391908    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-kube-api-access-fzfdk" (OuterVolumeSpecName: "kube-api-access-fzfdk") pod "99c6a8bd-796e-4f1c-9c3a-274cc3053f3f" (UID: "99c6a8bd-796e-4f1c-9c3a-274cc3053f3f"). InnerVolumeSpecName "kube-api-access-fzfdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:57:08.397809 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.397782    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-util" (OuterVolumeSpecName: "util") pod "99c6a8bd-796e-4f1c-9c3a-274cc3053f3f" (UID: "99c6a8bd-796e-4f1c-9c3a-274cc3053f3f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:57:08.491471 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.491405    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-util\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:57:08.491471 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.491429    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzfdk\" (UniqueName: \"kubernetes.io/projected/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-kube-api-access-fzfdk\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:57:08.491471 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:08.491440    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99c6a8bd-796e-4f1c-9c3a-274cc3053f3f-bundle\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:57:09.218493 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:09.218466    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k"
Aug 04 17:57:09.218493 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:09.218481    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06m77k" event={"ID":"99c6a8bd-796e-4f1c-9c3a-274cc3053f3f","Type":"ContainerDied","Data":"a813930c374ca9b6b5dbf1f7fc238ebca81bb9280a4181b715ad52c9164535c7"}
Aug 04 17:57:09.218947 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:09.218525    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a813930c374ca9b6b5dbf1f7fc238ebca81bb9280a4181b715ad52c9164535c7"
Aug 04 17:57:09.347898 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:09.347874    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg"
Aug 04 17:57:09.499610 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:09.499522    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0570e6d8-49e5-4512-95c9-2788acb36497-bundle\") pod \"0570e6d8-49e5-4512-95c9-2788acb36497\" (UID: \"0570e6d8-49e5-4512-95c9-2788acb36497\") "
Aug 04 17:57:09.499610 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:09.499565    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pp44z\" (UniqueName: \"kubernetes.io/projected/0570e6d8-49e5-4512-95c9-2788acb36497-kube-api-access-pp44z\") pod \"0570e6d8-49e5-4512-95c9-2788acb36497\" (UID: \"0570e6d8-49e5-4512-95c9-2788acb36497\") "
Aug 04 17:57:09.499787 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:09.499630    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0570e6d8-49e5-4512-95c9-2788acb36497-util\") pod \"0570e6d8-49e5-4512-95c9-2788acb36497\" (UID: \"0570e6d8-49e5-4512-95c9-2788acb36497\") "
Aug 04 17:57:09.500114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:09.500089    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0570e6d8-49e5-4512-95c9-2788acb36497-bundle" (OuterVolumeSpecName: "bundle") pod "0570e6d8-49e5-4512-95c9-2788acb36497" (UID: "0570e6d8-49e5-4512-95c9-2788acb36497"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:57:09.501783 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:09.501749    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0570e6d8-49e5-4512-95c9-2788acb36497-kube-api-access-pp44z" (OuterVolumeSpecName: "kube-api-access-pp44z") pod "0570e6d8-49e5-4512-95c9-2788acb36497" (UID: "0570e6d8-49e5-4512-95c9-2788acb36497"). InnerVolumeSpecName "kube-api-access-pp44z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:57:09.504370 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:09.504343    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0570e6d8-49e5-4512-95c9-2788acb36497-util" (OuterVolumeSpecName: "util") pod "0570e6d8-49e5-4512-95c9-2788acb36497" (UID: "0570e6d8-49e5-4512-95c9-2788acb36497"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:57:09.601393 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:09.601356    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0570e6d8-49e5-4512-95c9-2788acb36497-bundle\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:57:09.601393 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:09.601391    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pp44z\" (UniqueName: \"kubernetes.io/projected/0570e6d8-49e5-4512-95c9-2788acb36497-kube-api-access-pp44z\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:57:09.601583 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:09.601407    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0570e6d8-49e5-4512-95c9-2788acb36497-util\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:57:10.225236 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:10.225199    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg" event={"ID":"0570e6d8-49e5-4512-95c9-2788acb36497","Type":"ContainerDied","Data":"71e9b373b35c7618f8bc559399c8883092b09fce8b35ef2b573ba9f1559ab036"}
Aug 04 17:57:10.225236 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:10.225231    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c7r6gg"
Aug 04 17:57:10.225652 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:10.225272    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71e9b373b35c7618f8bc559399c8883092b09fce8b35ef2b573ba9f1559ab036"
Aug 04 17:57:21.039163 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039079    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh"]
Aug 04 17:57:21.039601 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039564    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3008b79-1828-47a9-bcd4-ed723d813600" containerName="extract"
Aug 04 17:57:21.039601 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039583    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3008b79-1828-47a9-bcd4-ed723d813600" containerName="extract"
Aug 04 17:57:21.039601 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039596    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0570e6d8-49e5-4512-95c9-2788acb36497" containerName="extract"
Aug 04 17:57:21.039765 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039605    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0570e6d8-49e5-4512-95c9-2788acb36497" containerName="extract"
Aug 04 17:57:21.039765 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039621    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99c6a8bd-796e-4f1c-9c3a-274cc3053f3f" containerName="util"
Aug 04 17:57:21.039765 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039629    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="99c6a8bd-796e-4f1c-9c3a-274cc3053f3f" containerName="util"
Aug 04 17:57:21.039765 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039641    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="296858fe-218a-4f38-99cf-f795c87c7e96" containerName="pull"
Aug 04 17:57:21.039765 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039649    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="296858fe-218a-4f38-99cf-f795c87c7e96" containerName="pull"
Aug 04 17:57:21.039765 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039659    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="296858fe-218a-4f38-99cf-f795c87c7e96" containerName="extract"
Aug 04 17:57:21.039765 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039667    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="296858fe-218a-4f38-99cf-f795c87c7e96" containerName="extract"
Aug 04 17:57:21.039765 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039682    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0570e6d8-49e5-4512-95c9-2788acb36497" containerName="util"
Aug 04 17:57:21.039765 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039691    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0570e6d8-49e5-4512-95c9-2788acb36497" containerName="util"
Aug 04 17:57:21.039765 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039703    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99c6a8bd-796e-4f1c-9c3a-274cc3053f3f" containerName="pull"
Aug 04 17:57:21.039765 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039734    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="99c6a8bd-796e-4f1c-9c3a-274cc3053f3f" containerName="pull"
Aug 04 17:57:21.039765 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039761    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3008b79-1828-47a9-bcd4-ed723d813600" containerName="util"
Aug 04 17:57:21.039765 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039769    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3008b79-1828-47a9-bcd4-ed723d813600" containerName="util"
Aug 04 17:57:21.040448 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039779    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="296858fe-218a-4f38-99cf-f795c87c7e96" containerName="util"
Aug 04 17:57:21.040448 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039787    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="296858fe-218a-4f38-99cf-f795c87c7e96" containerName="util"
Aug 04 17:57:21.040448 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039798    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3008b79-1828-47a9-bcd4-ed723d813600" containerName="pull"
Aug 04 17:57:21.040448 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039806    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3008b79-1828-47a9-bcd4-ed723d813600" containerName="pull"
Aug 04 17:57:21.040448 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039818    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0570e6d8-49e5-4512-95c9-2788acb36497" containerName="pull"
Aug 04 17:57:21.040448 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039828    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0570e6d8-49e5-4512-95c9-2788acb36497" containerName="pull"
Aug 04 17:57:21.040448 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039844    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99c6a8bd-796e-4f1c-9c3a-274cc3053f3f" containerName="extract"
Aug 04 17:57:21.040448 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039853    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="99c6a8bd-796e-4f1c-9c3a-274cc3053f3f" containerName="extract"
Aug 04 17:57:21.040448 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039964    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="99c6a8bd-796e-4f1c-9c3a-274cc3053f3f" containerName="extract"
Aug 04 17:57:21.040448 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039982    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0570e6d8-49e5-4512-95c9-2788acb36497" containerName="extract"
Aug 04 17:57:21.040448 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.039991    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="296858fe-218a-4f38-99cf-f795c87c7e96" containerName="extract"
Aug 04 17:57:21.040448 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.040000    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3008b79-1828-47a9-bcd4-ed723d813600" containerName="extract"
Aug 04 17:57:21.043332 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.043311    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh"
Aug 04 17:57:21.046542 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.046508    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 17:57:21.047395 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.047379    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 17:57:21.047469 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.047384    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-z8nhv\""
Aug 04 17:57:21.056115 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.056095    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh"]
Aug 04 17:57:21.201833 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.201803    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjkkh\" (UniqueName: \"kubernetes.io/projected/4291b24f-d79c-4247-a4f8-cf7a4d8e0687-kube-api-access-hjkkh\") pod \"limitador-operator-controller-manager-6c549b6d85-b8krh\" (UID: \"4291b24f-d79c-4247-a4f8-cf7a4d8e0687\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh"
Aug 04 17:57:21.303079 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.303001    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjkkh\" (UniqueName: \"kubernetes.io/projected/4291b24f-d79c-4247-a4f8-cf7a4d8e0687-kube-api-access-hjkkh\") pod \"limitador-operator-controller-manager-6c549b6d85-b8krh\" (UID: \"4291b24f-d79c-4247-a4f8-cf7a4d8e0687\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh"
Aug 04 17:57:21.313735 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.313705    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjkkh\" (UniqueName: \"kubernetes.io/projected/4291b24f-d79c-4247-a4f8-cf7a4d8e0687-kube-api-access-hjkkh\") pod \"limitador-operator-controller-manager-6c549b6d85-b8krh\" (UID: \"4291b24f-d79c-4247-a4f8-cf7a4d8e0687\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh"
Aug 04 17:57:21.352520 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.352497    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh"
Aug 04 17:57:21.486463 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:21.486435    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh"]
Aug 04 17:57:21.488195 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:57:21.488151    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4291b24f_d79c_4247_a4f8_cf7a4d8e0687.slice/crio-ca1b81dc08aa362ef526b514a2c6231d91c7a0ee600714f146c54f5b2cc1ebef WatchSource:0}: Error finding container ca1b81dc08aa362ef526b514a2c6231d91c7a0ee600714f146c54f5b2cc1ebef: Status 404 returned error can't find the container with id ca1b81dc08aa362ef526b514a2c6231d91c7a0ee600714f146c54f5b2cc1ebef
Aug 04 17:57:22.286768 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:22.286734    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh" event={"ID":"4291b24f-d79c-4247-a4f8-cf7a4d8e0687","Type":"ContainerStarted","Data":"ca1b81dc08aa362ef526b514a2c6231d91c7a0ee600714f146c54f5b2cc1ebef"}
Aug 04 17:57:23.621026 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:23.620994    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-gf68n"]
Aug 04 17:57:23.625790 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:23.625770    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-gf68n"
Aug 04 17:57:23.628240 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:23.628220    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8gfwk\""
Aug 04 17:57:23.637999 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:23.637978    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-gf68n"]
Aug 04 17:57:23.722563 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:23.722527    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cnxp\" (UniqueName: \"kubernetes.io/projected/97eed660-d9d9-4956-b248-54ff5973d910-kube-api-access-2cnxp\") pod \"authorino-operator-68d88948d8-gf68n\" (UID: \"97eed660-d9d9-4956-b248-54ff5973d910\") " pod="kuadrant-system/authorino-operator-68d88948d8-gf68n"
Aug 04 17:57:23.823608 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:23.823571    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cnxp\" (UniqueName: \"kubernetes.io/projected/97eed660-d9d9-4956-b248-54ff5973d910-kube-api-access-2cnxp\") pod \"authorino-operator-68d88948d8-gf68n\" (UID: \"97eed660-d9d9-4956-b248-54ff5973d910\") " pod="kuadrant-system/authorino-operator-68d88948d8-gf68n"
Aug 04 17:57:23.839870 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:23.839843    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cnxp\" (UniqueName: \"kubernetes.io/projected/97eed660-d9d9-4956-b248-54ff5973d910-kube-api-access-2cnxp\") pod \"authorino-operator-68d88948d8-gf68n\" (UID: \"97eed660-d9d9-4956-b248-54ff5973d910\") " pod="kuadrant-system/authorino-operator-68d88948d8-gf68n"
Aug 04 17:57:23.935998 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:23.935905    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-gf68n"
Aug 04 17:57:24.075962 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:24.075937    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-gf68n"]
Aug 04 17:57:24.077644 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:57:24.077614    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97eed660_d9d9_4956_b248_54ff5973d910.slice/crio-6acb7525641710ac12966457f68c19b2d42c86788718107188520b6531f65296 WatchSource:0}: Error finding container 6acb7525641710ac12966457f68c19b2d42c86788718107188520b6531f65296: Status 404 returned error can't find the container with id 6acb7525641710ac12966457f68c19b2d42c86788718107188520b6531f65296
Aug 04 17:57:24.299821 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:24.299726    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-gf68n" event={"ID":"97eed660-d9d9-4956-b248-54ff5973d910","Type":"ContainerStarted","Data":"6acb7525641710ac12966457f68c19b2d42c86788718107188520b6531f65296"}
Aug 04 17:57:26.314091 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:26.314060    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh" event={"ID":"4291b24f-d79c-4247-a4f8-cf7a4d8e0687","Type":"ContainerStarted","Data":"21eea023d5ac19f19947a929c1a5e4659a6dd92cd8276178a93f5f969d66175e"}
Aug 04 17:57:26.314504 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:26.314269    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh"
Aug 04 17:57:26.332031 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:26.331982    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh" podStartSLOduration=0.969910899 podStartE2EDuration="5.331969178s" totalImagesPullingTime="4.362058279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:57:26.330178158 +0000 UTC m=+631.240067751" watchObservedRunningTime="2026-08-04 17:57:26.331969178 +0000 UTC m=+631.241858765"
Aug 04 17:57:27.321101 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:27.321061    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-gf68n" event={"ID":"97eed660-d9d9-4956-b248-54ff5973d910","Type":"ContainerStarted","Data":"62e92c78c6a1a60576100280e209ad099f29400f89ac574ddd5748d870944d17"}
Aug 04 17:57:27.344865 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:27.344820    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-gf68n" podStartSLOduration=1.873379082 podStartE2EDuration="4.344803719s" totalImagesPullingTime="2.471424637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:57:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:57:27.343573812 +0000 UTC m=+632.253463400" watchObservedRunningTime="2026-08-04 17:57:27.344803719 +0000 UTC m=+632.254693306"
Aug 04 17:57:27.907227 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:27.907193    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"]
Aug 04 17:57:27.910678 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:27.910661    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"
Aug 04 17:57:27.913166 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:27.913145    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ttcms\""
Aug 04 17:57:27.924117 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:27.924097    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"]
Aug 04 17:57:28.060139 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:28.060109    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7560cac-21b2-400c-b18c-1362c817389c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vwcnh\" (UID: \"f7560cac-21b2-400c-b18c-1362c817389c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"
Aug 04 17:57:28.060317 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:28.060178    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvh7n\" (UniqueName: \"kubernetes.io/projected/f7560cac-21b2-400c-b18c-1362c817389c-kube-api-access-qvh7n\") pod \"kuadrant-operator-controller-manager-58fc56757c-vwcnh\" (UID: \"f7560cac-21b2-400c-b18c-1362c817389c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"
Aug 04 17:57:28.161651 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:28.161558    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvh7n\" (UniqueName: \"kubernetes.io/projected/f7560cac-21b2-400c-b18c-1362c817389c-kube-api-access-qvh7n\") pod \"kuadrant-operator-controller-manager-58fc56757c-vwcnh\" (UID: \"f7560cac-21b2-400c-b18c-1362c817389c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"
Aug 04 17:57:28.161651 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:28.161625    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7560cac-21b2-400c-b18c-1362c817389c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vwcnh\" (UID: \"f7560cac-21b2-400c-b18c-1362c817389c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"
Aug 04 17:57:28.162089 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:28.162067    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7560cac-21b2-400c-b18c-1362c817389c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vwcnh\" (UID: \"f7560cac-21b2-400c-b18c-1362c817389c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"
Aug 04 17:57:28.169039 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:28.169013    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvh7n\" (UniqueName: \"kubernetes.io/projected/f7560cac-21b2-400c-b18c-1362c817389c-kube-api-access-qvh7n\") pod \"kuadrant-operator-controller-manager-58fc56757c-vwcnh\" (UID: \"f7560cac-21b2-400c-b18c-1362c817389c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"
Aug 04 17:57:28.221009 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:28.220975    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"
Aug 04 17:57:28.326365 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:28.326330    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-gf68n"
Aug 04 17:57:28.361291 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:28.361268    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"]
Aug 04 17:57:28.364330 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:57:28.364297    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7560cac_21b2_400c_b18c_1362c817389c.slice/crio-a74e361218b8f6011869e15e54e5ba643626bdd875eda4f29d8e801d79ce4de7 WatchSource:0}: Error finding container a74e361218b8f6011869e15e54e5ba643626bdd875eda4f29d8e801d79ce4de7: Status 404 returned error can't find the container with id a74e361218b8f6011869e15e54e5ba643626bdd875eda4f29d8e801d79ce4de7
Aug 04 17:57:29.332982 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:29.332946    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh" event={"ID":"f7560cac-21b2-400c-b18c-1362c817389c","Type":"ContainerStarted","Data":"a74e361218b8f6011869e15e54e5ba643626bdd875eda4f29d8e801d79ce4de7"}
Aug 04 17:57:30.020118 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:30.020037    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-9g6kj"]
Aug 04 17:57:30.023738 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:30.023716    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9g6kj"
Aug 04 17:57:30.025941 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:30.025906    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Aug 04 17:57:30.026036 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:30.025987    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9rwh7\""
Aug 04 17:57:30.039253 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:30.039221    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-9g6kj"]
Aug 04 17:57:30.177319 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:30.177288    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qls4m\" (UniqueName: \"kubernetes.io/projected/56fdff5e-2741-4b96-9227-1f4bac31d1a7-kube-api-access-qls4m\") pod \"dns-operator-controller-manager-5985564776-9g6kj\" (UID: \"56fdff5e-2741-4b96-9227-1f4bac31d1a7\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-9g6kj"
Aug 04 17:57:30.278246 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:30.278162    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qls4m\" (UniqueName: \"kubernetes.io/projected/56fdff5e-2741-4b96-9227-1f4bac31d1a7-kube-api-access-qls4m\") pod \"dns-operator-controller-manager-5985564776-9g6kj\" (UID: \"56fdff5e-2741-4b96-9227-1f4bac31d1a7\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-9g6kj"
Aug 04 17:57:30.289865 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:30.289830    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qls4m\" (UniqueName: \"kubernetes.io/projected/56fdff5e-2741-4b96-9227-1f4bac31d1a7-kube-api-access-qls4m\") pod \"dns-operator-controller-manager-5985564776-9g6kj\" (UID: \"56fdff5e-2741-4b96-9227-1f4bac31d1a7\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-9g6kj"
Aug 04 17:57:30.337067 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:30.337041    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9g6kj"
Aug 04 17:57:30.483272 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:30.483247    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-9g6kj"]
Aug 04 17:57:30.484971 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:57:30.484941    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56fdff5e_2741_4b96_9227_1f4bac31d1a7.slice/crio-465dda9dcfe1abe5520f4c9101019fbf3f39afab69be9aa4f0cb77ef9bf44c34 WatchSource:0}: Error finding container 465dda9dcfe1abe5520f4c9101019fbf3f39afab69be9aa4f0cb77ef9bf44c34: Status 404 returned error can't find the container with id 465dda9dcfe1abe5520f4c9101019fbf3f39afab69be9aa4f0cb77ef9bf44c34
Aug 04 17:57:30.754757 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:57:30.754714    2572 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ca946bb88274562b8027c90d7b6945a426ec799b1b0017056f6189160c591c2d: pinging container registry registry.redhat.io: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" image="registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ca946bb88274562b8027c90d7b6945a426ec799b1b0017056f6189160c591c2d"
Aug 04 17:57:30.754963 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:57:30.754843    2572 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod dns-operator-controller-manager-5985564776-9g6kj_kuadrant-system(56fdff5e-2741-4b96-9227-1f4bac31d1a7): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ca946bb88274562b8027c90d7b6945a426ec799b1b0017056f6189160c591c2d: pinging container registry registry.redhat.io: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" logger="UnhandledError"
Aug 04 17:57:30.754963 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:57:30.754891    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ca946bb88274562b8027c90d7b6945a426ec799b1b0017056f6189160c591c2d: pinging container registry registry.redhat.io: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9g6kj" podUID="56fdff5e-2741-4b96-9227-1f4bac31d1a7"
Aug 04 17:57:31.345534 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:31.345497    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9g6kj" event={"ID":"56fdff5e-2741-4b96-9227-1f4bac31d1a7","Type":"ContainerStarted","Data":"465dda9dcfe1abe5520f4c9101019fbf3f39afab69be9aa4f0cb77ef9bf44c34"}
Aug 04 17:57:31.346608 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:57:31.346581    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ca946bb88274562b8027c90d7b6945a426ec799b1b0017056f6189160c591c2d\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ca946bb88274562b8027c90d7b6945a426ec799b1b0017056f6189160c591c2d: pinging container registry registry.redhat.io: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9g6kj" podUID="56fdff5e-2741-4b96-9227-1f4bac31d1a7"
Aug 04 17:57:32.352961 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:57:32.352931    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ca946bb88274562b8027c90d7b6945a426ec799b1b0017056f6189160c591c2d\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ca946bb88274562b8027c90d7b6945a426ec799b1b0017056f6189160c591c2d: pinging container registry registry.redhat.io: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9g6kj" podUID="56fdff5e-2741-4b96-9227-1f4bac31d1a7"
Aug 04 17:57:34.365032 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:34.364992    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh" event={"ID":"f7560cac-21b2-400c-b18c-1362c817389c","Type":"ContainerStarted","Data":"523624177dd66ae05a8c9e623e5786826c3bc40bb6670cf42bb7b340f889a829"}
Aug 04 17:57:34.365389 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:34.365106    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"
Aug 04 17:57:34.386660 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:34.386615    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh" podStartSLOduration=1.506397787 podStartE2EDuration="7.386601254s" totalImagesPullingTime="5.880203467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:57:34.383272974 +0000 UTC m=+639.293162583" watchObservedRunningTime="2026-08-04 17:57:34.386601254 +0000 UTC m=+639.296490842"
Aug 04 17:57:36.771252 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:36.771216    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd"]
Aug 04 17:57:36.775054 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:36.775035    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd"
Aug 04 17:57:36.777363 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:36.777342    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rwkxm\""
Aug 04 17:57:36.777363 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:36.777357    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Aug 04 17:57:36.777493 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:36.777341    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Aug 04 17:57:36.782662 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:36.782643    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd"]
Aug 04 17:57:36.836608 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:36.836571    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffpj7\" (UniqueName: \"kubernetes.io/projected/21566f9c-fa05-47de-8163-963ad05a75de-kube-api-access-ffpj7\") pod \"kuadrant-console-plugin-598f86468b-zglcd\" (UID: \"21566f9c-fa05-47de-8163-963ad05a75de\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd"
Aug 04 17:57:36.836780 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:36.836621    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/21566f9c-fa05-47de-8163-963ad05a75de-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-zglcd\" (UID: \"21566f9c-fa05-47de-8163-963ad05a75de\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd"
Aug 04 17:57:36.836780 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:36.836655    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/21566f9c-fa05-47de-8163-963ad05a75de-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-zglcd\" (UID: \"21566f9c-fa05-47de-8163-963ad05a75de\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd"
Aug 04 17:57:36.937053 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:36.937024    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffpj7\" (UniqueName: \"kubernetes.io/projected/21566f9c-fa05-47de-8163-963ad05a75de-kube-api-access-ffpj7\") pod \"kuadrant-console-plugin-598f86468b-zglcd\" (UID: \"21566f9c-fa05-47de-8163-963ad05a75de\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd"
Aug 04 17:57:36.937279 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:36.937076    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/21566f9c-fa05-47de-8163-963ad05a75de-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-zglcd\" (UID: \"21566f9c-fa05-47de-8163-963ad05a75de\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd"
Aug 04 17:57:36.937279 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:36.937113    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/21566f9c-fa05-47de-8163-963ad05a75de-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-zglcd\" (UID: \"21566f9c-fa05-47de-8163-963ad05a75de\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd"
Aug 04 17:57:36.937979 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:36.937947    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/21566f9c-fa05-47de-8163-963ad05a75de-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-zglcd\" (UID: \"21566f9c-fa05-47de-8163-963ad05a75de\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd"
Aug 04 17:57:36.939521 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:36.939495    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/21566f9c-fa05-47de-8163-963ad05a75de-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-zglcd\" (UID: \"21566f9c-fa05-47de-8163-963ad05a75de\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd"
Aug 04 17:57:36.944988 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:36.944967    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffpj7\" (UniqueName: \"kubernetes.io/projected/21566f9c-fa05-47de-8163-963ad05a75de-kube-api-access-ffpj7\") pod \"kuadrant-console-plugin-598f86468b-zglcd\" (UID: \"21566f9c-fa05-47de-8163-963ad05a75de\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd"
Aug 04 17:57:37.085599 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:37.085566    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd"
Aug 04 17:57:37.215483 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:37.215460    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd"]
Aug 04 17:57:37.217013 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:57:37.216986    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21566f9c_fa05_47de_8163_963ad05a75de.slice/crio-fa19049d98382b5c4ee006d3f9dc5eac2df6181c1bea7895008218ebc9042ae6 WatchSource:0}: Error finding container fa19049d98382b5c4ee006d3f9dc5eac2df6181c1bea7895008218ebc9042ae6: Status 404 returned error can't find the container with id fa19049d98382b5c4ee006d3f9dc5eac2df6181c1bea7895008218ebc9042ae6
Aug 04 17:57:37.323457 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:37.323427    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh"
Aug 04 17:57:37.383376 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:37.383298    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd" event={"ID":"21566f9c-fa05-47de-8163-963ad05a75de","Type":"ContainerStarted","Data":"fa19049d98382b5c4ee006d3f9dc5eac2df6181c1bea7895008218ebc9042ae6"}
Aug 04 17:57:39.336342 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:39.336308    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-gf68n"
Aug 04 17:57:43.423126 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:43.423088    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd" event={"ID":"21566f9c-fa05-47de-8163-963ad05a75de","Type":"ContainerStarted","Data":"b06a4b39364d766aeddd86ffb6d8d00d091e69ac30f6234f3578e480183ebb4b"}
Aug 04 17:57:43.438480 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:43.438434    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zglcd" podStartSLOduration=2.218438174 podStartE2EDuration="7.438420581s" totalImagesPullingTime="5.219982407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:57:43.436908213 +0000 UTC m=+648.346797802" watchObservedRunningTime="2026-08-04 17:57:43.438420581 +0000 UTC m=+648.348310169"
Aug 04 17:57:43.594202 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:43.594180    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 17:57:45.373436 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:45.373402    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"
Aug 04 17:57:46.441989 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:46.441951    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9g6kj" event={"ID":"56fdff5e-2741-4b96-9227-1f4bac31d1a7","Type":"ContainerStarted","Data":"176ea87ac00053aa808ec8e057b3059d9861dbb40082f3e0706fb82ff6cc0abf"}
Aug 04 17:57:46.442479 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:46.442175    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9g6kj"
Aug 04 17:57:46.461119 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:46.461073    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9g6kj" podStartSLOduration=2.39752124 podStartE2EDuration="17.461056142s" totalImagesPullingTime="15.063534902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-08-04 17:57:46.460241958 +0000 UTC m=+651.370131545" watchObservedRunningTime="2026-08-04 17:57:46.461056142 +0000 UTC m=+651.370945733"
Aug 04 17:57:47.490585 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.490550    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"]
Aug 04 17:57:47.491200 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.490724    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh" podUID="f7560cac-21b2-400c-b18c-1362c817389c" containerName="manager" containerID="cri-o://523624177dd66ae05a8c9e623e5786826c3bc40bb6670cf42bb7b340f889a829" gracePeriod=2
Aug 04 17:57:47.493166 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:57:47.493128    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vwcnh\" is forbidden: User \"system:node:ip-10-0-141-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-117.ec2.internal' and this object" podUID="f7560cac-21b2-400c-b18c-1362c817389c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"
Aug 04 17:57:47.495283 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.495238    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"]
Aug 04 17:57:47.516442 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.516415    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"]
Aug 04 17:57:47.516848 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.516831    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7560cac-21b2-400c-b18c-1362c817389c" containerName="manager"
Aug 04 17:57:47.516942 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.516850    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7560cac-21b2-400c-b18c-1362c817389c" containerName="manager"
Aug 04 17:57:47.517005 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.516978    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7560cac-21b2-400c-b18c-1362c817389c" containerName="manager"
Aug 04 17:57:47.520156 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.520136    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"
Aug 04 17:57:47.526651 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.526631    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh"]
Aug 04 17:57:47.526799 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.526781    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh" podUID="4291b24f-d79c-4247-a4f8-cf7a4d8e0687" containerName="manager" containerID="cri-o://21eea023d5ac19f19947a929c1a5e4659a6dd92cd8276178a93f5f969d66175e" gracePeriod=2
Aug 04 17:57:47.535606 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.535581    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"]
Aug 04 17:57:47.541667 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.541645    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh"]
Aug 04 17:57:47.552597 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.552565    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-q4kdk"]
Aug 04 17:57:47.553179 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.553159    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4291b24f-d79c-4247-a4f8-cf7a4d8e0687" containerName="manager"
Aug 04 17:57:47.553227 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.553183    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4291b24f-d79c-4247-a4f8-cf7a4d8e0687" containerName="manager"
Aug 04 17:57:47.553293 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.553280    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4291b24f-d79c-4247-a4f8-cf7a4d8e0687" containerName="manager"
Aug 04 17:57:47.556571 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.556557    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-q4kdk"
Aug 04 17:57:47.569732 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:57:47.569700    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vwcnh\" is forbidden: User \"system:node:ip-10-0-141-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-117.ec2.internal' and this object" podUID="f7560cac-21b2-400c-b18c-1362c817389c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"
Aug 04 17:57:47.571858 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:57:47.571830    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vwcnh\" is forbidden: User \"system:node:ip-10-0-141-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-117.ec2.internal' and this object" podUID="f7560cac-21b2-400c-b18c-1362c817389c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"
Aug 04 17:57:47.574396 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.574373    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-q4kdk"]
Aug 04 17:57:47.590845 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:57:47.590805    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-b8krh\" is forbidden: User \"system:node:ip-10-0-141-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-117.ec2.internal' and this object" podUID="4291b24f-d79c-4247-a4f8-cf7a4d8e0687" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh"
Aug 04 17:57:47.636418 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.636385    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h74c\" (UniqueName: \"kubernetes.io/projected/e4a9d63e-57b2-4802-af8f-129bec591013-kube-api-access-4h74c\") pod \"kuadrant-operator-controller-manager-58fc56757c-t4khb\" (UID: \"e4a9d63e-57b2-4802-af8f-129bec591013\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"
Aug 04 17:57:47.636561 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.636536    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4a9d63e-57b2-4802-af8f-129bec591013-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-t4khb\" (UID: \"e4a9d63e-57b2-4802-af8f-129bec591013\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"
Aug 04 17:57:47.636949 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.636688    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z46nc\" (UniqueName: \"kubernetes.io/projected/077c7648-08bd-40ed-9202-356d1390afbc-kube-api-access-z46nc\") pod \"limitador-operator-controller-manager-6c549b6d85-q4kdk\" (UID: \"077c7648-08bd-40ed-9202-356d1390afbc\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-q4kdk"
Aug 04 17:57:47.737883 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.737844    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z46nc\" (UniqueName: \"kubernetes.io/projected/077c7648-08bd-40ed-9202-356d1390afbc-kube-api-access-z46nc\") pod \"limitador-operator-controller-manager-6c549b6d85-q4kdk\" (UID: \"077c7648-08bd-40ed-9202-356d1390afbc\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-q4kdk"
Aug 04 17:57:47.738059 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.737958    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h74c\" (UniqueName: \"kubernetes.io/projected/e4a9d63e-57b2-4802-af8f-129bec591013-kube-api-access-4h74c\") pod \"kuadrant-operator-controller-manager-58fc56757c-t4khb\" (UID: \"e4a9d63e-57b2-4802-af8f-129bec591013\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"
Aug 04 17:57:47.738059 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.737997    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4a9d63e-57b2-4802-af8f-129bec591013-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-t4khb\" (UID: \"e4a9d63e-57b2-4802-af8f-129bec591013\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"
Aug 04 17:57:47.738389 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.738368    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4a9d63e-57b2-4802-af8f-129bec591013-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-t4khb\" (UID: \"e4a9d63e-57b2-4802-af8f-129bec591013\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"
Aug 04 17:57:47.747007 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.746943    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h74c\" (UniqueName: \"kubernetes.io/projected/e4a9d63e-57b2-4802-af8f-129bec591013-kube-api-access-4h74c\") pod \"kuadrant-operator-controller-manager-58fc56757c-t4khb\" (UID: \"e4a9d63e-57b2-4802-af8f-129bec591013\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"
Aug 04 17:57:47.747438 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.747414    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z46nc\" (UniqueName: \"kubernetes.io/projected/077c7648-08bd-40ed-9202-356d1390afbc-kube-api-access-z46nc\") pod \"limitador-operator-controller-manager-6c549b6d85-q4kdk\" (UID: \"077c7648-08bd-40ed-9202-356d1390afbc\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-q4kdk"
Aug 04 17:57:47.773447 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.773425    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"
Aug 04 17:57:47.775543 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.775528    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh"
Aug 04 17:57:47.838336 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.838304    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7560cac-21b2-400c-b18c-1362c817389c-extensions-socket-volume\") pod \"f7560cac-21b2-400c-b18c-1362c817389c\" (UID: \"f7560cac-21b2-400c-b18c-1362c817389c\") "
Aug 04 17:57:47.838492 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.838344    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjkkh\" (UniqueName: \"kubernetes.io/projected/4291b24f-d79c-4247-a4f8-cf7a4d8e0687-kube-api-access-hjkkh\") pod \"4291b24f-d79c-4247-a4f8-cf7a4d8e0687\" (UID: \"4291b24f-d79c-4247-a4f8-cf7a4d8e0687\") "
Aug 04 17:57:47.838492 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.838370    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvh7n\" (UniqueName: \"kubernetes.io/projected/f7560cac-21b2-400c-b18c-1362c817389c-kube-api-access-qvh7n\") pod \"f7560cac-21b2-400c-b18c-1362c817389c\" (UID: \"f7560cac-21b2-400c-b18c-1362c817389c\") "
Aug 04 17:57:47.838786 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.838756    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7560cac-21b2-400c-b18c-1362c817389c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f7560cac-21b2-400c-b18c-1362c817389c" (UID: "f7560cac-21b2-400c-b18c-1362c817389c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:57:47.840496 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.840471    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7560cac-21b2-400c-b18c-1362c817389c-kube-api-access-qvh7n" (OuterVolumeSpecName: "kube-api-access-qvh7n") pod "f7560cac-21b2-400c-b18c-1362c817389c" (UID: "f7560cac-21b2-400c-b18c-1362c817389c"). InnerVolumeSpecName "kube-api-access-qvh7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:57:47.840574 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.840505    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4291b24f-d79c-4247-a4f8-cf7a4d8e0687-kube-api-access-hjkkh" (OuterVolumeSpecName: "kube-api-access-hjkkh") pod "4291b24f-d79c-4247-a4f8-cf7a4d8e0687" (UID: "4291b24f-d79c-4247-a4f8-cf7a4d8e0687"). InnerVolumeSpecName "kube-api-access-hjkkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:57:47.917558 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.917534    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"
Aug 04 17:57:47.923519 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.923498    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-q4kdk"
Aug 04 17:57:47.939639 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.939610    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7560cac-21b2-400c-b18c-1362c817389c-extensions-socket-volume\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:57:47.939639 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.939637    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjkkh\" (UniqueName: \"kubernetes.io/projected/4291b24f-d79c-4247-a4f8-cf7a4d8e0687-kube-api-access-hjkkh\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:57:47.939797 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:47.939648    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvh7n\" (UniqueName: \"kubernetes.io/projected/f7560cac-21b2-400c-b18c-1362c817389c-kube-api-access-qvh7n\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:57:48.061588 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.059360    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"]
Aug 04 17:57:48.063969 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:57:48.062255    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a9d63e_57b2_4802_af8f_129bec591013.slice/crio-d275467a2d6f235e17297b7aaa14b5781cd7ba38bb1b518a4b296fcc780ad416 WatchSource:0}: Error finding container d275467a2d6f235e17297b7aaa14b5781cd7ba38bb1b518a4b296fcc780ad416: Status 404 returned error can't find the container with id d275467a2d6f235e17297b7aaa14b5781cd7ba38bb1b518a4b296fcc780ad416
Aug 04 17:57:48.081419 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:57:48.081396    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod077c7648_08bd_40ed_9202_356d1390afbc.slice/crio-a532b6d49c02a6f69fe83329eef9a5860eb6af24e557636371d9736f2d89db19 WatchSource:0}: Error finding container a532b6d49c02a6f69fe83329eef9a5860eb6af24e557636371d9736f2d89db19: Status 404 returned error can't find the container with id a532b6d49c02a6f69fe83329eef9a5860eb6af24e557636371d9736f2d89db19
Aug 04 17:57:48.081645 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.081620    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-q4kdk"]
Aug 04 17:57:48.453561 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.453527    2572 generic.go:356] "Generic (PLEG): container finished" podID="4291b24f-d79c-4247-a4f8-cf7a4d8e0687" containerID="21eea023d5ac19f19947a929c1a5e4659a6dd92cd8276178a93f5f969d66175e" exitCode=0
Aug 04 17:57:48.453740 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.453587    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-b8krh"
Aug 04 17:57:48.453740 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.453636    2572 scope.go:117] "RemoveContainer" containerID="21eea023d5ac19f19947a929c1a5e4659a6dd92cd8276178a93f5f969d66175e"
Aug 04 17:57:48.455381 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.455357    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-q4kdk" event={"ID":"077c7648-08bd-40ed-9202-356d1390afbc","Type":"ContainerStarted","Data":"2b5744b45100f139173007f984c1328969a71dc8293efb1384bacc5b4933b942"}
Aug 04 17:57:48.455500 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.455400    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-q4kdk" event={"ID":"077c7648-08bd-40ed-9202-356d1390afbc","Type":"ContainerStarted","Data":"a532b6d49c02a6f69fe83329eef9a5860eb6af24e557636371d9736f2d89db19"}
Aug 04 17:57:48.455560 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.455551    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-q4kdk"
Aug 04 17:57:48.457014 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.456993    2572 generic.go:356] "Generic (PLEG): container finished" podID="f7560cac-21b2-400c-b18c-1362c817389c" containerID="523624177dd66ae05a8c9e623e5786826c3bc40bb6670cf42bb7b340f889a829" exitCode=0
Aug 04 17:57:48.457117 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.457054    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vwcnh"
Aug 04 17:57:48.458878 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.458830    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb" event={"ID":"e4a9d63e-57b2-4802-af8f-129bec591013","Type":"ContainerStarted","Data":"9545b41d39232e13d6e063bc5414654eee6335252125b0adf905be34b4b9b491"}
Aug 04 17:57:48.458878 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.458874    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb" event={"ID":"e4a9d63e-57b2-4802-af8f-129bec591013","Type":"ContainerStarted","Data":"d275467a2d6f235e17297b7aaa14b5781cd7ba38bb1b518a4b296fcc780ad416"}
Aug 04 17:57:48.459055 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.458952    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"
Aug 04 17:57:48.463433 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.463398    2572 scope.go:117] "RemoveContainer" containerID="21eea023d5ac19f19947a929c1a5e4659a6dd92cd8276178a93f5f969d66175e"
Aug 04 17:57:48.463685 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:57:48.463659    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21eea023d5ac19f19947a929c1a5e4659a6dd92cd8276178a93f5f969d66175e\": container with ID starting with 21eea023d5ac19f19947a929c1a5e4659a6dd92cd8276178a93f5f969d66175e not found: ID does not exist" containerID="21eea023d5ac19f19947a929c1a5e4659a6dd92cd8276178a93f5f969d66175e"
Aug 04 17:57:48.463765 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.463690    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21eea023d5ac19f19947a929c1a5e4659a6dd92cd8276178a93f5f969d66175e"} err="failed to get container status \"21eea023d5ac19f19947a929c1a5e4659a6dd92cd8276178a93f5f969d66175e\": rpc error: code = NotFound desc = could not find container \"21eea023d5ac19f19947a929c1a5e4659a6dd92cd8276178a93f5f969d66175e\": container with ID starting with 21eea023d5ac19f19947a929c1a5e4659a6dd92cd8276178a93f5f969d66175e not found: ID does not exist"
Aug 04 17:57:48.463765 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.463707    2572 scope.go:117] "RemoveContainer" containerID="523624177dd66ae05a8c9e623e5786826c3bc40bb6670cf42bb7b340f889a829"
Aug 04 17:57:48.471751 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.471737    2572 scope.go:117] "RemoveContainer" containerID="523624177dd66ae05a8c9e623e5786826c3bc40bb6670cf42bb7b340f889a829"
Aug 04 17:57:48.471995 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:57:48.471978    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"523624177dd66ae05a8c9e623e5786826c3bc40bb6670cf42bb7b340f889a829\": container with ID starting with 523624177dd66ae05a8c9e623e5786826c3bc40bb6670cf42bb7b340f889a829 not found: ID does not exist" containerID="523624177dd66ae05a8c9e623e5786826c3bc40bb6670cf42bb7b340f889a829"
Aug 04 17:57:48.472042 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.472002    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"523624177dd66ae05a8c9e623e5786826c3bc40bb6670cf42bb7b340f889a829"} err="failed to get container status \"523624177dd66ae05a8c9e623e5786826c3bc40bb6670cf42bb7b340f889a829\": rpc error: code = NotFound desc = could not find container \"523624177dd66ae05a8c9e623e5786826c3bc40bb6670cf42bb7b340f889a829\": container with ID starting with 523624177dd66ae05a8c9e623e5786826c3bc40bb6670cf42bb7b340f889a829 not found: ID does not exist"
Aug 04 17:57:48.497769 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.497724    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-q4kdk" podStartSLOduration=1.497711711 podStartE2EDuration="1.497711711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:57:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:57:48.495657986 +0000 UTC m=+653.405547586" watchObservedRunningTime="2026-08-04 17:57:48.497711711 +0000 UTC m=+653.407601301"
Aug 04 17:57:48.531806 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:48.531763    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb" podStartSLOduration=1.531749105 podStartE2EDuration="1.531749105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:57:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:57:48.530895802 +0000 UTC m=+653.440785389" watchObservedRunningTime="2026-08-04 17:57:48.531749105 +0000 UTC m=+653.441638704"
Aug 04 17:57:49.599629 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:49.599596    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4291b24f-d79c-4247-a4f8-cf7a4d8e0687" path="/var/lib/kubelet/pods/4291b24f-d79c-4247-a4f8-cf7a4d8e0687/volumes"
Aug 04 17:57:49.600009 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:49.599967    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7560cac-21b2-400c-b18c-1362c817389c" path="/var/lib/kubelet/pods/f7560cac-21b2-400c-b18c-1362c817389c/volumes"
Aug 04 17:57:57.449828 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:57.449799    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9g6kj"
Aug 04 17:57:59.468951 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:59.468905    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"
Aug 04 17:57:59.469402 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:57:59.469008    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-q4kdk"
Aug 04 17:58:02.698419 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:02.698385    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"]
Aug 04 17:58:02.698938 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:02.698567    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb" podUID="e4a9d63e-57b2-4802-af8f-129bec591013" containerName="manager" containerID="cri-o://9545b41d39232e13d6e063bc5414654eee6335252125b0adf905be34b4b9b491" gracePeriod=10
Aug 04 17:58:02.896456 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:02.896427    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"]
Aug 04 17:58:02.898951 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:02.898930    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"
Aug 04 17:58:02.912546 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:02.912520    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"]
Aug 04 17:58:02.942196 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:02.942178    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"
Aug 04 17:58:02.970856 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:02.970774    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p575d\" (UniqueName: \"kubernetes.io/projected/8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887-kube-api-access-p575d\") pod \"kuadrant-operator-controller-manager-68cf589589-6kx82\" (UID: \"8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"
Aug 04 17:58:02.971075 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:02.970961    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-6kx82\" (UID: \"8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"
Aug 04 17:58:03.071487 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.071437    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4a9d63e-57b2-4802-af8f-129bec591013-extensions-socket-volume\") pod \"e4a9d63e-57b2-4802-af8f-129bec591013\" (UID: \"e4a9d63e-57b2-4802-af8f-129bec591013\") "
Aug 04 17:58:03.071695 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.071564    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h74c\" (UniqueName: \"kubernetes.io/projected/e4a9d63e-57b2-4802-af8f-129bec591013-kube-api-access-4h74c\") pod \"e4a9d63e-57b2-4802-af8f-129bec591013\" (UID: \"e4a9d63e-57b2-4802-af8f-129bec591013\") "
Aug 04 17:58:03.071695 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.071688    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p575d\" (UniqueName: \"kubernetes.io/projected/8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887-kube-api-access-p575d\") pod \"kuadrant-operator-controller-manager-68cf589589-6kx82\" (UID: \"8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"
Aug 04 17:58:03.071770 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.071722    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-6kx82\" (UID: \"8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"
Aug 04 17:58:03.071885 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.071858    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4a9d63e-57b2-4802-af8f-129bec591013-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e4a9d63e-57b2-4802-af8f-129bec591013" (UID: "e4a9d63e-57b2-4802-af8f-129bec591013"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:58:03.072063 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.072036    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-6kx82\" (UID: \"8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"
Aug 04 17:58:03.073659 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.073639    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4a9d63e-57b2-4802-af8f-129bec591013-kube-api-access-4h74c" (OuterVolumeSpecName: "kube-api-access-4h74c") pod "e4a9d63e-57b2-4802-af8f-129bec591013" (UID: "e4a9d63e-57b2-4802-af8f-129bec591013"). InnerVolumeSpecName "kube-api-access-4h74c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:58:03.080130 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.080107    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p575d\" (UniqueName: \"kubernetes.io/projected/8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887-kube-api-access-p575d\") pod \"kuadrant-operator-controller-manager-68cf589589-6kx82\" (UID: \"8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"
Aug 04 17:58:03.172509 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.172475    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4a9d63e-57b2-4802-af8f-129bec591013-extensions-socket-volume\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:58:03.172509 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.172502    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h74c\" (UniqueName: \"kubernetes.io/projected/e4a9d63e-57b2-4802-af8f-129bec591013-kube-api-access-4h74c\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:58:03.209392 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.209366    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"
Aug 04 17:58:03.345102 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.345075    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"]
Aug 04 17:58:03.346374 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:58:03.346339    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a0b2b0e_d2e5_4675_8d1d_4d5ff9aa9887.slice/crio-0c7c583bc65f756bd7c1b3dcc5d2bde5123911592ac56cb1ad6ee5a91783333f WatchSource:0}: Error finding container 0c7c583bc65f756bd7c1b3dcc5d2bde5123911592ac56cb1ad6ee5a91783333f: Status 404 returned error can't find the container with id 0c7c583bc65f756bd7c1b3dcc5d2bde5123911592ac56cb1ad6ee5a91783333f
Aug 04 17:58:03.547837 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.547732    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82" event={"ID":"8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887","Type":"ContainerStarted","Data":"806ad18fe828479251ca35ec46ee4bf24100a2cd8f35d7d67f58c82c4c6a1075"}
Aug 04 17:58:03.547837 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.547803    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82" event={"ID":"8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887","Type":"ContainerStarted","Data":"0c7c583bc65f756bd7c1b3dcc5d2bde5123911592ac56cb1ad6ee5a91783333f"}
Aug 04 17:58:03.548071 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.547952    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"
Aug 04 17:58:03.549232 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.549209    2572 generic.go:356] "Generic (PLEG): container finished" podID="e4a9d63e-57b2-4802-af8f-129bec591013" containerID="9545b41d39232e13d6e063bc5414654eee6335252125b0adf905be34b4b9b491" exitCode=0
Aug 04 17:58:03.549347 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.549245    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"
Aug 04 17:58:03.549347 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.549291    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb" event={"ID":"e4a9d63e-57b2-4802-af8f-129bec591013","Type":"ContainerDied","Data":"9545b41d39232e13d6e063bc5414654eee6335252125b0adf905be34b4b9b491"}
Aug 04 17:58:03.549347 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.549332    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb" event={"ID":"e4a9d63e-57b2-4802-af8f-129bec591013","Type":"ContainerDied","Data":"d275467a2d6f235e17297b7aaa14b5781cd7ba38bb1b518a4b296fcc780ad416"}
Aug 04 17:58:03.549467 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.549360    2572 scope.go:117] "RemoveContainer" containerID="9545b41d39232e13d6e063bc5414654eee6335252125b0adf905be34b4b9b491"
Aug 04 17:58:03.558379 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.558361    2572 scope.go:117] "RemoveContainer" containerID="9545b41d39232e13d6e063bc5414654eee6335252125b0adf905be34b4b9b491"
Aug 04 17:58:03.558633 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:58:03.558613    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9545b41d39232e13d6e063bc5414654eee6335252125b0adf905be34b4b9b491\": container with ID starting with 9545b41d39232e13d6e063bc5414654eee6335252125b0adf905be34b4b9b491 not found: ID does not exist" containerID="9545b41d39232e13d6e063bc5414654eee6335252125b0adf905be34b4b9b491"
Aug 04 17:58:03.558693 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.558640    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9545b41d39232e13d6e063bc5414654eee6335252125b0adf905be34b4b9b491"} err="failed to get container status \"9545b41d39232e13d6e063bc5414654eee6335252125b0adf905be34b4b9b491\": rpc error: code = NotFound desc = could not find container \"9545b41d39232e13d6e063bc5414654eee6335252125b0adf905be34b4b9b491\": container with ID starting with 9545b41d39232e13d6e063bc5414654eee6335252125b0adf905be34b4b9b491 not found: ID does not exist"
Aug 04 17:58:03.567880 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.567840    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82" podStartSLOduration=1.5678281200000002 podStartE2EDuration="1.56782812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:58:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:58:03.565522728 +0000 UTC m=+668.475412340" watchObservedRunningTime="2026-08-04 17:58:03.56782812 +0000 UTC m=+668.477717707"
Aug 04 17:58:03.583119 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.583095    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"]
Aug 04 17:58:03.602293 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:03.602272    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t4khb"]
Aug 04 17:58:05.599214 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:05.599180    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4a9d63e-57b2-4802-af8f-129bec591013" path="/var/lib/kubelet/pods/e4a9d63e-57b2-4802-af8f-129bec591013/volumes"
Aug 04 17:58:14.557543 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:14.557513    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"
Aug 04 17:58:35.241318 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.241269    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 17:58:35.241967 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.241946    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4a9d63e-57b2-4802-af8f-129bec591013" containerName="manager"
Aug 04 17:58:35.242047 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.241970    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4a9d63e-57b2-4802-af8f-129bec591013" containerName="manager"
Aug 04 17:58:35.242087 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.242070    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4a9d63e-57b2-4802-af8f-129bec591013" containerName="manager"
Aug 04 17:58:35.244727 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.244711    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"
Aug 04 17:58:35.247200 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.247178    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 04 17:58:35.252458 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.252361    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 17:58:35.281216 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.281181    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 17:58:35.348281 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.348230    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxhgz\" (UniqueName: \"kubernetes.io/projected/6becd9bf-c47b-45e7-8d5a-f199fe3fd6e6-kube-api-access-fxhgz\") pod \"limitador-limitador-85d9db4d5d-tpbnv\" (UID: \"6becd9bf-c47b-45e7-8d5a-f199fe3fd6e6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"
Aug 04 17:58:35.348281 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.348274    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6becd9bf-c47b-45e7-8d5a-f199fe3fd6e6-config-file\") pod \"limitador-limitador-85d9db4d5d-tpbnv\" (UID: \"6becd9bf-c47b-45e7-8d5a-f199fe3fd6e6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"
Aug 04 17:58:35.449248 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.449213    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhgz\" (UniqueName: \"kubernetes.io/projected/6becd9bf-c47b-45e7-8d5a-f199fe3fd6e6-kube-api-access-fxhgz\") pod \"limitador-limitador-85d9db4d5d-tpbnv\" (UID: \"6becd9bf-c47b-45e7-8d5a-f199fe3fd6e6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"
Aug 04 17:58:35.449248 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.449253    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6becd9bf-c47b-45e7-8d5a-f199fe3fd6e6-config-file\") pod \"limitador-limitador-85d9db4d5d-tpbnv\" (UID: \"6becd9bf-c47b-45e7-8d5a-f199fe3fd6e6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"
Aug 04 17:58:35.449853 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.449833    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6becd9bf-c47b-45e7-8d5a-f199fe3fd6e6-config-file\") pod \"limitador-limitador-85d9db4d5d-tpbnv\" (UID: \"6becd9bf-c47b-45e7-8d5a-f199fe3fd6e6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"
Aug 04 17:58:35.458310 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.458287    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxhgz\" (UniqueName: \"kubernetes.io/projected/6becd9bf-c47b-45e7-8d5a-f199fe3fd6e6-kube-api-access-fxhgz\") pod \"limitador-limitador-85d9db4d5d-tpbnv\" (UID: \"6becd9bf-c47b-45e7-8d5a-f199fe3fd6e6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"
Aug 04 17:58:35.555586 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.555558    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"
Aug 04 17:58:35.671902 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.671831    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-kmwsp"]
Aug 04 17:58:35.675692 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.675670    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-kmwsp"
Aug 04 17:58:35.678300 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.678280    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cjfjt\""
Aug 04 17:58:35.681868 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.681814    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-kmwsp"]
Aug 04 17:58:35.700392 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.700368    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 17:58:35.703063 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:58:35.703036    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6becd9bf_c47b_45e7_8d5a_f199fe3fd6e6.slice/crio-18b623f47cfadce72195baac7ddad490da805bcac5f65740989c553b590b6ad6 WatchSource:0}: Error finding container 18b623f47cfadce72195baac7ddad490da805bcac5f65740989c553b590b6ad6: Status 404 returned error can't find the container with id 18b623f47cfadce72195baac7ddad490da805bcac5f65740989c553b590b6ad6
Aug 04 17:58:35.718994 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.718966    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv" event={"ID":"6becd9bf-c47b-45e7-8d5a-f199fe3fd6e6","Type":"ContainerStarted","Data":"18b623f47cfadce72195baac7ddad490da805bcac5f65740989c553b590b6ad6"}
Aug 04 17:58:35.752231 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.752194    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzsbj\" (UniqueName: \"kubernetes.io/projected/2fcf9396-4092-45c6-beeb-6936a06a8f03-kube-api-access-bzsbj\") pod \"authorino-b54df94b4-kmwsp\" (UID: \"2fcf9396-4092-45c6-beeb-6936a06a8f03\") " pod="kuadrant-system/authorino-b54df94b4-kmwsp"
Aug 04 17:58:35.853415 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.853330    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzsbj\" (UniqueName: \"kubernetes.io/projected/2fcf9396-4092-45c6-beeb-6936a06a8f03-kube-api-access-bzsbj\") pod \"authorino-b54df94b4-kmwsp\" (UID: \"2fcf9396-4092-45c6-beeb-6936a06a8f03\") " pod="kuadrant-system/authorino-b54df94b4-kmwsp"
Aug 04 17:58:35.878570 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.878534    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzsbj\" (UniqueName: \"kubernetes.io/projected/2fcf9396-4092-45c6-beeb-6936a06a8f03-kube-api-access-bzsbj\") pod \"authorino-b54df94b4-kmwsp\" (UID: \"2fcf9396-4092-45c6-beeb-6936a06a8f03\") " pod="kuadrant-system/authorino-b54df94b4-kmwsp"
Aug 04 17:58:35.988735 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:35.988701    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-kmwsp"
Aug 04 17:58:36.117215 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:36.117189    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-kmwsp"]
Aug 04 17:58:36.118843 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:58:36.118818    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fcf9396_4092_45c6_beeb_6936a06a8f03.slice/crio-5997405a703f93c876d8c0be9173b15d469c9ade3f608e9b287f576a38f0f8e8 WatchSource:0}: Error finding container 5997405a703f93c876d8c0be9173b15d469c9ade3f608e9b287f576a38f0f8e8: Status 404 returned error can't find the container with id 5997405a703f93c876d8c0be9173b15d469c9ade3f608e9b287f576a38f0f8e8
Aug 04 17:58:36.733104 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:36.733064    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-kmwsp" event={"ID":"2fcf9396-4092-45c6-beeb-6936a06a8f03","Type":"ContainerStarted","Data":"5997405a703f93c876d8c0be9173b15d469c9ade3f608e9b287f576a38f0f8e8"}
Aug 04 17:58:37.741323 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:37.741283    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv" event={"ID":"6becd9bf-c47b-45e7-8d5a-f199fe3fd6e6","Type":"ContainerStarted","Data":"a94e405d9c3aad43614b810b9b05811dcc600a0c3d624c1b92a9e85f4d957398"}
Aug 04 17:58:37.741745 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:37.741371    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"
Aug 04 17:58:37.757508 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:37.757459    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv" podStartSLOduration=1.47926347 podStartE2EDuration="2.757440405s" totalImagesPullingTime="1.278176935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:58:37.756029418 +0000 UTC m=+702.665919042" watchObservedRunningTime="2026-08-04 17:58:37.757440405 +0000 UTC m=+702.667329990"
Aug 04 17:58:38.748819 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:38.748775    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-kmwsp" event={"ID":"2fcf9396-4092-45c6-beeb-6936a06a8f03","Type":"ContainerStarted","Data":"14b1a9782dc894b158599e23ad932b4b51e4cf88cb3bc010bdc53809bcd5db37"}
Aug 04 17:58:38.763663 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:38.763619    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-kmwsp" podStartSLOduration=1.6403527420000001 podStartE2EDuration="3.763604604s" totalImagesPullingTime="2.123251862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:58:38.762426541 +0000 UTC m=+703.672316130" watchObservedRunningTime="2026-08-04 17:58:38.763604604 +0000 UTC m=+703.673494191"
Aug 04 17:58:40.309022 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:40.308988    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-kmwsp"]
Aug 04 17:58:40.759991 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:40.759885    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-kmwsp" podUID="2fcf9396-4092-45c6-beeb-6936a06a8f03" containerName="authorino" containerID="cri-o://14b1a9782dc894b158599e23ad932b4b51e4cf88cb3bc010bdc53809bcd5db37" gracePeriod=30
Aug 04 17:58:41.008369 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:41.008342    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-kmwsp"
Aug 04 17:58:41.099667 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:41.099631    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzsbj\" (UniqueName: \"kubernetes.io/projected/2fcf9396-4092-45c6-beeb-6936a06a8f03-kube-api-access-bzsbj\") pod \"2fcf9396-4092-45c6-beeb-6936a06a8f03\" (UID: \"2fcf9396-4092-45c6-beeb-6936a06a8f03\") "
Aug 04 17:58:41.101597 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:41.101574    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fcf9396-4092-45c6-beeb-6936a06a8f03-kube-api-access-bzsbj" (OuterVolumeSpecName: "kube-api-access-bzsbj") pod "2fcf9396-4092-45c6-beeb-6936a06a8f03" (UID: "2fcf9396-4092-45c6-beeb-6936a06a8f03"). InnerVolumeSpecName "kube-api-access-bzsbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:58:41.200638 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:41.200608    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzsbj\" (UniqueName: \"kubernetes.io/projected/2fcf9396-4092-45c6-beeb-6936a06a8f03-kube-api-access-bzsbj\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:58:41.769291 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:41.769252    2572 generic.go:356] "Generic (PLEG): container finished" podID="2fcf9396-4092-45c6-beeb-6936a06a8f03" containerID="14b1a9782dc894b158599e23ad932b4b51e4cf88cb3bc010bdc53809bcd5db37" exitCode=0
Aug 04 17:58:41.769690 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:41.769299    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-kmwsp"
Aug 04 17:58:41.769690 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:41.769339    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-kmwsp" event={"ID":"2fcf9396-4092-45c6-beeb-6936a06a8f03","Type":"ContainerDied","Data":"14b1a9782dc894b158599e23ad932b4b51e4cf88cb3bc010bdc53809bcd5db37"}
Aug 04 17:58:41.769690 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:41.769383    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-kmwsp" event={"ID":"2fcf9396-4092-45c6-beeb-6936a06a8f03","Type":"ContainerDied","Data":"5997405a703f93c876d8c0be9173b15d469c9ade3f608e9b287f576a38f0f8e8"}
Aug 04 17:58:41.769690 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:41.769403    2572 scope.go:117] "RemoveContainer" containerID="14b1a9782dc894b158599e23ad932b4b51e4cf88cb3bc010bdc53809bcd5db37"
Aug 04 17:58:41.778122 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:41.778106    2572 scope.go:117] "RemoveContainer" containerID="14b1a9782dc894b158599e23ad932b4b51e4cf88cb3bc010bdc53809bcd5db37"
Aug 04 17:58:41.778371 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:58:41.778353    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14b1a9782dc894b158599e23ad932b4b51e4cf88cb3bc010bdc53809bcd5db37\": container with ID starting with 14b1a9782dc894b158599e23ad932b4b51e4cf88cb3bc010bdc53809bcd5db37 not found: ID does not exist" containerID="14b1a9782dc894b158599e23ad932b4b51e4cf88cb3bc010bdc53809bcd5db37"
Aug 04 17:58:41.778428 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:41.778379    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14b1a9782dc894b158599e23ad932b4b51e4cf88cb3bc010bdc53809bcd5db37"} err="failed to get container status \"14b1a9782dc894b158599e23ad932b4b51e4cf88cb3bc010bdc53809bcd5db37\": rpc error: code = NotFound desc = could not find container \"14b1a9782dc894b158599e23ad932b4b51e4cf88cb3bc010bdc53809bcd5db37\": container with ID starting with 14b1a9782dc894b158599e23ad932b4b51e4cf88cb3bc010bdc53809bcd5db37 not found: ID does not exist"
Aug 04 17:58:41.784723 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:41.784693    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-kmwsp"]
Aug 04 17:58:41.788073 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:41.788052    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-kmwsp"]
Aug 04 17:58:43.598860 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:43.598822    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fcf9396-4092-45c6-beeb-6936a06a8f03" path="/var/lib/kubelet/pods/2fcf9396-4092-45c6-beeb-6936a06a8f03/volumes"
Aug 04 17:58:48.750291 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:58:48.750215    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"
Aug 04 17:59:05.614628 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:05.614586    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wssn7"]
Aug 04 17:59:05.615069 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:05.615011    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fcf9396-4092-45c6-beeb-6936a06a8f03" containerName="authorino"
Aug 04 17:59:05.615069 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:05.615024    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fcf9396-4092-45c6-beeb-6936a06a8f03" containerName="authorino"
Aug 04 17:59:05.615144 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:05.615101    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fcf9396-4092-45c6-beeb-6936a06a8f03" containerName="authorino"
Aug 04 17:59:05.619489 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:05.619471    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-wssn7"
Aug 04 17:59:05.621754 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:05.621732    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cjfjt\""
Aug 04 17:59:05.624596 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:05.624572    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wssn7"]
Aug 04 17:59:05.715429 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:05.715397    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6gwn\" (UniqueName: \"kubernetes.io/projected/9ffe6821-a497-430b-bb6e-42fa88d6630f-kube-api-access-l6gwn\") pod \"authorino-5dc7ccb5f-wssn7\" (UID: \"9ffe6821-a497-430b-bb6e-42fa88d6630f\") " pod="kuadrant-system/authorino-5dc7ccb5f-wssn7"
Aug 04 17:59:05.816061 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:05.816020    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6gwn\" (UniqueName: \"kubernetes.io/projected/9ffe6821-a497-430b-bb6e-42fa88d6630f-kube-api-access-l6gwn\") pod \"authorino-5dc7ccb5f-wssn7\" (UID: \"9ffe6821-a497-430b-bb6e-42fa88d6630f\") " pod="kuadrant-system/authorino-5dc7ccb5f-wssn7"
Aug 04 17:59:05.824869 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:05.824837    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6gwn\" (UniqueName: \"kubernetes.io/projected/9ffe6821-a497-430b-bb6e-42fa88d6630f-kube-api-access-l6gwn\") pod \"authorino-5dc7ccb5f-wssn7\" (UID: \"9ffe6821-a497-430b-bb6e-42fa88d6630f\") " pod="kuadrant-system/authorino-5dc7ccb5f-wssn7"
Aug 04 17:59:05.888110 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:05.888040    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wssn7"]
Aug 04 17:59:05.888292 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:05.888278    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-wssn7"
Aug 04 17:59:05.917443 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:05.917413    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7cd99d5577-7rs9j"]
Aug 04 17:59:05.922149 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:05.922127    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cd99d5577-7rs9j"
Aug 04 17:59:05.928737 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:05.928711    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cd99d5577-7rs9j"]
Aug 04 17:59:05.966312 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:05.966283    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7cd99d5577-7rs9j"]
Aug 04 17:59:05.966769 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:59:05.966737    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mkhrr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7cd99d5577-7rs9j" podUID="e5b43c6f-378d-41d2-a576-2db6fef93a7e"
Aug 04 17:59:06.018477 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:06.018441    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkhrr\" (UniqueName: \"kubernetes.io/projected/e5b43c6f-378d-41d2-a576-2db6fef93a7e-kube-api-access-mkhrr\") pod \"authorino-7cd99d5577-7rs9j\" (UID: \"e5b43c6f-378d-41d2-a576-2db6fef93a7e\") " pod="kuadrant-system/authorino-7cd99d5577-7rs9j"
Aug 04 17:59:06.027805 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:06.027776    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wssn7"]
Aug 04 17:59:06.029601 ip-10-0-141-117 kubenswrapper[2572]: W0804 17:59:06.029569    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ffe6821_a497_430b_bb6e_42fa88d6630f.slice/crio-ccfa3df6128f56659cdbba99f8fa9faa08751951bac797c412c781b9cde17169 WatchSource:0}: Error finding container ccfa3df6128f56659cdbba99f8fa9faa08751951bac797c412c781b9cde17169: Status 404 returned error can't find the container with id ccfa3df6128f56659cdbba99f8fa9faa08751951bac797c412c781b9cde17169
Aug 04 17:59:06.119342 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:06.119309    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkhrr\" (UniqueName: \"kubernetes.io/projected/e5b43c6f-378d-41d2-a576-2db6fef93a7e-kube-api-access-mkhrr\") pod \"authorino-7cd99d5577-7rs9j\" (UID: \"e5b43c6f-378d-41d2-a576-2db6fef93a7e\") " pod="kuadrant-system/authorino-7cd99d5577-7rs9j"
Aug 04 17:59:06.126508 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:06.126487    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkhrr\" (UniqueName: \"kubernetes.io/projected/e5b43c6f-378d-41d2-a576-2db6fef93a7e-kube-api-access-mkhrr\") pod \"authorino-7cd99d5577-7rs9j\" (UID: \"e5b43c6f-378d-41d2-a576-2db6fef93a7e\") " pod="kuadrant-system/authorino-7cd99d5577-7rs9j"
Aug 04 17:59:06.906198 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:06.906158    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-wssn7" event={"ID":"9ffe6821-a497-430b-bb6e-42fa88d6630f","Type":"ContainerStarted","Data":"58082f69bece59a898fb231f03e39ff7858c98395f6112c72849bae14e22f958"}
Aug 04 17:59:06.906198 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:06.906184    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cd99d5577-7rs9j"
Aug 04 17:59:06.906637 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:06.906209    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-wssn7" event={"ID":"9ffe6821-a497-430b-bb6e-42fa88d6630f","Type":"ContainerStarted","Data":"ccfa3df6128f56659cdbba99f8fa9faa08751951bac797c412c781b9cde17169"}
Aug 04 17:59:06.906637 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:06.906211    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5dc7ccb5f-wssn7" podUID="9ffe6821-a497-430b-bb6e-42fa88d6630f" containerName="authorino" containerID="cri-o://58082f69bece59a898fb231f03e39ff7858c98395f6112c72849bae14e22f958" gracePeriod=30
Aug 04 17:59:06.913589 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:06.913570    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cd99d5577-7rs9j"
Aug 04 17:59:06.921992 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:06.921953    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dc7ccb5f-wssn7" podStartSLOduration=1.475085295 podStartE2EDuration="1.921940703s" totalImagesPullingTime="446.855408ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:59:06.919992154 +0000 UTC m=+731.829881742" watchObservedRunningTime="2026-08-04 17:59:06.921940703 +0000 UTC m=+731.831830284"
Aug 04 17:59:07.027076 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.027050    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkhrr\" (UniqueName: \"kubernetes.io/projected/e5b43c6f-378d-41d2-a576-2db6fef93a7e-kube-api-access-mkhrr\") pod \"e5b43c6f-378d-41d2-a576-2db6fef93a7e\" (UID: \"e5b43c6f-378d-41d2-a576-2db6fef93a7e\") "
Aug 04 17:59:07.028990 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.028959    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5b43c6f-378d-41d2-a576-2db6fef93a7e-kube-api-access-mkhrr" (OuterVolumeSpecName: "kube-api-access-mkhrr") pod "e5b43c6f-378d-41d2-a576-2db6fef93a7e" (UID: "e5b43c6f-378d-41d2-a576-2db6fef93a7e"). InnerVolumeSpecName "kube-api-access-mkhrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:59:07.128669 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.128637    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkhrr\" (UniqueName: \"kubernetes.io/projected/e5b43c6f-378d-41d2-a576-2db6fef93a7e-kube-api-access-mkhrr\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:59:07.162822 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.162761    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-wssn7"
Aug 04 17:59:07.329848 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.329807    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6gwn\" (UniqueName: \"kubernetes.io/projected/9ffe6821-a497-430b-bb6e-42fa88d6630f-kube-api-access-l6gwn\") pod \"9ffe6821-a497-430b-bb6e-42fa88d6630f\" (UID: \"9ffe6821-a497-430b-bb6e-42fa88d6630f\") "
Aug 04 17:59:07.331786 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.331763    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ffe6821-a497-430b-bb6e-42fa88d6630f-kube-api-access-l6gwn" (OuterVolumeSpecName: "kube-api-access-l6gwn") pod "9ffe6821-a497-430b-bb6e-42fa88d6630f" (UID: "9ffe6821-a497-430b-bb6e-42fa88d6630f"). InnerVolumeSpecName "kube-api-access-l6gwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:59:07.431335 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.431249    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6gwn\" (UniqueName: \"kubernetes.io/projected/9ffe6821-a497-430b-bb6e-42fa88d6630f-kube-api-access-l6gwn\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 17:59:07.913018 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.912988    2572 generic.go:356] "Generic (PLEG): container finished" podID="9ffe6821-a497-430b-bb6e-42fa88d6630f" containerID="58082f69bece59a898fb231f03e39ff7858c98395f6112c72849bae14e22f958" exitCode=0
Aug 04 17:59:07.913410 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.913027    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-wssn7"
Aug 04 17:59:07.913410 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.913079    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-wssn7" event={"ID":"9ffe6821-a497-430b-bb6e-42fa88d6630f","Type":"ContainerDied","Data":"58082f69bece59a898fb231f03e39ff7858c98395f6112c72849bae14e22f958"}
Aug 04 17:59:07.913410 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.913119    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-wssn7" event={"ID":"9ffe6821-a497-430b-bb6e-42fa88d6630f","Type":"ContainerDied","Data":"ccfa3df6128f56659cdbba99f8fa9faa08751951bac797c412c781b9cde17169"}
Aug 04 17:59:07.913410 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.913136    2572 scope.go:117] "RemoveContainer" containerID="58082f69bece59a898fb231f03e39ff7858c98395f6112c72849bae14e22f958"
Aug 04 17:59:07.913410 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.913145    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cd99d5577-7rs9j"
Aug 04 17:59:07.922114 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.922040    2572 scope.go:117] "RemoveContainer" containerID="58082f69bece59a898fb231f03e39ff7858c98395f6112c72849bae14e22f958"
Aug 04 17:59:07.922340 ip-10-0-141-117 kubenswrapper[2572]: E0804 17:59:07.922323    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58082f69bece59a898fb231f03e39ff7858c98395f6112c72849bae14e22f958\": container with ID starting with 58082f69bece59a898fb231f03e39ff7858c98395f6112c72849bae14e22f958 not found: ID does not exist" containerID="58082f69bece59a898fb231f03e39ff7858c98395f6112c72849bae14e22f958"
Aug 04 17:59:07.922416 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.922348    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58082f69bece59a898fb231f03e39ff7858c98395f6112c72849bae14e22f958"} err="failed to get container status \"58082f69bece59a898fb231f03e39ff7858c98395f6112c72849bae14e22f958\": rpc error: code = NotFound desc = could not find container \"58082f69bece59a898fb231f03e39ff7858c98395f6112c72849bae14e22f958\": container with ID starting with 58082f69bece59a898fb231f03e39ff7858c98395f6112c72849bae14e22f958 not found: ID does not exist"
Aug 04 17:59:07.938108 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.938089    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wssn7"]
Aug 04 17:59:07.942973 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.942953    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wssn7"]
Aug 04 17:59:07.973249 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.973227    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7cd99d5577-7rs9j"]
Aug 04 17:59:07.983873 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:07.983847    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7cd99d5577-7rs9j"]
Aug 04 17:59:09.600136 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:09.600104    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ffe6821-a497-430b-bb6e-42fa88d6630f" path="/var/lib/kubelet/pods/9ffe6821-a497-430b-bb6e-42fa88d6630f/volumes"
Aug 04 17:59:09.600487 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:09.600422    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5b43c6f-378d-41d2-a576-2db6fef93a7e" path="/var/lib/kubelet/pods/e5b43c6f-378d-41d2-a576-2db6fef93a7e/volumes"
Aug 04 17:59:49.997218 ip-10-0-141-117 kubenswrapper[2572]: I0804 17:59:49.997183    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:00:00.134740 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:00.134708    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764440-8hkgs"]
Aug 04 18:00:00.135135 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:00.135089    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ffe6821-a497-430b-bb6e-42fa88d6630f" containerName="authorino"
Aug 04 18:00:00.135135 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:00.135100    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ffe6821-a497-430b-bb6e-42fa88d6630f" containerName="authorino"
Aug 04 18:00:00.135210 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:00.135173    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ffe6821-a497-430b-bb6e-42fa88d6630f" containerName="authorino"
Aug 04 18:00:00.139345 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:00.139330    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764440-8hkgs"
Aug 04 18:00:00.141722 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:00.141697    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:00:00.144787 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:00.144760    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764440-8hkgs"]
Aug 04 18:00:00.150981 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:00.150960    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764440-8hkgs"
Aug 04 18:00:00.489532 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:00.489509    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764440-8hkgs"]
Aug 04 18:00:00.491638 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:00:00.491614    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod350cd794_23c6_4c7f_8a49_8a47300f6e75.slice/crio-4102be63eb860a34ec76022fe0afb015a877bb90261c84c388abef337da0ffe2 WatchSource:0}: Error finding container 4102be63eb860a34ec76022fe0afb015a877bb90261c84c388abef337da0ffe2: Status 404 returned error can't find the container with id 4102be63eb860a34ec76022fe0afb015a877bb90261c84c388abef337da0ffe2
Aug 04 18:00:01.207545 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:01.207510    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764440-8hkgs" event={"ID":"350cd794-23c6-4c7f-8a49-8a47300f6e75","Type":"ContainerStarted","Data":"4102be63eb860a34ec76022fe0afb015a877bb90261c84c388abef337da0ffe2"}
Aug 04 18:00:05.232173 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:05.232087    2572 generic.go:356] "Generic (PLEG): container finished" podID="350cd794-23c6-4c7f-8a49-8a47300f6e75" containerID="67cb344a65139ffd9f68807e5aca1d55a8babfbb2eab59c768ccce02c1747177" exitCode=0
Aug 04 18:00:05.232173 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:05.232136    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764440-8hkgs" event={"ID":"350cd794-23c6-4c7f-8a49-8a47300f6e75","Type":"ContainerDied","Data":"67cb344a65139ffd9f68807e5aca1d55a8babfbb2eab59c768ccce02c1747177"}
Aug 04 18:00:06.365515 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:06.365490    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764440-8hkgs"
Aug 04 18:00:07.244266 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:07.244237    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764440-8hkgs"
Aug 04 18:00:07.244266 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:07.244255    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764440-8hkgs" event={"ID":"350cd794-23c6-4c7f-8a49-8a47300f6e75","Type":"ContainerDied","Data":"4102be63eb860a34ec76022fe0afb015a877bb90261c84c388abef337da0ffe2"}
Aug 04 18:00:07.244470 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:07.244297    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4102be63eb860a34ec76022fe0afb015a877bb90261c84c388abef337da0ffe2"
Aug 04 18:00:30.294074 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:30.293989    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:00:38.192080 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:38.192044    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:00:51.283057 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.283026    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"]
Aug 04 18:00:51.283527 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.283432    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="350cd794-23c6-4c7f-8a49-8a47300f6e75" containerName="cleanup"
Aug 04 18:00:51.283527 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.283449    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="350cd794-23c6-4c7f-8a49-8a47300f6e75" containerName="cleanup"
Aug 04 18:00:51.283850 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.283813    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="350cd794-23c6-4c7f-8a49-8a47300f6e75" containerName="cleanup"
Aug 04 18:00:51.286849 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.286832    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.290042 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.290019    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 04 18:00:51.290167 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.290067    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b4f56\""
Aug 04 18:00:51.290167 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.290106    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 04 18:00:51.290167 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.290133    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Aug 04 18:00:51.297175 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.297157    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"]
Aug 04 18:00:51.436299 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.436266    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e9ca766-63bb-4f9d-b452-0faa221e53be-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.436453 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.436319    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e9ca766-63bb-4f9d-b452-0faa221e53be-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.436453 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.436348    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs99v\" (UniqueName: \"kubernetes.io/projected/7e9ca766-63bb-4f9d-b452-0faa221e53be-kube-api-access-fs99v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.436453 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.436370    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e9ca766-63bb-4f9d-b452-0faa221e53be-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.436453 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.436391    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e9ca766-63bb-4f9d-b452-0faa221e53be-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.436453 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.436420    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e9ca766-63bb-4f9d-b452-0faa221e53be-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.537186 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.537111    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e9ca766-63bb-4f9d-b452-0faa221e53be-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.537186 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.537156    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs99v\" (UniqueName: \"kubernetes.io/projected/7e9ca766-63bb-4f9d-b452-0faa221e53be-kube-api-access-fs99v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.537393 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.537196    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e9ca766-63bb-4f9d-b452-0faa221e53be-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.537393 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.537233    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e9ca766-63bb-4f9d-b452-0faa221e53be-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.537393 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.537285    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e9ca766-63bb-4f9d-b452-0faa221e53be-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.537393 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.537329    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e9ca766-63bb-4f9d-b452-0faa221e53be-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.537606 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.537574    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e9ca766-63bb-4f9d-b452-0faa221e53be-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.537606 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.537595    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e9ca766-63bb-4f9d-b452-0faa221e53be-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.537707 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.537652    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e9ca766-63bb-4f9d-b452-0faa221e53be-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.539629 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.539603    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e9ca766-63bb-4f9d-b452-0faa221e53be-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.539754 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.539736    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e9ca766-63bb-4f9d-b452-0faa221e53be-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.544664 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.544640    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs99v\" (UniqueName: \"kubernetes.io/projected/7e9ca766-63bb-4f9d-b452-0faa221e53be-kube-api-access-fs99v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vzwhz\" (UID: \"7e9ca766-63bb-4f9d-b452-0faa221e53be\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.596552 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.596523    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:00:51.766059 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:51.766028    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"]
Aug 04 18:00:51.769818 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:00:51.769781    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e9ca766_63bb_4f9d_b452_0faa221e53be.slice/crio-fc46635ff2c82eaba2a448c97e82c47ca092eab9835f39657acb0a492c5177cf WatchSource:0}: Error finding container fc46635ff2c82eaba2a448c97e82c47ca092eab9835f39657acb0a492c5177cf: Status 404 returned error can't find the container with id fc46635ff2c82eaba2a448c97e82c47ca092eab9835f39657acb0a492c5177cf
Aug 04 18:00:52.380121 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:52.380084    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:00:52.506104 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:52.506068    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz" event={"ID":"7e9ca766-63bb-4f9d-b452-0faa221e53be","Type":"ContainerStarted","Data":"fc46635ff2c82eaba2a448c97e82c47ca092eab9835f39657acb0a492c5177cf"}
Aug 04 18:00:53.513080 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:53.513000    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz" event={"ID":"7e9ca766-63bb-4f9d-b452-0faa221e53be","Type":"ContainerStarted","Data":"ea5bfc5276d374b0c08bbc29a35723074fd8f847b364d1384142162bf3f5e0d4"}
Aug 04 18:00:53.531932 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:53.531876    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz" podStartSLOduration=1.213148048 podStartE2EDuration="2.531860718s" totalImagesPullingTime="1.31871267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:00:53.529971095 +0000 UTC m=+838.439860692" watchObservedRunningTime="2026-08-04 18:00:53.531860718 +0000 UTC m=+838.441750342"
Aug 04 18:00:58.575324 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:00:58.575288    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:01:01.599049 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:01.599015    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:01:01.599518 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:01.599075    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:01:01.609399 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:01.609375    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:01:02.573811 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:02.573783    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vzwhz"
Aug 04 18:01:05.274269 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.274237    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"]
Aug 04 18:01:05.278204 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.278183    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.280708 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.280688    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Aug 04 18:01:05.287661 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.287639    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"]
Aug 04 18:01:05.354669 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.354628    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99424fc3-2e45-43f4-aab6-a9257bfd00fc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.354843 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.354681    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx7vn\" (UniqueName: \"kubernetes.io/projected/99424fc3-2e45-43f4-aab6-a9257bfd00fc-kube-api-access-jx7vn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.354843 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.354787    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99424fc3-2e45-43f4-aab6-a9257bfd00fc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.354843 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.354811    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99424fc3-2e45-43f4-aab6-a9257bfd00fc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.354843 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.354831    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99424fc3-2e45-43f4-aab6-a9257bfd00fc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.355050 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.354866    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99424fc3-2e45-43f4-aab6-a9257bfd00fc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.455534 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.455492    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99424fc3-2e45-43f4-aab6-a9257bfd00fc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.455534 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.455532    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99424fc3-2e45-43f4-aab6-a9257bfd00fc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.455789 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.455550    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99424fc3-2e45-43f4-aab6-a9257bfd00fc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.455789 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.455581    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99424fc3-2e45-43f4-aab6-a9257bfd00fc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.455789 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.455626    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99424fc3-2e45-43f4-aab6-a9257bfd00fc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.455789 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.455651    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx7vn\" (UniqueName: \"kubernetes.io/projected/99424fc3-2e45-43f4-aab6-a9257bfd00fc-kube-api-access-jx7vn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.456064 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.456027    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99424fc3-2e45-43f4-aab6-a9257bfd00fc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.456121 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.456063    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99424fc3-2e45-43f4-aab6-a9257bfd00fc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.456200 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.456181    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99424fc3-2e45-43f4-aab6-a9257bfd00fc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.457945 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.457908    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99424fc3-2e45-43f4-aab6-a9257bfd00fc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.458243 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.458227    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99424fc3-2e45-43f4-aab6-a9257bfd00fc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.463055 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.463034    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx7vn\" (UniqueName: \"kubernetes.io/projected/99424fc3-2e45-43f4-aab6-a9257bfd00fc-kube-api-access-jx7vn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mntw\" (UID: \"99424fc3-2e45-43f4-aab6-a9257bfd00fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.590529 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.590495    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:05.725643 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:05.725617    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"]
Aug 04 18:01:05.727777 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:01:05.727748    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99424fc3_2e45_43f4_aab6_a9257bfd00fc.slice/crio-d476ac2919018d73a4e4d8ad7eaa5c100e623ffd2f6717a6208daaa37f941c20 WatchSource:0}: Error finding container d476ac2919018d73a4e4d8ad7eaa5c100e623ffd2f6717a6208daaa37f941c20: Status 404 returned error can't find the container with id d476ac2919018d73a4e4d8ad7eaa5c100e623ffd2f6717a6208daaa37f941c20
Aug 04 18:01:06.586065 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:06.586022    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw" event={"ID":"99424fc3-2e45-43f4-aab6-a9257bfd00fc","Type":"ContainerStarted","Data":"e2ed2f159f4d26c0c9a697027a28f3389efbf43f22c27f5335eacf8e8651266d"}
Aug 04 18:01:06.586462 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:06.586080    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw" event={"ID":"99424fc3-2e45-43f4-aab6-a9257bfd00fc","Type":"ContainerStarted","Data":"d476ac2919018d73a4e4d8ad7eaa5c100e623ffd2f6717a6208daaa37f941c20"}
Aug 04 18:01:06.603257 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:06.603203    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw" podStartSLOduration=1.218230059 podStartE2EDuration="1.603187812s" totalImagesPullingTime="384.957753ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:06.602008965 +0000 UTC m=+851.511898551" watchObservedRunningTime="2026-08-04 18:01:06.603187812 +0000 UTC m=+851.513077414"
Aug 04 18:01:07.407889 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:07.407850    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:01:15.591261 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:15.591216    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:15.591724 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:15.591287    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:15.604356 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:15.604330    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:15.645087 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:15.645060    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mntw"
Aug 04 18:01:15.878309 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:15.878224    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:01:55.528414 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:55.528336    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:01:55.531961 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:01:55.531939    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:02:50.280291 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:02:50.280259    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:02:59.485007 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:02:59.484971    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:03:10.576957 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:03:10.576905    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:04:49.678221 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:04:49.678127    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:04:58.676531 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:04:58.676491    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:05:56.579497 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:05:56.579459    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:06:03.773677 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:06:03.773635    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:06:19.380794 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:06:19.380714    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:06:25.173796 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:06:25.173755    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:06:34.781910 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:06:34.781868    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:06:42.172269 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:06:42.172231    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:06:55.378785 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:06:55.378752    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:06:55.565975 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:06:55.565949    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:06:55.569852 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:06:55.569829    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:07:00.677824 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:07:00.677785    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:07:05.776840 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:07:05.776810    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:07:27.779624 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:07:27.779591    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:07:38.672892 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:07:38.672847    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:08:01.580888 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:08:01.580804    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:08:12.077881 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:08:12.077846    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:08:18.478302 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:08:18.478254    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:08:25.382490 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:08:25.382451    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:08:32.476383 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:08:32.476350    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:08:38.275319 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:08:38.275284    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:08:43.876180 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:08:43.876145    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:08:51.083450 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:08:51.083411    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:09:03.380507 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:09:03.380470    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:09:10.372503 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:09:10.372459    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:09:21.582638 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:09:21.582560    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:09:26.881732 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:09:26.881695    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:09:33.179520 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:09:33.179482    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:09:41.678549 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:09:41.678514    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:09:48.074512 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:09:48.074477    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:09:57.877164 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:09:57.877130    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:10:53.581870 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:53.581791    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"]
Aug 04 18:10:53.582389 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:53.582020    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82" podUID="8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887" containerName="manager" containerID="cri-o://806ad18fe828479251ca35ec46ee4bf24100a2cd8f35d7d67f58c82c4c6a1075" gracePeriod=10
Aug 04 18:10:53.837522 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:53.837457    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"
Aug 04 18:10:53.908653 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:53.908620    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p575d\" (UniqueName: \"kubernetes.io/projected/8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887-kube-api-access-p575d\") pod \"8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887\" (UID: \"8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887\") "
Aug 04 18:10:53.908815 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:53.908662    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887-extensions-socket-volume\") pod \"8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887\" (UID: \"8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887\") "
Aug 04 18:10:53.909119 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:53.909092    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887" (UID: "8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:10:53.910725 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:53.910688    2572 generic.go:356] "Generic (PLEG): container finished" podID="8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887" containerID="806ad18fe828479251ca35ec46ee4bf24100a2cd8f35d7d67f58c82c4c6a1075" exitCode=0
Aug 04 18:10:53.910844 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:53.910732    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"
Aug 04 18:10:53.910844 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:53.910771    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82" event={"ID":"8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887","Type":"ContainerDied","Data":"806ad18fe828479251ca35ec46ee4bf24100a2cd8f35d7d67f58c82c4c6a1075"}
Aug 04 18:10:53.910936 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:53.910844    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82" event={"ID":"8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887","Type":"ContainerDied","Data":"0c7c583bc65f756bd7c1b3dcc5d2bde5123911592ac56cb1ad6ee5a91783333f"}
Aug 04 18:10:53.910936 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:53.910877    2572 scope.go:117] "RemoveContainer" containerID="806ad18fe828479251ca35ec46ee4bf24100a2cd8f35d7d67f58c82c4c6a1075"
Aug 04 18:10:53.911120 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:53.911093    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887-kube-api-access-p575d" (OuterVolumeSpecName: "kube-api-access-p575d") pod "8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887" (UID: "8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887"). InnerVolumeSpecName "kube-api-access-p575d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:10:53.923308 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:53.923280    2572 scope.go:117] "RemoveContainer" containerID="806ad18fe828479251ca35ec46ee4bf24100a2cd8f35d7d67f58c82c4c6a1075"
Aug 04 18:10:53.923600 ip-10-0-141-117 kubenswrapper[2572]: E0804 18:10:53.923582    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"806ad18fe828479251ca35ec46ee4bf24100a2cd8f35d7d67f58c82c4c6a1075\": container with ID starting with 806ad18fe828479251ca35ec46ee4bf24100a2cd8f35d7d67f58c82c4c6a1075 not found: ID does not exist" containerID="806ad18fe828479251ca35ec46ee4bf24100a2cd8f35d7d67f58c82c4c6a1075"
Aug 04 18:10:53.923652 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:53.923607    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"806ad18fe828479251ca35ec46ee4bf24100a2cd8f35d7d67f58c82c4c6a1075"} err="failed to get container status \"806ad18fe828479251ca35ec46ee4bf24100a2cd8f35d7d67f58c82c4c6a1075\": rpc error: code = NotFound desc = could not find container \"806ad18fe828479251ca35ec46ee4bf24100a2cd8f35d7d67f58c82c4c6a1075\": container with ID starting with 806ad18fe828479251ca35ec46ee4bf24100a2cd8f35d7d67f58c82c4c6a1075 not found: ID does not exist"
Aug 04 18:10:54.009663 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:54.009625    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p575d\" (UniqueName: \"kubernetes.io/projected/8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887-kube-api-access-p575d\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:10:54.009663 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:54.009654    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887-extensions-socket-volume\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:10:54.233206 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:54.233171    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"]
Aug 04 18:10:54.237960 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:54.237934    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6kx82"]
Aug 04 18:10:55.599683 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:10:55.599652    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887" path="/var/lib/kubelet/pods/8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887/volumes"
Aug 04 18:11:54.382164 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:54.382118    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"]
Aug 04 18:11:54.382752 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:54.382509    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887" containerName="manager"
Aug 04 18:11:54.382752 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:54.382522    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887" containerName="manager"
Aug 04 18:11:54.382752 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:54.382595    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a0b2b0e-d2e5-4675-8d1d-4d5ff9aa9887" containerName="manager"
Aug 04 18:11:54.385603 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:54.385584    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"
Aug 04 18:11:54.393972 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:54.393949    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ttcms\""
Aug 04 18:11:54.405604 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:54.405576    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"]
Aug 04 18:11:54.458706 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:54.458669    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/191d76ab-8a00-4e9e-87d3-3a941d5e12a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-99jtw\" (UID: \"191d76ab-8a00-4e9e-87d3-3a941d5e12a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"
Aug 04 18:11:54.458873 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:54.458738    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfscc\" (UniqueName: \"kubernetes.io/projected/191d76ab-8a00-4e9e-87d3-3a941d5e12a0-kube-api-access-gfscc\") pod \"kuadrant-operator-controller-manager-68cf589589-99jtw\" (UID: \"191d76ab-8a00-4e9e-87d3-3a941d5e12a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"
Aug 04 18:11:54.559556 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:54.559515    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/191d76ab-8a00-4e9e-87d3-3a941d5e12a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-99jtw\" (UID: \"191d76ab-8a00-4e9e-87d3-3a941d5e12a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"
Aug 04 18:11:54.559735 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:54.559595    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfscc\" (UniqueName: \"kubernetes.io/projected/191d76ab-8a00-4e9e-87d3-3a941d5e12a0-kube-api-access-gfscc\") pod \"kuadrant-operator-controller-manager-68cf589589-99jtw\" (UID: \"191d76ab-8a00-4e9e-87d3-3a941d5e12a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"
Aug 04 18:11:54.559914 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:54.559891    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/191d76ab-8a00-4e9e-87d3-3a941d5e12a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-99jtw\" (UID: \"191d76ab-8a00-4e9e-87d3-3a941d5e12a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"
Aug 04 18:11:54.568697 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:54.568675    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfscc\" (UniqueName: \"kubernetes.io/projected/191d76ab-8a00-4e9e-87d3-3a941d5e12a0-kube-api-access-gfscc\") pod \"kuadrant-operator-controller-manager-68cf589589-99jtw\" (UID: \"191d76ab-8a00-4e9e-87d3-3a941d5e12a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"
Aug 04 18:11:54.696573 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:54.696494    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"
Aug 04 18:11:54.835959 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:54.835906    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"]
Aug 04 18:11:54.837978 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:11:54.837949    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod191d76ab_8a00_4e9e_87d3_3a941d5e12a0.slice/crio-9dc2a3bdbdd60b0cf51c113a8d54d549c4a81527cfb2e49a7a635d27b5c7766e WatchSource:0}: Error finding container 9dc2a3bdbdd60b0cf51c113a8d54d549c4a81527cfb2e49a7a635d27b5c7766e: Status 404 returned error can't find the container with id 9dc2a3bdbdd60b0cf51c113a8d54d549c4a81527cfb2e49a7a635d27b5c7766e
Aug 04 18:11:55.245416 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:55.245376    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw" event={"ID":"191d76ab-8a00-4e9e-87d3-3a941d5e12a0","Type":"ContainerStarted","Data":"f9aacb6aeb9ef02ce5e886ca725bbfe97281caaa06536a16d4857791f6f876bd"}
Aug 04 18:11:55.245620 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:55.245462    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw" event={"ID":"191d76ab-8a00-4e9e-87d3-3a941d5e12a0","Type":"ContainerStarted","Data":"9dc2a3bdbdd60b0cf51c113a8d54d549c4a81527cfb2e49a7a635d27b5c7766e"}
Aug 04 18:11:55.245620 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:55.245484    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"
Aug 04 18:11:55.268550 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:55.268505    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw" podStartSLOduration=1.268492148 podStartE2EDuration="1.268492148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:11:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:55.264657413 +0000 UTC m=+1500.174547003" watchObservedRunningTime="2026-08-04 18:11:55.268492148 +0000 UTC m=+1500.178381738"
Aug 04 18:11:55.607374 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:55.607349    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:11:55.616598 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:11:55.616574    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:12:06.252870 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:12:06.252838    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"
Aug 04 18:12:15.986167 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:12:15.986129    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:12:21.078713 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:12:21.078631    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:12:44.880369 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:12:44.880325    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:12:59.579224 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:12:59.579189    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:13:05.478302 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:13:05.478259    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:13:15.682539 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:13:15.682503    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:13:22.079695 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:13:22.079654    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:13:31.675858 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:13:31.675807    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:13:36.882994 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:13:36.882959    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:13:47.078069 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:13:47.078030    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:13:52.674801 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:13:52.674767    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:14:02.474006 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:14:02.473972    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:14:08.873622 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:14:08.873589    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:14:18.177535 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:14:18.177501    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:14:40.481398 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:14:40.481364    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:14:47.874435 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:14:47.874402    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:15:22.082877 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:15:22.082792    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:15:36.581755 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:15:36.581708    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:16:15.877111 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:16:15.877075    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:16:25.072995 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:16:25.072957    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:16:29.778141 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:16:29.778103    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:16:35.973875 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:16:35.973839    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:16:45.975079 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:16:45.975044    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:16:52.375484 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:16:52.375400    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:16:55.648316 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:16:55.648286    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:16:55.657981 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:16:55.657962    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:16:58.983538 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:16:58.983500    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:17:05.082389 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:17:05.082353    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:17:08.779002 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:17:08.778970    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:17:23.581497 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:17:23.581459    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:17:30.374998 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:17:30.374962    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:17:45.986340 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:17:45.986302    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:17:52.278989 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:17:52.278949    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:18:04.678070 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:18:04.678038    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:18:11.075274 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:18:11.075239    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:18:17.406359 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:18:17.406281    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:18:22.473906 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:18:22.473868    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:18:29.877122 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:18:29.877085    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:18:39.199886 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:18:39.199854    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:18:45.173483 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:18:45.173443    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:18:56.076644 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:18:56.076611    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:19:02.179185 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:19:02.179149    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:19:12.975231 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:19:12.975192    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:19:28.077728 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:19:28.077691    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:19:33.978628 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:19:33.978593    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:19:39.974158 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:19:39.974120    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:19:51.790568 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:19:51.790491    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:20:00.276110 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:00.276074    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:20:05.075324 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:05.075284    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:20:19.782952 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:19.782897    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:20:41.209252 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:41.209215    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw"]
Aug 04 18:20:41.212904 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:41.212888    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw"
Aug 04 18:20:41.216126 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:41.216106    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:20:41.216219 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:41.216178    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:20:41.222703 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:41.222683    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw"]
Aug 04 18:20:41.401769 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:41.401740    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee55d1c-12b5-4320-b86b-26b759796c2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a208c700-fzpbw\" (UID: \"2ee55d1c-12b5-4320-b86b-26b759796c2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw"
Aug 04 18:20:41.503120 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:41.503040    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee55d1c-12b5-4320-b86b-26b759796c2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a208c700-fzpbw\" (UID: \"2ee55d1c-12b5-4320-b86b-26b759796c2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw"
Aug 04 18:20:41.503604 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:41.503583    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee55d1c-12b5-4320-b86b-26b759796c2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a208c700-fzpbw\" (UID: \"2ee55d1c-12b5-4320-b86b-26b759796c2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw"
Aug 04 18:20:41.525080 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:41.525058    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw"
Aug 04 18:20:41.661279 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:41.661251    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw"]
Aug 04 18:20:41.662941 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:20:41.662887    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ee55d1c_12b5_4320_b86b_26b759796c2a.slice/crio-7524b27e842bdfb4103f0ce05aad2e4d10db1ac90cddebb997f2105b51cc99e9 WatchSource:0}: Error finding container 7524b27e842bdfb4103f0ce05aad2e4d10db1ac90cddebb997f2105b51cc99e9: Status 404 returned error can't find the container with id 7524b27e842bdfb4103f0ce05aad2e4d10db1ac90cddebb997f2105b51cc99e9
Aug 04 18:20:42.218086 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:42.217994    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw" event={"ID":"2ee55d1c-12b5-4320-b86b-26b759796c2a","Type":"ContainerStarted","Data":"0ad3624f5fec9b47c5b5d11768db153970052b6f328fa597eaf281c6267cfb71"}
Aug 04 18:20:42.218086 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:42.218061    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw" event={"ID":"2ee55d1c-12b5-4320-b86b-26b759796c2a","Type":"ContainerStarted","Data":"7524b27e842bdfb4103f0ce05aad2e4d10db1ac90cddebb997f2105b51cc99e9"}
Aug 04 18:20:42.233403 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:42.233356    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw" podStartSLOduration=1.233342007 podStartE2EDuration="1.233342007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:20:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:20:42.230544802 +0000 UTC m=+2027.140434389" watchObservedRunningTime="2026-08-04 18:20:42.233342007 +0000 UTC m=+2027.143231595"
Aug 04 18:20:43.224913 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:43.224876    2572 generic.go:356] "Generic (PLEG): container finished" podID="2ee55d1c-12b5-4320-b86b-26b759796c2a" containerID="0ad3624f5fec9b47c5b5d11768db153970052b6f328fa597eaf281c6267cfb71" exitCode=0
Aug 04 18:20:43.225294 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:43.224959    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw" event={"ID":"2ee55d1c-12b5-4320-b86b-26b759796c2a","Type":"ContainerDied","Data":"0ad3624f5fec9b47c5b5d11768db153970052b6f328fa597eaf281c6267cfb71"}
Aug 04 18:20:44.363653 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:44.363631    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw"
Aug 04 18:20:44.429231 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:44.429205    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee55d1c-12b5-4320-b86b-26b759796c2a-maas-api-service-ca\") pod \"2ee55d1c-12b5-4320-b86b-26b759796c2a\" (UID: \"2ee55d1c-12b5-4320-b86b-26b759796c2a\") "
Aug 04 18:20:44.429530 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:44.429509    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ee55d1c-12b5-4320-b86b-26b759796c2a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2ee55d1c-12b5-4320-b86b-26b759796c2a" (UID: "2ee55d1c-12b5-4320-b86b-26b759796c2a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:20:44.529911 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:44.529826    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee55d1c-12b5-4320-b86b-26b759796c2a-maas-api-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:20:45.238130 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:45.238097    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw"
Aug 04 18:20:45.238342 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:45.238127    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw" event={"ID":"2ee55d1c-12b5-4320-b86b-26b759796c2a","Type":"ContainerDied","Data":"7524b27e842bdfb4103f0ce05aad2e4d10db1ac90cddebb997f2105b51cc99e9"}
Aug 04 18:20:45.238342 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:45.238193    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7524b27e842bdfb4103f0ce05aad2e4d10db1ac90cddebb997f2105b51cc99e9"
Aug 04 18:20:47.473137 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:47.473102    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw"]
Aug 04 18:20:47.475427 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:47.475402    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a208c700-fzpbw"]
Aug 04 18:20:47.600634 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:47.600595    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ee55d1c-12b5-4320-b86b-26b759796c2a" path="/var/lib/kubelet/pods/2ee55d1c-12b5-4320-b86b-26b759796c2a/volumes"
Aug 04 18:20:50.484004 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:50.483972    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:20:56.575069 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:20:56.575032    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:21:15.905317 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:15.905285    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-06d91391-grz48"]
Aug 04 18:21:15.905758 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:15.905743    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ee55d1c-12b5-4320-b86b-26b759796c2a" containerName="revoke-keys"
Aug 04 18:21:15.905758 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:15.905759    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ee55d1c-12b5-4320-b86b-26b759796c2a" containerName="revoke-keys"
Aug 04 18:21:15.905846 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:15.905821    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ee55d1c-12b5-4320-b86b-26b759796c2a" containerName="revoke-keys"
Aug 04 18:21:15.908888 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:15.908870    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-06d91391-grz48"
Aug 04 18:21:15.912556 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:15.912538    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:21:15.912665 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:15.912630    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:21:15.925059 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:15.925032    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-06d91391-grz48"]
Aug 04 18:21:15.998088 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:15.998055    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42a72b94-5283-4fbe-9825-f75d60ba52f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-06d91391-grz48\" (UID: \"42a72b94-5283-4fbe-9825-f75d60ba52f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-06d91391-grz48"
Aug 04 18:21:16.098665 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:16.098627    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42a72b94-5283-4fbe-9825-f75d60ba52f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-06d91391-grz48\" (UID: \"42a72b94-5283-4fbe-9825-f75d60ba52f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-06d91391-grz48"
Aug 04 18:21:16.099307 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:16.099284    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42a72b94-5283-4fbe-9825-f75d60ba52f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-06d91391-grz48\" (UID: \"42a72b94-5283-4fbe-9825-f75d60ba52f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-06d91391-grz48"
Aug 04 18:21:16.218807 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:16.218718    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-06d91391-grz48"
Aug 04 18:21:16.350249 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:16.350219    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-06d91391-grz48"]
Aug 04 18:21:16.351375 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:21:16.351350    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a72b94_5283_4fbe_9825_f75d60ba52f4.slice/crio-3e9ae86f675adfbe0bb5631559f9ce17d13931ea388801b4f57008b2d5dfa19b WatchSource:0}: Error finding container 3e9ae86f675adfbe0bb5631559f9ce17d13931ea388801b4f57008b2d5dfa19b: Status 404 returned error can't find the container with id 3e9ae86f675adfbe0bb5631559f9ce17d13931ea388801b4f57008b2d5dfa19b
Aug 04 18:21:16.412886 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:16.412847    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-06d91391-grz48" event={"ID":"42a72b94-5283-4fbe-9825-f75d60ba52f4","Type":"ContainerStarted","Data":"3e9ae86f675adfbe0bb5631559f9ce17d13931ea388801b4f57008b2d5dfa19b"}
Aug 04 18:21:17.419995 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:17.419955    2572 generic.go:356] "Generic (PLEG): container finished" podID="42a72b94-5283-4fbe-9825-f75d60ba52f4" containerID="5d2443f11968138e24ae600d431bf15a8783baee67f8aa082ad32063eb2aa128" exitCode=0
Aug 04 18:21:17.420380 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:17.420002    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-06d91391-grz48" event={"ID":"42a72b94-5283-4fbe-9825-f75d60ba52f4","Type":"ContainerDied","Data":"5d2443f11968138e24ae600d431bf15a8783baee67f8aa082ad32063eb2aa128"}
Aug 04 18:21:18.565718 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:18.565694    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-06d91391-grz48"
Aug 04 18:21:18.623268 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:18.623243    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42a72b94-5283-4fbe-9825-f75d60ba52f4-maas-api-service-ca\") pod \"42a72b94-5283-4fbe-9825-f75d60ba52f4\" (UID: \"42a72b94-5283-4fbe-9825-f75d60ba52f4\") "
Aug 04 18:21:18.623549 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:18.623526    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42a72b94-5283-4fbe-9825-f75d60ba52f4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "42a72b94-5283-4fbe-9825-f75d60ba52f4" (UID: "42a72b94-5283-4fbe-9825-f75d60ba52f4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:21:18.724423 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:18.724362    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42a72b94-5283-4fbe-9825-f75d60ba52f4-maas-api-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:21:19.433198 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:19.433170    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-06d91391-grz48"
Aug 04 18:21:19.433198 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:19.433190    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-06d91391-grz48" event={"ID":"42a72b94-5283-4fbe-9825-f75d60ba52f4","Type":"ContainerDied","Data":"3e9ae86f675adfbe0bb5631559f9ce17d13931ea388801b4f57008b2d5dfa19b"}
Aug 04 18:21:19.433393 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:19.433231    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e9ae86f675adfbe0bb5631559f9ce17d13931ea388801b4f57008b2d5dfa19b"
Aug 04 18:21:21.849290 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:21.849252    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-06d91391-grz48"]
Aug 04 18:21:21.851458 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:21.851432    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-06d91391-grz48"]
Aug 04 18:21:23.598887 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:23.598850    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42a72b94-5283-4fbe-9825-f75d60ba52f4" path="/var/lib/kubelet/pods/42a72b94-5283-4fbe-9825-f75d60ba52f4/volumes"
Aug 04 18:21:24.476162 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:24.476130    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:21:32.378357 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:32.378319    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:21:55.691943 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:55.691898    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:21:55.703885 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:55.703861    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:21:59.583824 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:21:59.583790    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:22:07.774705 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:07.774664    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:22:25.999192 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:25.999158    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-024faf48-shs6v"]
Aug 04 18:22:25.999741 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:25.999720    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42a72b94-5283-4fbe-9825-f75d60ba52f4" containerName="revoke-keys"
Aug 04 18:22:25.999792 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:25.999746    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="42a72b94-5283-4fbe-9825-f75d60ba52f4" containerName="revoke-keys"
Aug 04 18:22:25.999860 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:25.999848    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="42a72b94-5283-4fbe-9825-f75d60ba52f4" containerName="revoke-keys"
Aug 04 18:22:26.003453 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:26.003434    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-024faf48-shs6v"
Aug 04 18:22:26.005894 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:26.005868    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:22:26.006087 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:26.006043    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:22:26.010383 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:26.010358    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-024faf48-shs6v"]
Aug 04 18:22:26.019866 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:26.019840    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/780075bb-27e3-4295-9544-584486d90475-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-024faf48-shs6v\" (UID: \"780075bb-27e3-4295-9544-584486d90475\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-024faf48-shs6v"
Aug 04 18:22:26.120389 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:26.120354    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/780075bb-27e3-4295-9544-584486d90475-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-024faf48-shs6v\" (UID: \"780075bb-27e3-4295-9544-584486d90475\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-024faf48-shs6v"
Aug 04 18:22:26.121104 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:26.121079    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/780075bb-27e3-4295-9544-584486d90475-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-024faf48-shs6v\" (UID: \"780075bb-27e3-4295-9544-584486d90475\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-024faf48-shs6v"
Aug 04 18:22:26.316020 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:26.315986    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-024faf48-shs6v"
Aug 04 18:22:26.656249 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:26.656221    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-024faf48-shs6v"]
Aug 04 18:22:26.658123 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:22:26.658094    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod780075bb_27e3_4295_9544_584486d90475.slice/crio-92e5a4a535898ddd2199ac02022211eef9f57181036cc192ffec0301d7e70def WatchSource:0}: Error finding container 92e5a4a535898ddd2199ac02022211eef9f57181036cc192ffec0301d7e70def: Status 404 returned error can't find the container with id 92e5a4a535898ddd2199ac02022211eef9f57181036cc192ffec0301d7e70def
Aug 04 18:22:26.834183 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:26.834145    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-024faf48-shs6v" event={"ID":"780075bb-27e3-4295-9544-584486d90475","Type":"ContainerStarted","Data":"92e5a4a535898ddd2199ac02022211eef9f57181036cc192ffec0301d7e70def"}
Aug 04 18:22:27.841585 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:27.841543    2572 generic.go:356] "Generic (PLEG): container finished" podID="780075bb-27e3-4295-9544-584486d90475" containerID="60051c35a23ec2370a57836fd57820c22c462d788f5973105f443b350666aeb1" exitCode=0
Aug 04 18:22:27.842055 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:27.841632    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-024faf48-shs6v" event={"ID":"780075bb-27e3-4295-9544-584486d90475","Type":"ContainerDied","Data":"60051c35a23ec2370a57836fd57820c22c462d788f5973105f443b350666aeb1"}
Aug 04 18:22:28.984535 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:28.984513    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-024faf48-shs6v"
Aug 04 18:22:29.039255 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:29.039223    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/780075bb-27e3-4295-9544-584486d90475-maas-api-service-ca\") pod \"780075bb-27e3-4295-9544-584486d90475\" (UID: \"780075bb-27e3-4295-9544-584486d90475\") "
Aug 04 18:22:29.039591 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:29.039558    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/780075bb-27e3-4295-9544-584486d90475-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "780075bb-27e3-4295-9544-584486d90475" (UID: "780075bb-27e3-4295-9544-584486d90475"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:22:29.140673 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:29.140589    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/780075bb-27e3-4295-9544-584486d90475-maas-api-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:22:29.854381 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:29.854351    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-024faf48-shs6v"
Aug 04 18:22:29.854572 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:29.854384    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-024faf48-shs6v" event={"ID":"780075bb-27e3-4295-9544-584486d90475","Type":"ContainerDied","Data":"92e5a4a535898ddd2199ac02022211eef9f57181036cc192ffec0301d7e70def"}
Aug 04 18:22:29.854572 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:29.854430    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92e5a4a535898ddd2199ac02022211eef9f57181036cc192ffec0301d7e70def"
Aug 04 18:22:32.963110 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:32.963072    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-024faf48-shs6v"]
Aug 04 18:22:32.964273 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:32.964249    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-024faf48-shs6v"]
Aug 04 18:22:33.598996 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:33.598959    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="780075bb-27e3-4295-9544-584486d90475" path="/var/lib/kubelet/pods/780075bb-27e3-4295-9544-584486d90475/volumes"
Aug 04 18:22:35.586312 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:35.586275    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:22:46.979286 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:22:46.979239    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:24:15.877935 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:24:15.877892    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:24:24.633628 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:24:24.633536    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:24:37.183408 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:24:37.183372    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:25:17.979959 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:25:17.979913    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:25:53.482180 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:25:53.482095    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:26:02.678361 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:02.678324    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"]
Aug 04 18:26:02.678772 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:02.678530    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw" podUID="191d76ab-8a00-4e9e-87d3-3a941d5e12a0" containerName="manager" containerID="cri-o://f9aacb6aeb9ef02ce5e886ca725bbfe97281caaa06536a16d4857791f6f876bd" gracePeriod=10
Aug 04 18:26:02.922134 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:02.922111    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"
Aug 04 18:26:03.024719 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:03.024645    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/191d76ab-8a00-4e9e-87d3-3a941d5e12a0-extensions-socket-volume\") pod \"191d76ab-8a00-4e9e-87d3-3a941d5e12a0\" (UID: \"191d76ab-8a00-4e9e-87d3-3a941d5e12a0\") "
Aug 04 18:26:03.024851 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:03.024734    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfscc\" (UniqueName: \"kubernetes.io/projected/191d76ab-8a00-4e9e-87d3-3a941d5e12a0-kube-api-access-gfscc\") pod \"191d76ab-8a00-4e9e-87d3-3a941d5e12a0\" (UID: \"191d76ab-8a00-4e9e-87d3-3a941d5e12a0\") "
Aug 04 18:26:03.025055 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:03.025032    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/191d76ab-8a00-4e9e-87d3-3a941d5e12a0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "191d76ab-8a00-4e9e-87d3-3a941d5e12a0" (UID: "191d76ab-8a00-4e9e-87d3-3a941d5e12a0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:26:03.026722 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:03.026702    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/191d76ab-8a00-4e9e-87d3-3a941d5e12a0-kube-api-access-gfscc" (OuterVolumeSpecName: "kube-api-access-gfscc") pod "191d76ab-8a00-4e9e-87d3-3a941d5e12a0" (UID: "191d76ab-8a00-4e9e-87d3-3a941d5e12a0"). InnerVolumeSpecName "kube-api-access-gfscc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:26:03.094695 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:03.094666    2572 generic.go:356] "Generic (PLEG): container finished" podID="191d76ab-8a00-4e9e-87d3-3a941d5e12a0" containerID="f9aacb6aeb9ef02ce5e886ca725bbfe97281caaa06536a16d4857791f6f876bd" exitCode=0
Aug 04 18:26:03.094813 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:03.094713    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"
Aug 04 18:26:03.094813 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:03.094719    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw" event={"ID":"191d76ab-8a00-4e9e-87d3-3a941d5e12a0","Type":"ContainerDied","Data":"f9aacb6aeb9ef02ce5e886ca725bbfe97281caaa06536a16d4857791f6f876bd"}
Aug 04 18:26:03.094813 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:03.094760    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw" event={"ID":"191d76ab-8a00-4e9e-87d3-3a941d5e12a0","Type":"ContainerDied","Data":"9dc2a3bdbdd60b0cf51c113a8d54d549c4a81527cfb2e49a7a635d27b5c7766e"}
Aug 04 18:26:03.094813 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:03.094782    2572 scope.go:117] "RemoveContainer" containerID="f9aacb6aeb9ef02ce5e886ca725bbfe97281caaa06536a16d4857791f6f876bd"
Aug 04 18:26:03.104759 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:03.104739    2572 scope.go:117] "RemoveContainer" containerID="f9aacb6aeb9ef02ce5e886ca725bbfe97281caaa06536a16d4857791f6f876bd"
Aug 04 18:26:03.105030 ip-10-0-141-117 kubenswrapper[2572]: E0804 18:26:03.105013    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9aacb6aeb9ef02ce5e886ca725bbfe97281caaa06536a16d4857791f6f876bd\": container with ID starting with f9aacb6aeb9ef02ce5e886ca725bbfe97281caaa06536a16d4857791f6f876bd not found: ID does not exist" containerID="f9aacb6aeb9ef02ce5e886ca725bbfe97281caaa06536a16d4857791f6f876bd"
Aug 04 18:26:03.105095 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:03.105037    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9aacb6aeb9ef02ce5e886ca725bbfe97281caaa06536a16d4857791f6f876bd"} err="failed to get container status \"f9aacb6aeb9ef02ce5e886ca725bbfe97281caaa06536a16d4857791f6f876bd\": rpc error: code = NotFound desc = could not find container \"f9aacb6aeb9ef02ce5e886ca725bbfe97281caaa06536a16d4857791f6f876bd\": container with ID starting with f9aacb6aeb9ef02ce5e886ca725bbfe97281caaa06536a16d4857791f6f876bd not found: ID does not exist"
Aug 04 18:26:03.116504 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:03.116479    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"]
Aug 04 18:26:03.120557 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:03.120536    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-99jtw"]
Aug 04 18:26:03.125458 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:03.125439    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/191d76ab-8a00-4e9e-87d3-3a941d5e12a0-extensions-socket-volume\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:26:03.125518 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:03.125461    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfscc\" (UniqueName: \"kubernetes.io/projected/191d76ab-8a00-4e9e-87d3-3a941d5e12a0-kube-api-access-gfscc\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:26:03.599681 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:03.599647    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="191d76ab-8a00-4e9e-87d3-3a941d5e12a0" path="/var/lib/kubelet/pods/191d76ab-8a00-4e9e-87d3-3a941d5e12a0/volumes"
Aug 04 18:26:55.729173 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:55.729145    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:26:55.741176 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:55.741154    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:26:55.793774 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:26:55.793746    2572 scope.go:117] "RemoveContainer" containerID="0ad3624f5fec9b47c5b5d11768db153970052b6f328fa597eaf281c6267cfb71"
Aug 04 18:27:18.285197 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.285114    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g2wfb"]
Aug 04 18:27:18.285592 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.285577    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="191d76ab-8a00-4e9e-87d3-3a941d5e12a0" containerName="manager"
Aug 04 18:27:18.285646 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.285594    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="191d76ab-8a00-4e9e-87d3-3a941d5e12a0" containerName="manager"
Aug 04 18:27:18.285646 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.285618    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="780075bb-27e3-4295-9544-584486d90475" containerName="revoke-keys"
Aug 04 18:27:18.285646 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.285625    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="780075bb-27e3-4295-9544-584486d90475" containerName="revoke-keys"
Aug 04 18:27:18.285751 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.285711    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="191d76ab-8a00-4e9e-87d3-3a941d5e12a0" containerName="manager"
Aug 04 18:27:18.285751 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.285721    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="780075bb-27e3-4295-9544-584486d90475" containerName="revoke-keys"
Aug 04 18:27:18.288599 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.288584    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g2wfb"
Aug 04 18:27:18.295994 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.295967    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ttcms\""
Aug 04 18:27:18.299255 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.299222    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g2wfb"]
Aug 04 18:27:18.302219 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.302187    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq7wk\" (UniqueName: \"kubernetes.io/projected/c729cee2-cfb4-4dac-b2a5-ee25ed405aa5-kube-api-access-bq7wk\") pod \"kuadrant-operator-controller-manager-68cf589589-g2wfb\" (UID: \"c729cee2-cfb4-4dac-b2a5-ee25ed405aa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g2wfb"
Aug 04 18:27:18.302343 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.302253    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c729cee2-cfb4-4dac-b2a5-ee25ed405aa5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-g2wfb\" (UID: \"c729cee2-cfb4-4dac-b2a5-ee25ed405aa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g2wfb"
Aug 04 18:27:18.402750 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.402711    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq7wk\" (UniqueName: \"kubernetes.io/projected/c729cee2-cfb4-4dac-b2a5-ee25ed405aa5-kube-api-access-bq7wk\") pod \"kuadrant-operator-controller-manager-68cf589589-g2wfb\" (UID: \"c729cee2-cfb4-4dac-b2a5-ee25ed405aa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g2wfb"
Aug 04 18:27:18.402968 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.402761    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c729cee2-cfb4-4dac-b2a5-ee25ed405aa5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-g2wfb\" (UID: \"c729cee2-cfb4-4dac-b2a5-ee25ed405aa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g2wfb"
Aug 04 18:27:18.403151 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.403134    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c729cee2-cfb4-4dac-b2a5-ee25ed405aa5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-g2wfb\" (UID: \"c729cee2-cfb4-4dac-b2a5-ee25ed405aa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g2wfb"
Aug 04 18:27:18.412431 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.412404    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq7wk\" (UniqueName: \"kubernetes.io/projected/c729cee2-cfb4-4dac-b2a5-ee25ed405aa5-kube-api-access-bq7wk\") pod \"kuadrant-operator-controller-manager-68cf589589-g2wfb\" (UID: \"c729cee2-cfb4-4dac-b2a5-ee25ed405aa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g2wfb"
Aug 04 18:27:18.606737 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.606700    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g2wfb"
Aug 04 18:27:18.747783 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:18.747756    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g2wfb"]
Aug 04 18:27:18.749576 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:27:18.749549    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc729cee2_cfb4_4dac_b2a5_ee25ed405aa5.slice/crio-e266855f2427dfecb1975990369c5e52f073e32e42b7b18c8309d331aab45ecc WatchSource:0}: Error finding container e266855f2427dfecb1975990369c5e52f073e32e42b7b18c8309d331aab45ecc: Status 404 returned error can't find the container with id e266855f2427dfecb1975990369c5e52f073e32e42b7b18c8309d331aab45ecc
Aug 04 18:27:19.538365 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:19.538329    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g2wfb" event={"ID":"c729cee2-cfb4-4dac-b2a5-ee25ed405aa5","Type":"ContainerStarted","Data":"0e80678f6bef036c541f10ccde4e0c789685ac909761b95e181e1744617249bb"}
Aug 04 18:27:19.538743 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:19.538389    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g2wfb"
Aug 04 18:27:19.538743 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:19.538410    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g2wfb" event={"ID":"c729cee2-cfb4-4dac-b2a5-ee25ed405aa5","Type":"ContainerStarted","Data":"e266855f2427dfecb1975990369c5e52f073e32e42b7b18c8309d331aab45ecc"}
Aug 04 18:27:19.560511 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:19.560459    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g2wfb" podStartSLOduration=1.56044535 podStartE2EDuration="1.56044535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:27:19.556799002 +0000 UTC m=+2424.466688627" watchObservedRunningTime="2026-08-04 18:27:19.56044535 +0000 UTC m=+2424.470334937"
Aug 04 18:27:30.545908 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:30.545866    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g2wfb"
Aug 04 18:27:40.109489 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:40.109440    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:27:48.078395 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:48.078351    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:27:55.818338 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:27:55.818308    2572 scope.go:117] "RemoveContainer" containerID="5d2443f11968138e24ae600d431bf15a8783baee67f8aa082ad32063eb2aa128"
Aug 04 18:28:13.481254 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:13.481216    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:28:38.982144 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:38.982099    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:28:49.458247 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:49.458171    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749"]
Aug 04 18:28:49.461653 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:49.461635    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749"
Aug 04 18:28:49.463978 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:49.463954    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:28:49.464088 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:49.463985    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:28:49.468272 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:49.468247    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749"]
Aug 04 18:28:49.591798 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:49.591767    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42bd2892-24cf-4c28-959f-8169e990e2f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749\" (UID: \"42bd2892-24cf-4c28-959f-8169e990e2f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749"
Aug 04 18:28:49.692258 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:49.692223    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42bd2892-24cf-4c28-959f-8169e990e2f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749\" (UID: \"42bd2892-24cf-4c28-959f-8169e990e2f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749"
Aug 04 18:28:49.692840 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:49.692817    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42bd2892-24cf-4c28-959f-8169e990e2f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749\" (UID: \"42bd2892-24cf-4c28-959f-8169e990e2f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749"
Aug 04 18:28:49.773232 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:49.773161    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749"
Aug 04 18:28:49.904443 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:49.904413    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749"]
Aug 04 18:28:49.906028 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:28:49.905989    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42bd2892_24cf_4c28_959f_8169e990e2f0.slice/crio-464faf28e5fad41e6e177efe6c0d4052a54718c8eac97a88425906f084cade70 WatchSource:0}: Error finding container 464faf28e5fad41e6e177efe6c0d4052a54718c8eac97a88425906f084cade70: Status 404 returned error can't find the container with id 464faf28e5fad41e6e177efe6c0d4052a54718c8eac97a88425906f084cade70
Aug 04 18:28:50.041975 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:50.041866    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749" event={"ID":"42bd2892-24cf-4c28-959f-8169e990e2f0","Type":"ContainerStarted","Data":"464faf28e5fad41e6e177efe6c0d4052a54718c8eac97a88425906f084cade70"}
Aug 04 18:28:51.049073 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:51.048985    2572 generic.go:356] "Generic (PLEG): container finished" podID="42bd2892-24cf-4c28-959f-8169e990e2f0" containerID="e233e4c49622bfcb60884dd842265e1026a2a485c4c602d62afcb313aae7cc42" exitCode=0
Aug 04 18:28:51.049073 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:51.049062    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749" event={"ID":"42bd2892-24cf-4c28-959f-8169e990e2f0","Type":"ContainerDied","Data":"e233e4c49622bfcb60884dd842265e1026a2a485c4c602d62afcb313aae7cc42"}
Aug 04 18:28:52.189571 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:52.189544    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749"
Aug 04 18:28:52.315971 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:52.315864    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42bd2892-24cf-4c28-959f-8169e990e2f0-maas-api-service-ca\") pod \"42bd2892-24cf-4c28-959f-8169e990e2f0\" (UID: \"42bd2892-24cf-4c28-959f-8169e990e2f0\") "
Aug 04 18:28:52.316265 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:52.316245    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42bd2892-24cf-4c28-959f-8169e990e2f0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "42bd2892-24cf-4c28-959f-8169e990e2f0" (UID: "42bd2892-24cf-4c28-959f-8169e990e2f0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:28:52.417089 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:52.417053    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42bd2892-24cf-4c28-959f-8169e990e2f0-maas-api-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:28:53.062152 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:53.062110    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749" event={"ID":"42bd2892-24cf-4c28-959f-8169e990e2f0","Type":"ContainerDied","Data":"464faf28e5fad41e6e177efe6c0d4052a54718c8eac97a88425906f084cade70"}
Aug 04 18:28:53.062322 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:53.062173    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="464faf28e5fad41e6e177efe6c0d4052a54718c8eac97a88425906f084cade70"
Aug 04 18:28:53.062322 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:53.062126    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749"
Aug 04 18:28:55.842635 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:28:55.842598    2572 scope.go:117] "RemoveContainer" containerID="60051c35a23ec2370a57836fd57820c22c462d788f5973105f443b350666aeb1"
Aug 04 18:29:02.277319 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:29:02.277285    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:29:05.040304 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:29:05.040265    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749"]
Aug 04 18:29:05.044193 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:29:05.044164    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f0f8ee0-zh749"]
Aug 04 18:29:05.599663 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:29:05.599621    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42bd2892-24cf-4c28-959f-8169e990e2f0" path="/var/lib/kubelet/pods/42bd2892-24cf-4c28-959f-8169e990e2f0/volumes"
Aug 04 18:29:08.078849 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:29:08.078811    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:29:57.879222 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:29:57.879182    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:30:09.283010 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:30:09.282976    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:30:15.790462 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:30:15.790420    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:30:24.079353 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:30:24.079273    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:31:06.586549 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:31:06.586508    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:31:39.852636 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:31:39.852599    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:31:55.765738 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:31:55.765667    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:31:55.777697 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:31:55.777673    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:32:19.383608 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:32:19.383574    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:32:25.381139 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:32:25.381092    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:32:41.184033 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:32:41.183998    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:33:26.686448 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:26.686360    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47"]
Aug 04 18:33:26.687023 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:26.686992    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42bd2892-24cf-4c28-959f-8169e990e2f0" containerName="revoke-keys"
Aug 04 18:33:26.687023 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:26.687013    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="42bd2892-24cf-4c28-959f-8169e990e2f0" containerName="revoke-keys"
Aug 04 18:33:26.687157 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:26.687107    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="42bd2892-24cf-4c28-959f-8169e990e2f0" containerName="revoke-keys"
Aug 04 18:33:26.690119 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:26.690097    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47"
Aug 04 18:33:26.692565 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:26.692531    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:33:26.692680 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:26.692629    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:33:26.697020 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:26.696992    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47"]
Aug 04 18:33:26.729977 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:26.729947    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79c58f78-2c17-4c68-90b3-fd7c5b8458c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47\" (UID: \"79c58f78-2c17-4c68-90b3-fd7c5b8458c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47"
Aug 04 18:33:26.830769 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:26.830741    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79c58f78-2c17-4c68-90b3-fd7c5b8458c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47\" (UID: \"79c58f78-2c17-4c68-90b3-fd7c5b8458c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47"
Aug 04 18:33:26.831413 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:26.831391    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79c58f78-2c17-4c68-90b3-fd7c5b8458c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47\" (UID: \"79c58f78-2c17-4c68-90b3-fd7c5b8458c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47"
Aug 04 18:33:27.002562 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:27.002480    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47"
Aug 04 18:33:27.135430 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:27.135402    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47"]
Aug 04 18:33:27.137678 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:33:27.137651    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c58f78_2c17_4c68_90b3_fd7c5b8458c1.slice/crio-f9fedc68c4aeb381d2c7c7d88a8f266541e2b5847da197fdfff8ddc71ec9329b WatchSource:0}: Error finding container f9fedc68c4aeb381d2c7c7d88a8f266541e2b5847da197fdfff8ddc71ec9329b: Status 404 returned error can't find the container with id f9fedc68c4aeb381d2c7c7d88a8f266541e2b5847da197fdfff8ddc71ec9329b
Aug 04 18:33:27.612295 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:27.612213    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47" event={"ID":"79c58f78-2c17-4c68-90b3-fd7c5b8458c1","Type":"ContainerStarted","Data":"922a75a8a6aa1cda935d44a87bbbc167a3dbe6b6695786a9130ca71e52d267be"}
Aug 04 18:33:27.612295 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:27.612256    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47" event={"ID":"79c58f78-2c17-4c68-90b3-fd7c5b8458c1","Type":"ContainerStarted","Data":"f9fedc68c4aeb381d2c7c7d88a8f266541e2b5847da197fdfff8ddc71ec9329b"}
Aug 04 18:33:27.627060 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:27.627012    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47" podStartSLOduration=1.626996155 podStartE2EDuration="1.626996155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:33:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:33:27.62501045 +0000 UTC m=+2792.534900039" watchObservedRunningTime="2026-08-04 18:33:27.626996155 +0000 UTC m=+2792.536885742"
Aug 04 18:33:28.619318 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:28.619284    2572 generic.go:356] "Generic (PLEG): container finished" podID="79c58f78-2c17-4c68-90b3-fd7c5b8458c1" containerID="922a75a8a6aa1cda935d44a87bbbc167a3dbe6b6695786a9130ca71e52d267be" exitCode=0
Aug 04 18:33:28.619714 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:28.619378    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47" event={"ID":"79c58f78-2c17-4c68-90b3-fd7c5b8458c1","Type":"ContainerDied","Data":"922a75a8a6aa1cda935d44a87bbbc167a3dbe6b6695786a9130ca71e52d267be"}
Aug 04 18:33:28.783808 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:28.783777    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:33:29.766294 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:29.766269    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47"
Aug 04 18:33:29.856429 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:29.856397    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79c58f78-2c17-4c68-90b3-fd7c5b8458c1-maas-api-service-ca\") pod \"79c58f78-2c17-4c68-90b3-fd7c5b8458c1\" (UID: \"79c58f78-2c17-4c68-90b3-fd7c5b8458c1\") "
Aug 04 18:33:29.856758 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:29.856731    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c58f78-2c17-4c68-90b3-fd7c5b8458c1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "79c58f78-2c17-4c68-90b3-fd7c5b8458c1" (UID: "79c58f78-2c17-4c68-90b3-fd7c5b8458c1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:33:29.957532 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:29.957458    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79c58f78-2c17-4c68-90b3-fd7c5b8458c1-maas-api-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:33:30.632484 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:30.632453    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47"
Aug 04 18:33:30.632652 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:30.632489    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47" event={"ID":"79c58f78-2c17-4c68-90b3-fd7c5b8458c1","Type":"ContainerDied","Data":"f9fedc68c4aeb381d2c7c7d88a8f266541e2b5847da197fdfff8ddc71ec9329b"}
Aug 04 18:33:30.632652 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:30.632539    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9fedc68c4aeb381d2c7c7d88a8f266541e2b5847da197fdfff8ddc71ec9329b"
Aug 04 18:33:37.273245 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:37.273210    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47"]
Aug 04 18:33:37.275529 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:37.275504    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7e1998-6vq47"]
Aug 04 18:33:37.599345 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:37.599315    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79c58f78-2c17-4c68-90b3-fd7c5b8458c1" path="/var/lib/kubelet/pods/79c58f78-2c17-4c68-90b3-fd7c5b8458c1/volumes"
Aug 04 18:33:39.677435 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:39.677396    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:33:44.034373 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:44.034334    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj"]
Aug 04 18:33:44.034747 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:44.034734    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c58f78-2c17-4c68-90b3-fd7c5b8458c1" containerName="revoke-keys"
Aug 04 18:33:44.034747 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:44.034746    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c58f78-2c17-4c68-90b3-fd7c5b8458c1" containerName="revoke-keys"
Aug 04 18:33:44.034836 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:44.034825    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="79c58f78-2c17-4c68-90b3-fd7c5b8458c1" containerName="revoke-keys"
Aug 04 18:33:44.038039 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:44.038022    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj"
Aug 04 18:33:44.040108 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:44.040084    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:33:44.040231 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:44.040137    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:33:44.044699 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:44.044673    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj"]
Aug 04 18:33:44.179866 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:44.179826    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5691d034-75e5-4206-b102-5eb33e7546eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj\" (UID: \"5691d034-75e5-4206-b102-5eb33e7546eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj"
Aug 04 18:33:44.281293 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:44.281252    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5691d034-75e5-4206-b102-5eb33e7546eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj\" (UID: \"5691d034-75e5-4206-b102-5eb33e7546eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj"
Aug 04 18:33:44.281892 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:44.281869    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5691d034-75e5-4206-b102-5eb33e7546eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj\" (UID: \"5691d034-75e5-4206-b102-5eb33e7546eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj"
Aug 04 18:33:44.350124 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:44.350089    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj"
Aug 04 18:33:44.487329 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:44.487294    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj"]
Aug 04 18:33:44.487557 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:33:44.487534    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5691d034_75e5_4206_b102_5eb33e7546eb.slice/crio-3cd0260f21215b06f185955cc4e7365442014dee89d61457010a14ac840c3876 WatchSource:0}: Error finding container 3cd0260f21215b06f185955cc4e7365442014dee89d61457010a14ac840c3876: Status 404 returned error can't find the container with id 3cd0260f21215b06f185955cc4e7365442014dee89d61457010a14ac840c3876
Aug 04 18:33:44.710691 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:44.710604    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj" event={"ID":"5691d034-75e5-4206-b102-5eb33e7546eb","Type":"ContainerStarted","Data":"3cd0260f21215b06f185955cc4e7365442014dee89d61457010a14ac840c3876"}
Aug 04 18:33:45.717727 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:45.717690    2572 generic.go:356] "Generic (PLEG): container finished" podID="5691d034-75e5-4206-b102-5eb33e7546eb" containerID="42089f7e36d154dbfd5267a6557453770e88a1e78959393431954ae8e54f0e6b" exitCode=0
Aug 04 18:33:45.718141 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:45.717771    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj" event={"ID":"5691d034-75e5-4206-b102-5eb33e7546eb","Type":"ContainerDied","Data":"42089f7e36d154dbfd5267a6557453770e88a1e78959393431954ae8e54f0e6b"}
Aug 04 18:33:46.853507 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:46.853482    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj"
Aug 04 18:33:47.003535 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:47.003445    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5691d034-75e5-4206-b102-5eb33e7546eb-maas-api-service-ca\") pod \"5691d034-75e5-4206-b102-5eb33e7546eb\" (UID: \"5691d034-75e5-4206-b102-5eb33e7546eb\") "
Aug 04 18:33:47.003820 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:47.003795    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5691d034-75e5-4206-b102-5eb33e7546eb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5691d034-75e5-4206-b102-5eb33e7546eb" (UID: "5691d034-75e5-4206-b102-5eb33e7546eb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:33:47.104616 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:47.104571    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5691d034-75e5-4206-b102-5eb33e7546eb-maas-api-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:33:47.730674 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:47.730644    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj"
Aug 04 18:33:47.730831 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:47.730670    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj" event={"ID":"5691d034-75e5-4206-b102-5eb33e7546eb","Type":"ContainerDied","Data":"3cd0260f21215b06f185955cc4e7365442014dee89d61457010a14ac840c3876"}
Aug 04 18:33:47.730831 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:47.730718    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cd0260f21215b06f185955cc4e7365442014dee89d61457010a14ac840c3876"
Aug 04 18:33:54.590502 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:54.590456    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj"]
Aug 04 18:33:54.594751 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:54.594729    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ca2e8-hqsqj"]
Aug 04 18:33:55.600264 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:55.600225    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5691d034-75e5-4206-b102-5eb33e7546eb" path="/var/lib/kubelet/pods/5691d034-75e5-4206-b102-5eb33e7546eb/volumes"
Aug 04 18:33:56.379762 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:33:56.379732    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:34:08.581338 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:34:08.581299    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:34:36.975335 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:34:36.975302    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:34:55.912303 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:34:55.912219    2572 scope.go:117] "RemoveContainer" containerID="e233e4c49622bfcb60884dd842265e1026a2a485c4c602d62afcb313aae7cc42"
Aug 04 18:35:00.681888 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:00.681846    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh"]
Aug 04 18:35:00.682285 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:00.682264    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5691d034-75e5-4206-b102-5eb33e7546eb" containerName="revoke-keys"
Aug 04 18:35:00.682285 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:00.682276    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5691d034-75e5-4206-b102-5eb33e7546eb" containerName="revoke-keys"
Aug 04 18:35:00.682358 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:00.682341    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5691d034-75e5-4206-b102-5eb33e7546eb" containerName="revoke-keys"
Aug 04 18:35:00.686909 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:00.686894    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh"
Aug 04 18:35:00.689842 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:00.689813    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:35:00.690005 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:00.689948    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:35:00.691382 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:00.691357    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh"]
Aug 04 18:35:00.848366 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:00.848325    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/835e5567-08cb-4c8c-873c-584d4c660e8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh\" (UID: \"835e5567-08cb-4c8c-873c-584d4c660e8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh"
Aug 04 18:35:00.949774 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:00.949688    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/835e5567-08cb-4c8c-873c-584d4c660e8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh\" (UID: \"835e5567-08cb-4c8c-873c-584d4c660e8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh"
Aug 04 18:35:00.950424 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:00.950400    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/835e5567-08cb-4c8c-873c-584d4c660e8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh\" (UID: \"835e5567-08cb-4c8c-873c-584d4c660e8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh"
Aug 04 18:35:01.000227 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:01.000193    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh"
Aug 04 18:35:01.140205 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:01.140172    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh"]
Aug 04 18:35:01.141349 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:35:01.141323    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod835e5567_08cb_4c8c_873c_584d4c660e8e.slice/crio-045564e88eb569896b42cf171eecc62c30c2b8dc8a31c1f7f4963abcd66a3410 WatchSource:0}: Error finding container 045564e88eb569896b42cf171eecc62c30c2b8dc8a31c1f7f4963abcd66a3410: Status 404 returned error can't find the container with id 045564e88eb569896b42cf171eecc62c30c2b8dc8a31c1f7f4963abcd66a3410
Aug 04 18:35:01.170194 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:01.170163    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh" event={"ID":"835e5567-08cb-4c8c-873c-584d4c660e8e","Type":"ContainerStarted","Data":"045564e88eb569896b42cf171eecc62c30c2b8dc8a31c1f7f4963abcd66a3410"}
Aug 04 18:35:02.178977 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:02.178870    2572 generic.go:356] "Generic (PLEG): container finished" podID="835e5567-08cb-4c8c-873c-584d4c660e8e" containerID="6e029a51e172275289a750b274de292b3689aeecdee2c5af4d38a9cd0a9919d3" exitCode=0
Aug 04 18:35:02.178977 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:02.178958    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh" event={"ID":"835e5567-08cb-4c8c-873c-584d4c660e8e","Type":"ContainerDied","Data":"6e029a51e172275289a750b274de292b3689aeecdee2c5af4d38a9cd0a9919d3"}
Aug 04 18:35:03.314543 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:03.314515    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh"
Aug 04 18:35:03.367816 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:03.367788    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/835e5567-08cb-4c8c-873c-584d4c660e8e-maas-api-service-ca\") pod \"835e5567-08cb-4c8c-873c-584d4c660e8e\" (UID: \"835e5567-08cb-4c8c-873c-584d4c660e8e\") "
Aug 04 18:35:03.368172 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:03.368152    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/835e5567-08cb-4c8c-873c-584d4c660e8e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "835e5567-08cb-4c8c-873c-584d4c660e8e" (UID: "835e5567-08cb-4c8c-873c-584d4c660e8e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:35:03.468518 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:03.468439    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/835e5567-08cb-4c8c-873c-584d4c660e8e-maas-api-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:35:04.191263 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:04.191234    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh"
Aug 04 18:35:04.191434 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:04.191274    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh" event={"ID":"835e5567-08cb-4c8c-873c-584d4c660e8e","Type":"ContainerDied","Data":"045564e88eb569896b42cf171eecc62c30c2b8dc8a31c1f7f4963abcd66a3410"}
Aug 04 18:35:04.191434 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:04.191322    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="045564e88eb569896b42cf171eecc62c30c2b8dc8a31c1f7f4963abcd66a3410"
Aug 04 18:35:16.293670 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:16.293634    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh"]
Aug 04 18:35:16.295945 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:16.295909    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b81f-jmcnh"]
Aug 04 18:35:17.600273 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:17.600238    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="835e5567-08cb-4c8c-873c-584d4c660e8e" path="/var/lib/kubelet/pods/835e5567-08cb-4c8c-873c-584d4c660e8e/volumes"
Aug 04 18:35:18.377445 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:18.377411    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:35:22.880857 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:22.880821    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd"]
Aug 04 18:35:22.881274 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:22.881260    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="835e5567-08cb-4c8c-873c-584d4c660e8e" containerName="revoke-keys"
Aug 04 18:35:22.881333 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:22.881275    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="835e5567-08cb-4c8c-873c-584d4c660e8e" containerName="revoke-keys"
Aug 04 18:35:22.881375 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:22.881344    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="835e5567-08cb-4c8c-873c-584d4c660e8e" containerName="revoke-keys"
Aug 04 18:35:22.884666 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:22.884650    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd"
Aug 04 18:35:22.886909 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:22.886888    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:35:22.887016 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:22.886912    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:35:22.891914 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:22.891892    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd"]
Aug 04 18:35:22.926716 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:22.926689    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de47475a-2f9c-4e5c-b905-4348ba0e4c05-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd\" (UID: \"de47475a-2f9c-4e5c-b905-4348ba0e4c05\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd"
Aug 04 18:35:23.027751 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:23.027718    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de47475a-2f9c-4e5c-b905-4348ba0e4c05-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd\" (UID: \"de47475a-2f9c-4e5c-b905-4348ba0e4c05\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd"
Aug 04 18:35:23.028343 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:23.028323    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de47475a-2f9c-4e5c-b905-4348ba0e4c05-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd\" (UID: \"de47475a-2f9c-4e5c-b905-4348ba0e4c05\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd"
Aug 04 18:35:23.197656 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:23.197578    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd"
Aug 04 18:35:23.538498 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:23.538468    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd"]
Aug 04 18:35:23.539893 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:35:23.539863    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde47475a_2f9c_4e5c_b905_4348ba0e4c05.slice/crio-95ce5f0d5520973f511874b4a047d585ebc44ff6ec5495d38fa48bcf483b347b WatchSource:0}: Error finding container 95ce5f0d5520973f511874b4a047d585ebc44ff6ec5495d38fa48bcf483b347b: Status 404 returned error can't find the container with id 95ce5f0d5520973f511874b4a047d585ebc44ff6ec5495d38fa48bcf483b347b
Aug 04 18:35:24.313431 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:24.313399    2572 generic.go:356] "Generic (PLEG): container finished" podID="de47475a-2f9c-4e5c-b905-4348ba0e4c05" containerID="7062790ee1cb59784b3169d2f5a36f108b3770b8e3843d38fac6aa8b80228426" exitCode=0
Aug 04 18:35:24.313762 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:24.313445    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd" event={"ID":"de47475a-2f9c-4e5c-b905-4348ba0e4c05","Type":"ContainerDied","Data":"7062790ee1cb59784b3169d2f5a36f108b3770b8e3843d38fac6aa8b80228426"}
Aug 04 18:35:24.313762 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:24.313485    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd" event={"ID":"de47475a-2f9c-4e5c-b905-4348ba0e4c05","Type":"ContainerStarted","Data":"95ce5f0d5520973f511874b4a047d585ebc44ff6ec5495d38fa48bcf483b347b"}
Aug 04 18:35:25.451766 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:25.451738    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd"
Aug 04 18:35:25.550502 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:25.550472    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de47475a-2f9c-4e5c-b905-4348ba0e4c05-maas-api-service-ca\") pod \"de47475a-2f9c-4e5c-b905-4348ba0e4c05\" (UID: \"de47475a-2f9c-4e5c-b905-4348ba0e4c05\") "
Aug 04 18:35:25.550829 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:25.550805    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de47475a-2f9c-4e5c-b905-4348ba0e4c05-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "de47475a-2f9c-4e5c-b905-4348ba0e4c05" (UID: "de47475a-2f9c-4e5c-b905-4348ba0e4c05"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:35:25.651045 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:25.651021    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de47475a-2f9c-4e5c-b905-4348ba0e4c05-maas-api-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:35:26.329579 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:26.329546    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd"
Aug 04 18:35:26.329757 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:26.329584    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd" event={"ID":"de47475a-2f9c-4e5c-b905-4348ba0e4c05","Type":"ContainerDied","Data":"95ce5f0d5520973f511874b4a047d585ebc44ff6ec5495d38fa48bcf483b347b"}
Aug 04 18:35:26.329757 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:26.329633    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95ce5f0d5520973f511874b4a047d585ebc44ff6ec5495d38fa48bcf483b347b"
Aug 04 18:35:38.483539 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:38.483489    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd"]
Aug 04 18:35:38.485967 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:38.485944    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-95cf1a-hcxfd"]
Aug 04 18:35:39.598784 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:39.598746    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de47475a-2f9c-4e5c-b905-4348ba0e4c05" path="/var/lib/kubelet/pods/de47475a-2f9c-4e5c-b905-4348ba0e4c05/volumes"
Aug 04 18:35:40.378275 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:40.378239    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:35:51.771515 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:35:51.771479    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:36:18.217168 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.217083    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"]
Aug 04 18:36:18.217604 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.217585    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de47475a-2f9c-4e5c-b905-4348ba0e4c05" containerName="revoke-keys"
Aug 04 18:36:18.217648 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.217606    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="de47475a-2f9c-4e5c-b905-4348ba0e4c05" containerName="revoke-keys"
Aug 04 18:36:18.217684 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.217677    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="de47475a-2f9c-4e5c-b905-4348ba0e4c05" containerName="revoke-keys"
Aug 04 18:36:18.220791 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.220771    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"
Aug 04 18:36:18.223090 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.223067    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-e9be3f-dockercfg-mrclz\""
Aug 04 18:36:18.223216 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.223181    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-e9be3f\""
Aug 04 18:36:18.232848 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.232822    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"]
Aug 04 18:36:18.307032 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.307005    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/894be2d4-46c0-4725-8ea2-b8081ec5ddf7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr\" (UID: \"894be2d4-46c0-4725-8ea2-b8081ec5ddf7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"
Aug 04 18:36:18.307182 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.307143    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-444w2\" (UniqueName: \"kubernetes.io/projected/894be2d4-46c0-4725-8ea2-b8081ec5ddf7-kube-api-access-444w2\") pod \"payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr\" (UID: \"894be2d4-46c0-4725-8ea2-b8081ec5ddf7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"
Aug 04 18:36:18.408621 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.408584    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-444w2\" (UniqueName: \"kubernetes.io/projected/894be2d4-46c0-4725-8ea2-b8081ec5ddf7-kube-api-access-444w2\") pod \"payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr\" (UID: \"894be2d4-46c0-4725-8ea2-b8081ec5ddf7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"
Aug 04 18:36:18.408766 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.408741    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/894be2d4-46c0-4725-8ea2-b8081ec5ddf7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr\" (UID: \"894be2d4-46c0-4725-8ea2-b8081ec5ddf7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"
Aug 04 18:36:18.409456 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.409437    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/894be2d4-46c0-4725-8ea2-b8081ec5ddf7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr\" (UID: \"894be2d4-46c0-4725-8ea2-b8081ec5ddf7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"
Aug 04 18:36:18.415775 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.415756    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-444w2\" (UniqueName: \"kubernetes.io/projected/894be2d4-46c0-4725-8ea2-b8081ec5ddf7-kube-api-access-444w2\") pod \"payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr\" (UID: \"894be2d4-46c0-4725-8ea2-b8081ec5ddf7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"
Aug 04 18:36:18.536211 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.536123    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"
Aug 04 18:36:18.872264 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.872238    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"]
Aug 04 18:36:18.873998 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:36:18.873973    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod894be2d4_46c0_4725_8ea2_b8081ec5ddf7.slice/crio-d18e05b65acc7e455efa167e0fb56160508ba1d2c92f49ae34ab04fe14ac99d6 WatchSource:0}: Error finding container d18e05b65acc7e455efa167e0fb56160508ba1d2c92f49ae34ab04fe14ac99d6: Status 404 returned error can't find the container with id d18e05b65acc7e455efa167e0fb56160508ba1d2c92f49ae34ab04fe14ac99d6
Aug 04 18:36:18.876332 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:18.876308    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:36:19.642230 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:19.642193    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr" event={"ID":"894be2d4-46c0-4725-8ea2-b8081ec5ddf7","Type":"ContainerStarted","Data":"d18e05b65acc7e455efa167e0fb56160508ba1d2c92f49ae34ab04fe14ac99d6"}
Aug 04 18:36:20.674345 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:20.674312    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:36:21.658344 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:21.658304    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr" event={"ID":"894be2d4-46c0-4725-8ea2-b8081ec5ddf7","Type":"ContainerStarted","Data":"ab2079e22b5a4a069e0ecaea3ad4d759547a12bdd4462b0cee7d5cff25e1987f"}
Aug 04 18:36:21.658563 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:21.658440    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"
Aug 04 18:36:21.676560 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:21.676513    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr" podStartSLOduration=1.866449279 podStartE2EDuration="3.676488834s" totalImagesPullingTime="1.810039555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:36:21.673595457 +0000 UTC m=+2966.583485044" watchObservedRunningTime="2026-08-04 18:36:21.676488834 +0000 UTC m=+2966.586378421"
Aug 04 18:36:32.666040 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:32.666005    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"
Aug 04 18:36:50.086571 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:50.086535    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:36:55.806339 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:55.806307    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:36:55.816471 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:36:55.816450    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:37:14.074826 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:37:14.074789    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:37:41.479358 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:37:41.479319    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:37:57.224757 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:37:57.224680    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:38:08.885774 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:38:08.885734    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:38:23.081509 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:38:23.081474    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:38:32.675109 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:38:32.675075    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:38:47.576671 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:38:47.576635    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:38:58.184229 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:38:58.184194    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:39:13.681317 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:39:13.681280    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:39:29.775054 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:39:29.774970    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:39:40.585014 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:39:40.584974    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:39:55.877092 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:39:55.877057    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:39:55.970472 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:39:55.970438    2572 scope.go:117] "RemoveContainer" containerID="42089f7e36d154dbfd5267a6557453770e88a1e78959393431954ae8e54f0e6b"
Aug 04 18:39:55.979349 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:39:55.979329    2572 scope.go:117] "RemoveContainer" containerID="922a75a8a6aa1cda935d44a87bbbc167a3dbe6b6695786a9130ca71e52d267be"
Aug 04 18:40:07.076672 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:40:07.076632    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:40:22.075886 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:40:22.075850    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:40:32.375659 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:40:32.375618    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:40:43.187683 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:40:43.187650    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:41:20.086361 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:41:20.086276    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:41:55.845285 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:41:55.845259    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:41:55.856055 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:41:55.856034    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:41:56.011707 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:41:56.011675    2572 scope.go:117] "RemoveContainer" containerID="6e029a51e172275289a750b274de292b3689aeecdee2c5af4d38a9cd0a9919d3"
Aug 04 18:41:56.020353 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:41:56.020332    2572 scope.go:117] "RemoveContainer" containerID="7062790ee1cb59784b3169d2f5a36f108b3770b8e3843d38fac6aa8b80228426"
Aug 04 18:42:14.982863 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:42:14.982830    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:42:26.183499 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:42:26.183413    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:42:54.280772 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:42:54.280737    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:43:04.077471 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:43:04.077433    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:43:10.580422 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:43:10.580378    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:43:30.574608 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:43:30.574573    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:44:06.383930 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:06.383892    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:44:14.675046 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:14.675007    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:44:40.782936 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:40.782875    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:44:48.184994 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:48.184959    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7179-140512034544176"]
Aug 04 18:44:48.188707 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:48.188691    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034544176"
Aug 04 18:44:48.191152 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:48.191129    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qmdb4\""
Aug 04 18:44:48.193745 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:48.193722    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140512034544176"]
Aug 04 18:44:48.217585 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:48.217564    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2rzr\" (UniqueName: \"kubernetes.io/projected/695fd2b5-b5bc-421f-ad5e-de0b67c20812-kube-api-access-h2rzr\") pod \"test-curl-7179-140512034544176\" (UID: \"695fd2b5-b5bc-421f-ad5e-de0b67c20812\") " pod="opendatahub/test-curl-7179-140512034544176"
Aug 04 18:44:48.318385 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:48.318352    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2rzr\" (UniqueName: \"kubernetes.io/projected/695fd2b5-b5bc-421f-ad5e-de0b67c20812-kube-api-access-h2rzr\") pod \"test-curl-7179-140512034544176\" (UID: \"695fd2b5-b5bc-421f-ad5e-de0b67c20812\") " pod="opendatahub/test-curl-7179-140512034544176"
Aug 04 18:44:48.325788 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:48.325760    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2rzr\" (UniqueName: \"kubernetes.io/projected/695fd2b5-b5bc-421f-ad5e-de0b67c20812-kube-api-access-h2rzr\") pod \"test-curl-7179-140512034544176\" (UID: \"695fd2b5-b5bc-421f-ad5e-de0b67c20812\") " pod="opendatahub/test-curl-7179-140512034544176"
Aug 04 18:44:48.499422 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:48.499330    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034544176"
Aug 04 18:44:48.630728 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:48.630701    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140512034544176"]
Aug 04 18:44:48.631694 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:44:48.631665    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod695fd2b5_b5bc_421f_ad5e_de0b67c20812.slice/crio-8d73ec02427e3fbdcd95145d967fd07c8b76bf2b76e84870793c24c7824144bc WatchSource:0}: Error finding container 8d73ec02427e3fbdcd95145d967fd07c8b76bf2b76e84870793c24c7824144bc: Status 404 returned error can't find the container with id 8d73ec02427e3fbdcd95145d967fd07c8b76bf2b76e84870793c24c7824144bc
Aug 04 18:44:48.633485 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:48.633463    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:44:49.377155 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:49.377121    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:44:49.603939 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:49.603824    2572 generic.go:356] "Generic (PLEG): container finished" podID="695fd2b5-b5bc-421f-ad5e-de0b67c20812" containerID="ed17d74ce59d19611aca2ae68103955bd104ba042d2f7572aacbb746d9b59d14" exitCode=0
Aug 04 18:44:49.604649 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:49.604618    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140512034544176" event={"ID":"695fd2b5-b5bc-421f-ad5e-de0b67c20812","Type":"ContainerDied","Data":"ed17d74ce59d19611aca2ae68103955bd104ba042d2f7572aacbb746d9b59d14"}
Aug 04 18:44:49.604696 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:49.604670    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140512034544176" event={"ID":"695fd2b5-b5bc-421f-ad5e-de0b67c20812","Type":"ContainerStarted","Data":"8d73ec02427e3fbdcd95145d967fd07c8b76bf2b76e84870793c24c7824144bc"}
Aug 04 18:44:50.750376 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:50.750351    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034544176"
Aug 04 18:44:50.781333 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:50.781303    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7179-140512034544176_695fd2b5-b5bc-421f-ad5e-de0b67c20812/test-curl-7179-140512034544176/0.log"
Aug 04 18:44:50.802293 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:50.802266    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7179-140512034544176"]
Aug 04 18:44:50.804956 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:50.804933    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7179-140512034544176"]
Aug 04 18:44:50.839960 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:50.839911    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2rzr\" (UniqueName: \"kubernetes.io/projected/695fd2b5-b5bc-421f-ad5e-de0b67c20812-kube-api-access-h2rzr\") pod \"695fd2b5-b5bc-421f-ad5e-de0b67c20812\" (UID: \"695fd2b5-b5bc-421f-ad5e-de0b67c20812\") "
Aug 04 18:44:50.842194 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:50.842162    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/695fd2b5-b5bc-421f-ad5e-de0b67c20812-kube-api-access-h2rzr" (OuterVolumeSpecName: "kube-api-access-h2rzr") pod "695fd2b5-b5bc-421f-ad5e-de0b67c20812" (UID: "695fd2b5-b5bc-421f-ad5e-de0b67c20812"). InnerVolumeSpecName "kube-api-access-h2rzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:44:50.923245 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:50.923173    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7179-140512034541872"]
Aug 04 18:44:50.923779 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:50.923756    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695fd2b5-b5bc-421f-ad5e-de0b67c20812" containerName="test-curl-7179-140512034544176"
Aug 04 18:44:50.923883 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:50.923781    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="695fd2b5-b5bc-421f-ad5e-de0b67c20812" containerName="test-curl-7179-140512034544176"
Aug 04 18:44:50.923983 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:50.923912    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="695fd2b5-b5bc-421f-ad5e-de0b67c20812" containerName="test-curl-7179-140512034544176"
Aug 04 18:44:50.926964 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:50.926944    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034541872"
Aug 04 18:44:50.929576 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:50.929553    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140512034541872"]
Aug 04 18:44:50.941171 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:50.941147    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2lft\" (UniqueName: \"kubernetes.io/projected/cbd08fba-8bc1-4280-9b89-df5fdb9904f3-kube-api-access-q2lft\") pod \"test-curl-7179-140512034541872\" (UID: \"cbd08fba-8bc1-4280-9b89-df5fdb9904f3\") " pod="opendatahub/test-curl-7179-140512034541872"
Aug 04 18:44:50.941257 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:50.941207    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2rzr\" (UniqueName: \"kubernetes.io/projected/695fd2b5-b5bc-421f-ad5e-de0b67c20812-kube-api-access-h2rzr\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:44:51.041859 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:51.041827    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2lft\" (UniqueName: \"kubernetes.io/projected/cbd08fba-8bc1-4280-9b89-df5fdb9904f3-kube-api-access-q2lft\") pod \"test-curl-7179-140512034541872\" (UID: \"cbd08fba-8bc1-4280-9b89-df5fdb9904f3\") " pod="opendatahub/test-curl-7179-140512034541872"
Aug 04 18:44:51.049198 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:51.049171    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2lft\" (UniqueName: \"kubernetes.io/projected/cbd08fba-8bc1-4280-9b89-df5fdb9904f3-kube-api-access-q2lft\") pod \"test-curl-7179-140512034541872\" (UID: \"cbd08fba-8bc1-4280-9b89-df5fdb9904f3\") " pod="opendatahub/test-curl-7179-140512034541872"
Aug 04 18:44:51.238728 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:51.238644    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034541872"
Aug 04 18:44:51.370700 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:51.370674    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140512034541872"]
Aug 04 18:44:51.373345 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:44:51.373320    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbd08fba_8bc1_4280_9b89_df5fdb9904f3.slice/crio-3cb924c443d54c4747ef50888a2f523192468efbd04151089cce65a493e15c96 WatchSource:0}: Error finding container 3cb924c443d54c4747ef50888a2f523192468efbd04151089cce65a493e15c96: Status 404 returned error can't find the container with id 3cb924c443d54c4747ef50888a2f523192468efbd04151089cce65a493e15c96
Aug 04 18:44:51.599240 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:51.599208    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="695fd2b5-b5bc-421f-ad5e-de0b67c20812" path="/var/lib/kubelet/pods/695fd2b5-b5bc-421f-ad5e-de0b67c20812/volumes"
Aug 04 18:44:51.616354 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:51.616336    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034544176"
Aug 04 18:44:51.616469 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:51.616340    2572 scope.go:117] "RemoveContainer" containerID="ed17d74ce59d19611aca2ae68103955bd104ba042d2f7572aacbb746d9b59d14"
Aug 04 18:44:51.617624 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:51.617520    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140512034541872" event={"ID":"cbd08fba-8bc1-4280-9b89-df5fdb9904f3","Type":"ContainerStarted","Data":"3cb924c443d54c4747ef50888a2f523192468efbd04151089cce65a493e15c96"}
Aug 04 18:44:52.626348 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:52.626309    2572 generic.go:356] "Generic (PLEG): container finished" podID="cbd08fba-8bc1-4280-9b89-df5fdb9904f3" containerID="7e8ce6a36b03a40948c4435769cd4c9e2ea5bc2cd562c36ac3e54114f20bab3f" exitCode=0
Aug 04 18:44:52.626795 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:52.626400    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140512034541872" event={"ID":"cbd08fba-8bc1-4280-9b89-df5fdb9904f3","Type":"ContainerDied","Data":"7e8ce6a36b03a40948c4435769cd4c9e2ea5bc2cd562c36ac3e54114f20bab3f"}
Aug 04 18:44:53.772280 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:53.772253    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034541872"
Aug 04 18:44:53.790160 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:53.790136    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7179-140512034541872_cbd08fba-8bc1-4280-9b89-df5fdb9904f3/test-curl-7179-140512034541872/0.log"
Aug 04 18:44:53.811323 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:53.811294    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7179-140512034541872"]
Aug 04 18:44:53.816546 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:53.816522    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7179-140512034541872"]
Aug 04 18:44:53.869860 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:53.869827    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2lft\" (UniqueName: \"kubernetes.io/projected/cbd08fba-8bc1-4280-9b89-df5fdb9904f3-kube-api-access-q2lft\") pod \"cbd08fba-8bc1-4280-9b89-df5fdb9904f3\" (UID: \"cbd08fba-8bc1-4280-9b89-df5fdb9904f3\") "
Aug 04 18:44:53.871860 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:53.871831    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbd08fba-8bc1-4280-9b89-df5fdb9904f3-kube-api-access-q2lft" (OuterVolumeSpecName: "kube-api-access-q2lft") pod "cbd08fba-8bc1-4280-9b89-df5fdb9904f3" (UID: "cbd08fba-8bc1-4280-9b89-df5fdb9904f3"). InnerVolumeSpecName "kube-api-access-q2lft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:44:53.966295 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:53.966209    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7179-140512034630944"]
Aug 04 18:44:53.966663 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:53.966639    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbd08fba-8bc1-4280-9b89-df5fdb9904f3" containerName="test-curl-7179-140512034541872"
Aug 04 18:44:53.966663 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:53.966656    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbd08fba-8bc1-4280-9b89-df5fdb9904f3" containerName="test-curl-7179-140512034541872"
Aug 04 18:44:53.966794 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:53.966742    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbd08fba-8bc1-4280-9b89-df5fdb9904f3" containerName="test-curl-7179-140512034541872"
Aug 04 18:44:53.969959 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:53.969941    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034630944"
Aug 04 18:44:53.970520 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:53.970492    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2lft\" (UniqueName: \"kubernetes.io/projected/cbd08fba-8bc1-4280-9b89-df5fdb9904f3-kube-api-access-q2lft\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:44:53.973820 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:53.973796    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140512034630944"]
Aug 04 18:44:54.071749 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:54.071714    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mq9x\" (UniqueName: \"kubernetes.io/projected/0ec504e1-02af-4a2f-b5ab-1d9797dcbafb-kube-api-access-8mq9x\") pod \"test-curl-7179-140512034630944\" (UID: \"0ec504e1-02af-4a2f-b5ab-1d9797dcbafb\") " pod="opendatahub/test-curl-7179-140512034630944"
Aug 04 18:44:54.173016 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:54.172980    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mq9x\" (UniqueName: \"kubernetes.io/projected/0ec504e1-02af-4a2f-b5ab-1d9797dcbafb-kube-api-access-8mq9x\") pod \"test-curl-7179-140512034630944\" (UID: \"0ec504e1-02af-4a2f-b5ab-1d9797dcbafb\") " pod="opendatahub/test-curl-7179-140512034630944"
Aug 04 18:44:54.180728 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:54.180700    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mq9x\" (UniqueName: \"kubernetes.io/projected/0ec504e1-02af-4a2f-b5ab-1d9797dcbafb-kube-api-access-8mq9x\") pod \"test-curl-7179-140512034630944\" (UID: \"0ec504e1-02af-4a2f-b5ab-1d9797dcbafb\") " pod="opendatahub/test-curl-7179-140512034630944"
Aug 04 18:44:54.280516 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:54.280452    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034630944"
Aug 04 18:44:54.416525 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:54.416497    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140512034630944"]
Aug 04 18:44:54.417736 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:44:54.417714    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ec504e1_02af_4a2f_b5ab_1d9797dcbafb.slice/crio-d2656f779f9c73612893092e867244e02308e739ae9c79bc322d77df89ac1a5d WatchSource:0}: Error finding container d2656f779f9c73612893092e867244e02308e739ae9c79bc322d77df89ac1a5d: Status 404 returned error can't find the container with id d2656f779f9c73612893092e867244e02308e739ae9c79bc322d77df89ac1a5d
Aug 04 18:44:54.643412 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:54.643388    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034541872"
Aug 04 18:44:54.643412 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:54.643403    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cb924c443d54c4747ef50888a2f523192468efbd04151089cce65a493e15c96"
Aug 04 18:44:54.644676 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:54.644652    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140512034630944" event={"ID":"0ec504e1-02af-4a2f-b5ab-1d9797dcbafb","Type":"ContainerStarted","Data":"d2656f779f9c73612893092e867244e02308e739ae9c79bc322d77df89ac1a5d"}
Aug 04 18:44:54.654497 ip-10-0-141-117 kubenswrapper[2572]: E0804 18:44:54.654473    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7179-140512034541872\" is forbidden: User \"system:node:ip-10-0-141-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-117.ec2.internal' and this object" podUID="cbd08fba-8bc1-4280-9b89-df5fdb9904f3" pod="opendatahub/test-curl-7179-140512034541872"
Aug 04 18:44:55.597912 ip-10-0-141-117 kubenswrapper[2572]: E0804 18:44:55.597873    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7179-140512034541872\" is forbidden: User \"system:node:ip-10-0-141-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-117.ec2.internal' and this object" podUID="cbd08fba-8bc1-4280-9b89-df5fdb9904f3" pod="opendatahub/test-curl-7179-140512034541872"
Aug 04 18:44:55.599664 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:55.599642    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbd08fba-8bc1-4280-9b89-df5fdb9904f3" path="/var/lib/kubelet/pods/cbd08fba-8bc1-4280-9b89-df5fdb9904f3/volumes"
Aug 04 18:44:55.651932 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:55.651890    2572 generic.go:356] "Generic (PLEG): container finished" podID="0ec504e1-02af-4a2f-b5ab-1d9797dcbafb" containerID="db9b3b1a6f0418c5c5128eb3992a32d9a81e177f8e70113cdd4f11d02e1c782d" exitCode=0
Aug 04 18:44:55.652087 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:55.652025    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140512034630944" event={"ID":"0ec504e1-02af-4a2f-b5ab-1d9797dcbafb","Type":"ContainerDied","Data":"db9b3b1a6f0418c5c5128eb3992a32d9a81e177f8e70113cdd4f11d02e1c782d"}
Aug 04 18:44:56.784410 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:56.784385    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034630944"
Aug 04 18:44:56.809881 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:56.809847    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7179-140512034630944_0ec504e1-02af-4a2f-b5ab-1d9797dcbafb/test-curl-7179-140512034630944/0.log"
Aug 04 18:44:56.834296 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:56.834270    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7179-140512034630944"]
Aug 04 18:44:56.836487 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:56.836466    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7179-140512034630944"]
Aug 04 18:44:56.897161 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:56.897130    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mq9x\" (UniqueName: \"kubernetes.io/projected/0ec504e1-02af-4a2f-b5ab-1d9797dcbafb-kube-api-access-8mq9x\") pod \"0ec504e1-02af-4a2f-b5ab-1d9797dcbafb\" (UID: \"0ec504e1-02af-4a2f-b5ab-1d9797dcbafb\") "
Aug 04 18:44:56.899232 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:56.899206    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ec504e1-02af-4a2f-b5ab-1d9797dcbafb-kube-api-access-8mq9x" (OuterVolumeSpecName: "kube-api-access-8mq9x") pod "0ec504e1-02af-4a2f-b5ab-1d9797dcbafb" (UID: "0ec504e1-02af-4a2f-b5ab-1d9797dcbafb"). InnerVolumeSpecName "kube-api-access-8mq9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:44:56.946016 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:56.945959    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7179-140512034630944"]
Aug 04 18:44:56.946394 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:56.946380    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec504e1-02af-4a2f-b5ab-1d9797dcbafb" containerName="test-curl-7179-140512034630944"
Aug 04 18:44:56.946438 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:56.946396    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec504e1-02af-4a2f-b5ab-1d9797dcbafb" containerName="test-curl-7179-140512034630944"
Aug 04 18:44:56.946482 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:56.946473    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ec504e1-02af-4a2f-b5ab-1d9797dcbafb" containerName="test-curl-7179-140512034630944"
Aug 04 18:44:56.949551 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:56.949537    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034630944"
Aug 04 18:44:56.954228 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:56.954202    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140512034630944"]
Aug 04 18:44:56.998152 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:56.998126    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8c8l\" (UniqueName: \"kubernetes.io/projected/bbfb85f1-767c-4eb6-92a7-1af8a93bdff2-kube-api-access-z8c8l\") pod \"test-curl-7179-140512034630944\" (UID: \"bbfb85f1-767c-4eb6-92a7-1af8a93bdff2\") " pod="opendatahub/test-curl-7179-140512034630944"
Aug 04 18:44:56.998279 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:56.998173    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mq9x\" (UniqueName: \"kubernetes.io/projected/0ec504e1-02af-4a2f-b5ab-1d9797dcbafb-kube-api-access-8mq9x\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:44:57.099434 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:57.099400    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8c8l\" (UniqueName: \"kubernetes.io/projected/bbfb85f1-767c-4eb6-92a7-1af8a93bdff2-kube-api-access-z8c8l\") pod \"test-curl-7179-140512034630944\" (UID: \"bbfb85f1-767c-4eb6-92a7-1af8a93bdff2\") " pod="opendatahub/test-curl-7179-140512034630944"
Aug 04 18:44:57.108298 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:57.108273    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8c8l\" (UniqueName: \"kubernetes.io/projected/bbfb85f1-767c-4eb6-92a7-1af8a93bdff2-kube-api-access-z8c8l\") pod \"test-curl-7179-140512034630944\" (UID: \"bbfb85f1-767c-4eb6-92a7-1af8a93bdff2\") " pod="opendatahub/test-curl-7179-140512034630944"
Aug 04 18:44:57.260414 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:57.260333    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034630944"
Aug 04 18:44:57.390244 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:57.390221    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140512034630944"]
Aug 04 18:44:57.391361 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:44:57.391335    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbfb85f1_767c_4eb6_92a7_1af8a93bdff2.slice/crio-d2f2f1ee64f795d86a6131ec6c514cfb99bd984220bd724c93d00b29a8bf79f2 WatchSource:0}: Error finding container d2f2f1ee64f795d86a6131ec6c514cfb99bd984220bd724c93d00b29a8bf79f2: Status 404 returned error can't find the container with id d2f2f1ee64f795d86a6131ec6c514cfb99bd984220bd724c93d00b29a8bf79f2
Aug 04 18:44:57.599231 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:57.599199    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ec504e1-02af-4a2f-b5ab-1d9797dcbafb" path="/var/lib/kubelet/pods/0ec504e1-02af-4a2f-b5ab-1d9797dcbafb/volumes"
Aug 04 18:44:57.667213 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:57.665147    2572 scope.go:117] "RemoveContainer" containerID="db9b3b1a6f0418c5c5128eb3992a32d9a81e177f8e70113cdd4f11d02e1c782d"
Aug 04 18:44:57.667213 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:57.665325    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034630944"
Aug 04 18:44:57.669122 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:57.669088    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140512034630944" event={"ID":"bbfb85f1-767c-4eb6-92a7-1af8a93bdff2","Type":"ContainerStarted","Data":"d2f2f1ee64f795d86a6131ec6c514cfb99bd984220bd724c93d00b29a8bf79f2"}
Aug 04 18:44:58.676450 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:58.676414    2572 generic.go:356] "Generic (PLEG): container finished" podID="bbfb85f1-767c-4eb6-92a7-1af8a93bdff2" containerID="638cd4cc325ed1447e35c62a65421a65de37c2b07f8a03b04d3e736fa5c6474f" exitCode=0
Aug 04 18:44:58.676883 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:58.676499    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140512034630944" event={"ID":"bbfb85f1-767c-4eb6-92a7-1af8a93bdff2","Type":"ContainerDied","Data":"638cd4cc325ed1447e35c62a65421a65de37c2b07f8a03b04d3e736fa5c6474f"}
Aug 04 18:44:59.819090 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:59.819065    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034630944"
Aug 04 18:44:59.841702 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:59.841675    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7179-140512034630944_bbfb85f1-767c-4eb6-92a7-1af8a93bdff2/test-curl-7179-140512034630944/0.log"
Aug 04 18:44:59.862138 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:59.862116    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7179-140512034630944"]
Aug 04 18:44:59.864172 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:59.864152    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7179-140512034630944"]
Aug 04 18:44:59.925416 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:59.925391    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8c8l\" (UniqueName: \"kubernetes.io/projected/bbfb85f1-767c-4eb6-92a7-1af8a93bdff2-kube-api-access-z8c8l\") pod \"bbfb85f1-767c-4eb6-92a7-1af8a93bdff2\" (UID: \"bbfb85f1-767c-4eb6-92a7-1af8a93bdff2\") "
Aug 04 18:44:59.927370 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:59.927351    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbfb85f1-767c-4eb6-92a7-1af8a93bdff2-kube-api-access-z8c8l" (OuterVolumeSpecName: "kube-api-access-z8c8l") pod "bbfb85f1-767c-4eb6-92a7-1af8a93bdff2" (UID: "bbfb85f1-767c-4eb6-92a7-1af8a93bdff2"). InnerVolumeSpecName "kube-api-access-z8c8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:44:59.976863 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:59.976802    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7179-140512034509136"]
Aug 04 18:44:59.977217 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:59.977204    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbfb85f1-767c-4eb6-92a7-1af8a93bdff2" containerName="test-curl-7179-140512034630944"
Aug 04 18:44:59.977260 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:59.977219    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbfb85f1-767c-4eb6-92a7-1af8a93bdff2" containerName="test-curl-7179-140512034630944"
Aug 04 18:44:59.977296 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:59.977284    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbfb85f1-767c-4eb6-92a7-1af8a93bdff2" containerName="test-curl-7179-140512034630944"
Aug 04 18:44:59.980310 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:59.980296    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034509136"
Aug 04 18:44:59.986519 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:44:59.986497    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140512034509136"]
Aug 04 18:45:00.026251 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.026219    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhxzj\" (UniqueName: \"kubernetes.io/projected/045b9d73-b6a9-4939-9656-95700afa469f-kube-api-access-bhxzj\") pod \"test-curl-7179-140512034509136\" (UID: \"045b9d73-b6a9-4939-9656-95700afa469f\") " pod="opendatahub/test-curl-7179-140512034509136"
Aug 04 18:45:00.026423 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.026389    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8c8l\" (UniqueName: \"kubernetes.io/projected/bbfb85f1-767c-4eb6-92a7-1af8a93bdff2-kube-api-access-z8c8l\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:45:00.126955 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.126902    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhxzj\" (UniqueName: \"kubernetes.io/projected/045b9d73-b6a9-4939-9656-95700afa469f-kube-api-access-bhxzj\") pod \"test-curl-7179-140512034509136\" (UID: \"045b9d73-b6a9-4939-9656-95700afa469f\") " pod="opendatahub/test-curl-7179-140512034509136"
Aug 04 18:45:00.134952 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.134913    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhxzj\" (UniqueName: \"kubernetes.io/projected/045b9d73-b6a9-4939-9656-95700afa469f-kube-api-access-bhxzj\") pod \"test-curl-7179-140512034509136\" (UID: \"045b9d73-b6a9-4939-9656-95700afa469f\") " pod="opendatahub/test-curl-7179-140512034509136"
Aug 04 18:45:00.138085 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.138062    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e9be3f-29764485-2xm26"]
Aug 04 18:45:00.142208 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.142188    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4659f1-29764485-jflvz"]
Aug 04 18:45:00.142372 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.142349    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e9be3f-29764485-2xm26"
Aug 04 18:45:00.144798 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.144783    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:45:00.145898 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.145884    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764485-w7lls"]
Aug 04 18:45:00.146006 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.145992    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4659f1-29764485-jflvz"
Aug 04 18:45:00.149607 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.149582    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-w7lls"
Aug 04 18:45:00.151908 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.151888    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e9be3f-29764485-2xm26"]
Aug 04 18:45:00.155127 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.155104    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4659f1-29764485-jflvz"]
Aug 04 18:45:00.156601 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.156577    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e9be3f-29764485-2xm26"
Aug 04 18:45:00.158006 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.157987    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764485-w7lls"]
Aug 04 18:45:00.166159 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.166138    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4659f1-29764485-jflvz"
Aug 04 18:45:00.186735 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.186712    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-w7lls"
Aug 04 18:45:00.290331 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.290166    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034509136"
Aug 04 18:45:00.438107 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.438081    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140512034509136"]
Aug 04 18:45:00.439121 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:45:00.439092    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod045b9d73_b6a9_4939_9656_95700afa469f.slice/crio-d0faea0e6fa1332025cb2c220f89a16ac9c60db5a9e740e355b647537b2342b0 WatchSource:0}: Error finding container d0faea0e6fa1332025cb2c220f89a16ac9c60db5a9e740e355b647537b2342b0: Status 404 returned error can't find the container with id d0faea0e6fa1332025cb2c220f89a16ac9c60db5a9e740e355b647537b2342b0
Aug 04 18:45:00.520005 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.519981    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e9be3f-29764485-2xm26"]
Aug 04 18:45:00.522018 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:45:00.521987    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf05befd4_ff50_4ed5_bf4f_3e8d88dacf10.slice/crio-8b5ec772910b2fd8b348b6fc2e1291afdcd43d1f565b885aa37801a0fdb65170 WatchSource:0}: Error finding container 8b5ec772910b2fd8b348b6fc2e1291afdcd43d1f565b885aa37801a0fdb65170: Status 404 returned error can't find the container with id 8b5ec772910b2fd8b348b6fc2e1291afdcd43d1f565b885aa37801a0fdb65170
Aug 04 18:45:00.548288 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.548261    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4659f1-29764485-jflvz"]
Aug 04 18:45:00.553132 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:45:00.553102    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod071e13b8_ad5b_4b8b_b53f_77d6256de910.slice/crio-4f1014e561c59900d7fff2d4c3fefc1875c368883b2304f847d7e52c2222410d WatchSource:0}: Error finding container 4f1014e561c59900d7fff2d4c3fefc1875c368883b2304f847d7e52c2222410d: Status 404 returned error can't find the container with id 4f1014e561c59900d7fff2d4c3fefc1875c368883b2304f847d7e52c2222410d
Aug 04 18:45:00.570464 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.570435    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764485-w7lls"]
Aug 04 18:45:00.571179 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:45:00.571155    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41cf0a28_44f0_435b_af52_bce385839d33.slice/crio-c2a0f17c59a05a6b937c0984f88eb05c36e3dc1ff29ac375898dbd847c543ad5 WatchSource:0}: Error finding container c2a0f17c59a05a6b937c0984f88eb05c36e3dc1ff29ac375898dbd847c543ad5: Status 404 returned error can't find the container with id c2a0f17c59a05a6b937c0984f88eb05c36e3dc1ff29ac375898dbd847c543ad5
Aug 04 18:45:00.690484 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.690454    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140512034509136" event={"ID":"045b9d73-b6a9-4939-9656-95700afa469f","Type":"ContainerStarted","Data":"d0faea0e6fa1332025cb2c220f89a16ac9c60db5a9e740e355b647537b2342b0"}
Aug 04 18:45:00.691769 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.691752    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2f2f1ee64f795d86a6131ec6c514cfb99bd984220bd724c93d00b29a8bf79f2"
Aug 04 18:45:00.691769 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.691756    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034630944"
Aug 04 18:45:00.693117 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.693093    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e9be3f-29764485-2xm26" event={"ID":"f05befd4-ff50-4ed5-bf4f-3e8d88dacf10","Type":"ContainerStarted","Data":"8b5ec772910b2fd8b348b6fc2e1291afdcd43d1f565b885aa37801a0fdb65170"}
Aug 04 18:45:00.694311 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.694285    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4659f1-29764485-jflvz" event={"ID":"071e13b8-ad5b-4b8b-b53f-77d6256de910","Type":"ContainerStarted","Data":"4f1014e561c59900d7fff2d4c3fefc1875c368883b2304f847d7e52c2222410d"}
Aug 04 18:45:00.695404 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:00.695381    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-w7lls" event={"ID":"41cf0a28-44f0-435b-af52-bce385839d33","Type":"ContainerStarted","Data":"c2a0f17c59a05a6b937c0984f88eb05c36e3dc1ff29ac375898dbd847c543ad5"}
Aug 04 18:45:00.702237 ip-10-0-141-117 kubenswrapper[2572]: E0804 18:45:00.702214    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7179-140512034630944\" is forbidden: User \"system:node:ip-10-0-141-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-117.ec2.internal' and this object" podUID="bbfb85f1-767c-4eb6-92a7-1af8a93bdff2" pod="opendatahub/test-curl-7179-140512034630944"
Aug 04 18:45:01.599503 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:01.599473    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbfb85f1-767c-4eb6-92a7-1af8a93bdff2" path="/var/lib/kubelet/pods/bbfb85f1-767c-4eb6-92a7-1af8a93bdff2/volumes"
Aug 04 18:45:01.702740 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:01.702667    2572 generic.go:356] "Generic (PLEG): container finished" podID="41cf0a28-44f0-435b-af52-bce385839d33" containerID="7e302f436b129b7ca41589ba9a7c48895edffcb4226b8fbd44b215850e0f0539" exitCode=0
Aug 04 18:45:01.702740 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:01.702713    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-w7lls" event={"ID":"41cf0a28-44f0-435b-af52-bce385839d33","Type":"ContainerDied","Data":"7e302f436b129b7ca41589ba9a7c48895edffcb4226b8fbd44b215850e0f0539"}
Aug 04 18:45:01.704200 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:01.704175    2572 generic.go:356] "Generic (PLEG): container finished" podID="045b9d73-b6a9-4939-9656-95700afa469f" containerID="7216177d1ceeb4283787717035c83129cad1df6b51c3de1431bd46da7e0aaae7" exitCode=0
Aug 04 18:45:01.704321 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:01.704239    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140512034509136" event={"ID":"045b9d73-b6a9-4939-9656-95700afa469f","Type":"ContainerDied","Data":"7216177d1ceeb4283787717035c83129cad1df6b51c3de1431bd46da7e0aaae7"}
Aug 04 18:45:01.705716 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:01.705697    2572 generic.go:356] "Generic (PLEG): container finished" podID="f05befd4-ff50-4ed5-bf4f-3e8d88dacf10" containerID="8dc432a19ac03c5e64ed305b9316275813973d1ffd65c42cefacdd26dc29a71b" exitCode=0
Aug 04 18:45:01.705813 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:01.705755    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e9be3f-29764485-2xm26" event={"ID":"f05befd4-ff50-4ed5-bf4f-3e8d88dacf10","Type":"ContainerDied","Data":"8dc432a19ac03c5e64ed305b9316275813973d1ffd65c42cefacdd26dc29a71b"}
Aug 04 18:45:01.707279 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:01.707258    2572 generic.go:356] "Generic (PLEG): container finished" podID="071e13b8-ad5b-4b8b-b53f-77d6256de910" containerID="1aff7d8d79c17b2c34bb06c02e7c592e8eb14879cdc8597b919253c03dc50a98" exitCode=0
Aug 04 18:45:01.707279 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:01.707283    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4659f1-29764485-jflvz" event={"ID":"071e13b8-ad5b-4b8b-b53f-77d6256de910","Type":"ContainerDied","Data":"1aff7d8d79c17b2c34bb06c02e7c592e8eb14879cdc8597b919253c03dc50a98"}
Aug 04 18:45:02.876781 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:02.876753    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4659f1-29764485-jflvz"
Aug 04 18:45:02.922616 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:02.922588    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e9be3f-29764485-2xm26"
Aug 04 18:45:02.925830 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:02.925808    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-w7lls"
Aug 04 18:45:02.929265 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:02.929247    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034509136"
Aug 04 18:45:02.952432 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:02.952402    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7179-140512034509136_045b9d73-b6a9-4939-9656-95700afa469f/test-curl-7179-140512034509136/0.log"
Aug 04 18:45:02.992057 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:02.975340    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7179-140512034509136"]
Aug 04 18:45:02.993959 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:02.993934    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7179-140512034509136"]
Aug 04 18:45:03.059471 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.059438    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhxzj\" (UniqueName: \"kubernetes.io/projected/045b9d73-b6a9-4939-9656-95700afa469f-kube-api-access-bhxzj\") pod \"045b9d73-b6a9-4939-9656-95700afa469f\" (UID: \"045b9d73-b6a9-4939-9656-95700afa469f\") "
Aug 04 18:45:03.061488 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.061465    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/045b9d73-b6a9-4939-9656-95700afa469f-kube-api-access-bhxzj" (OuterVolumeSpecName: "kube-api-access-bhxzj") pod "045b9d73-b6a9-4939-9656-95700afa469f" (UID: "045b9d73-b6a9-4939-9656-95700afa469f"). InnerVolumeSpecName "kube-api-access-bhxzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:45:03.088072 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.088043    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7179-140512034509136"]
Aug 04 18:45:03.088444 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.088432    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="071e13b8-ad5b-4b8b-b53f-77d6256de910" containerName="cleanup"
Aug 04 18:45:03.088494 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.088446    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="071e13b8-ad5b-4b8b-b53f-77d6256de910" containerName="cleanup"
Aug 04 18:45:03.088494 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.088459    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="045b9d73-b6a9-4939-9656-95700afa469f" containerName="test-curl-7179-140512034509136"
Aug 04 18:45:03.088494 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.088465    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="045b9d73-b6a9-4939-9656-95700afa469f" containerName="test-curl-7179-140512034509136"
Aug 04 18:45:03.088494 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.088487    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f05befd4-ff50-4ed5-bf4f-3e8d88dacf10" containerName="cleanup"
Aug 04 18:45:03.088494 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.088492    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f05befd4-ff50-4ed5-bf4f-3e8d88dacf10" containerName="cleanup"
Aug 04 18:45:03.088645 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.088500    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41cf0a28-44f0-435b-af52-bce385839d33" containerName="cleanup"
Aug 04 18:45:03.088645 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.088505    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="41cf0a28-44f0-435b-af52-bce385839d33" containerName="cleanup"
Aug 04 18:45:03.088645 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.088582    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f05befd4-ff50-4ed5-bf4f-3e8d88dacf10" containerName="cleanup"
Aug 04 18:45:03.088645 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.088596    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="045b9d73-b6a9-4939-9656-95700afa469f" containerName="test-curl-7179-140512034509136"
Aug 04 18:45:03.088645 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.088602    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="41cf0a28-44f0-435b-af52-bce385839d33" containerName="cleanup"
Aug 04 18:45:03.088645 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.088609    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="071e13b8-ad5b-4b8b-b53f-77d6256de910" containerName="cleanup"
Aug 04 18:45:03.091632 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.091616    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034509136"
Aug 04 18:45:03.096295 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.096268    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140512034509136"]
Aug 04 18:45:03.160716 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.160681    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqsnm\" (UniqueName: \"kubernetes.io/projected/3f80c39f-19c0-4fa7-977b-a77cd095e3e3-kube-api-access-sqsnm\") pod \"test-curl-7179-140512034509136\" (UID: \"3f80c39f-19c0-4fa7-977b-a77cd095e3e3\") " pod="opendatahub/test-curl-7179-140512034509136"
Aug 04 18:45:03.160906 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.160881    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhxzj\" (UniqueName: \"kubernetes.io/projected/045b9d73-b6a9-4939-9656-95700afa469f-kube-api-access-bhxzj\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:45:03.262329 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.262207    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqsnm\" (UniqueName: \"kubernetes.io/projected/3f80c39f-19c0-4fa7-977b-a77cd095e3e3-kube-api-access-sqsnm\") pod \"test-curl-7179-140512034509136\" (UID: \"3f80c39f-19c0-4fa7-977b-a77cd095e3e3\") " pod="opendatahub/test-curl-7179-140512034509136"
Aug 04 18:45:03.269425 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.269404    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqsnm\" (UniqueName: \"kubernetes.io/projected/3f80c39f-19c0-4fa7-977b-a77cd095e3e3-kube-api-access-sqsnm\") pod \"test-curl-7179-140512034509136\" (UID: \"3f80c39f-19c0-4fa7-977b-a77cd095e3e3\") " pod="opendatahub/test-curl-7179-140512034509136"
Aug 04 18:45:03.401468 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.401434    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034509136"
Aug 04 18:45:03.534345 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.534321    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140512034509136"]
Aug 04 18:45:03.535640 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:45:03.535611    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f80c39f_19c0_4fa7_977b_a77cd095e3e3.slice/crio-a050edfe7f45ebf4d37d2682976e22fc35747c607667b58769526091b06c16fe WatchSource:0}: Error finding container a050edfe7f45ebf4d37d2682976e22fc35747c607667b58769526091b06c16fe: Status 404 returned error can't find the container with id a050edfe7f45ebf4d37d2682976e22fc35747c607667b58769526091b06c16fe
Aug 04 18:45:03.600189 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.600158    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="045b9d73-b6a9-4939-9656-95700afa469f" path="/var/lib/kubelet/pods/045b9d73-b6a9-4939-9656-95700afa469f/volumes"
Aug 04 18:45:03.721385 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.721352    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e9be3f-29764485-2xm26"
Aug 04 18:45:03.721530 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.721351    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e9be3f-29764485-2xm26" event={"ID":"f05befd4-ff50-4ed5-bf4f-3e8d88dacf10","Type":"ContainerDied","Data":"8b5ec772910b2fd8b348b6fc2e1291afdcd43d1f565b885aa37801a0fdb65170"}
Aug 04 18:45:03.721530 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.721484    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b5ec772910b2fd8b348b6fc2e1291afdcd43d1f565b885aa37801a0fdb65170"
Aug 04 18:45:03.722725 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.722698    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4659f1-29764485-jflvz"
Aug 04 18:45:03.722725 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.722711    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4659f1-29764485-jflvz" event={"ID":"071e13b8-ad5b-4b8b-b53f-77d6256de910","Type":"ContainerDied","Data":"4f1014e561c59900d7fff2d4c3fefc1875c368883b2304f847d7e52c2222410d"}
Aug 04 18:45:03.722870 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.722751    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f1014e561c59900d7fff2d4c3fefc1875c368883b2304f847d7e52c2222410d"
Aug 04 18:45:03.724184 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.724162    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-w7lls"
Aug 04 18:45:03.724268 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.724219    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-w7lls" event={"ID":"41cf0a28-44f0-435b-af52-bce385839d33","Type":"ContainerDied","Data":"c2a0f17c59a05a6b937c0984f88eb05c36e3dc1ff29ac375898dbd847c543ad5"}
Aug 04 18:45:03.724324 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.724268    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2a0f17c59a05a6b937c0984f88eb05c36e3dc1ff29ac375898dbd847c543ad5"
Aug 04 18:45:03.725719 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.725703    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034509136"
Aug 04 18:45:03.725807 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.725723    2572 scope.go:117] "RemoveContainer" containerID="7216177d1ceeb4283787717035c83129cad1df6b51c3de1431bd46da7e0aaae7"
Aug 04 18:45:03.727185 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:03.727067    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140512034509136" event={"ID":"3f80c39f-19c0-4fa7-977b-a77cd095e3e3","Type":"ContainerStarted","Data":"a050edfe7f45ebf4d37d2682976e22fc35747c607667b58769526091b06c16fe"}
Aug 04 18:45:04.009194 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:04.009161    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764440-8hkgs"]
Aug 04 18:45:04.011408 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:04.011386    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764440-8hkgs"]
Aug 04 18:45:04.735852 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:04.735819    2572 generic.go:356] "Generic (PLEG): container finished" podID="3f80c39f-19c0-4fa7-977b-a77cd095e3e3" containerID="44d7c2270a4aea560696ae990636200a3b73c3079d43824b1ec38f64b55330c3" exitCode=0
Aug 04 18:45:04.736046 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:04.735902    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140512034509136" event={"ID":"3f80c39f-19c0-4fa7-977b-a77cd095e3e3","Type":"ContainerDied","Data":"44d7c2270a4aea560696ae990636200a3b73c3079d43824b1ec38f64b55330c3"}
Aug 04 18:45:05.600302 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:05.600267    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="350cd794-23c6-4c7f-8a49-8a47300f6e75" path="/var/lib/kubelet/pods/350cd794-23c6-4c7f-8a49-8a47300f6e75/volumes"
Aug 04 18:45:05.881297 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:05.881273    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034509136"
Aug 04 18:45:05.899931 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:05.899898    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7179-140512034509136_3f80c39f-19c0-4fa7-977b-a77cd095e3e3/test-curl-7179-140512034509136/0.log"
Aug 04 18:45:05.921944 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:05.921903    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7179-140512034509136"]
Aug 04 18:45:05.927127 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:05.927105    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7179-140512034509136"]
Aug 04 18:45:05.988183 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:05.988155    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqsnm\" (UniqueName: \"kubernetes.io/projected/3f80c39f-19c0-4fa7-977b-a77cd095e3e3-kube-api-access-sqsnm\") pod \"3f80c39f-19c0-4fa7-977b-a77cd095e3e3\" (UID: \"3f80c39f-19c0-4fa7-977b-a77cd095e3e3\") "
Aug 04 18:45:05.990190 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:05.990166    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f80c39f-19c0-4fa7-977b-a77cd095e3e3-kube-api-access-sqsnm" (OuterVolumeSpecName: "kube-api-access-sqsnm") pod "3f80c39f-19c0-4fa7-977b-a77cd095e3e3" (UID: "3f80c39f-19c0-4fa7-977b-a77cd095e3e3"). InnerVolumeSpecName "kube-api-access-sqsnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:45:06.089362 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:06.089331    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqsnm\" (UniqueName: \"kubernetes.io/projected/3f80c39f-19c0-4fa7-977b-a77cd095e3e3-kube-api-access-sqsnm\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:45:06.748512 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:06.748477    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140512034509136"
Aug 04 18:45:06.748512 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:06.748515    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a050edfe7f45ebf4d37d2682976e22fc35747c607667b58769526091b06c16fe"
Aug 04 18:45:06.758075 ip-10-0-141-117 kubenswrapper[2572]: E0804 18:45:06.758049    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7179-140512034509136\" is forbidden: User \"system:node:ip-10-0-141-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-117.ec2.internal' and this object" podUID="3f80c39f-19c0-4fa7-977b-a77cd095e3e3" pod="opendatahub/test-curl-7179-140512034509136"
Aug 04 18:45:07.599802 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:07.599771    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f80c39f-19c0-4fa7-977b-a77cd095e3e3" path="/var/lib/kubelet/pods/3f80c39f-19c0-4fa7-977b-a77cd095e3e3/volumes"
Aug 04 18:45:11.399458 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:11.399421    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"]
Aug 04 18:45:11.399867 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:11.399853    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f80c39f-19c0-4fa7-977b-a77cd095e3e3" containerName="test-curl-7179-140512034509136"
Aug 04 18:45:11.399906 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:11.399868    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f80c39f-19c0-4fa7-977b-a77cd095e3e3" containerName="test-curl-7179-140512034509136"
Aug 04 18:45:11.399977 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:11.399972    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f80c39f-19c0-4fa7-977b-a77cd095e3e3" containerName="test-curl-7179-140512034509136"
Aug 04 18:45:11.403101 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:11.403086    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"
Aug 04 18:45:11.405390 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:11.405368    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-e72e63-dockercfg-lwxfn\""
Aug 04 18:45:11.405521 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:11.405369    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-e72e63\""
Aug 04 18:45:11.413313 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:11.413289    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"]
Aug 04 18:45:11.536047 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:11.536008    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d0fc3e5-1bac-439f-a494-b5d9b9b6164e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75\" (UID: \"4d0fc3e5-1bac-439f-a494-b5d9b9b6164e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"
Aug 04 18:45:11.536215 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:11.536054    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9dmm\" (UniqueName: \"kubernetes.io/projected/4d0fc3e5-1bac-439f-a494-b5d9b9b6164e-kube-api-access-r9dmm\") pod \"payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75\" (UID: \"4d0fc3e5-1bac-439f-a494-b5d9b9b6164e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"
Aug 04 18:45:11.636818 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:11.636784    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d0fc3e5-1bac-439f-a494-b5d9b9b6164e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75\" (UID: \"4d0fc3e5-1bac-439f-a494-b5d9b9b6164e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"
Aug 04 18:45:11.637029 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:11.636837    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9dmm\" (UniqueName: \"kubernetes.io/projected/4d0fc3e5-1bac-439f-a494-b5d9b9b6164e-kube-api-access-r9dmm\") pod \"payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75\" (UID: \"4d0fc3e5-1bac-439f-a494-b5d9b9b6164e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"
Aug 04 18:45:11.637502 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:11.637483    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d0fc3e5-1bac-439f-a494-b5d9b9b6164e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75\" (UID: \"4d0fc3e5-1bac-439f-a494-b5d9b9b6164e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"
Aug 04 18:45:11.644401 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:11.644377    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9dmm\" (UniqueName: \"kubernetes.io/projected/4d0fc3e5-1bac-439f-a494-b5d9b9b6164e-kube-api-access-r9dmm\") pod \"payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75\" (UID: \"4d0fc3e5-1bac-439f-a494-b5d9b9b6164e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"
Aug 04 18:45:11.714479 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:11.714407    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"
Aug 04 18:45:11.854871 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:11.854843    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"]
Aug 04 18:45:11.856430 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:45:11.856406    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d0fc3e5_1bac_439f_a494_b5d9b9b6164e.slice/crio-b4ee00518187ebc13d4e7075d489d78739e5afedb94dd33c4263785eb00c04ba WatchSource:0}: Error finding container b4ee00518187ebc13d4e7075d489d78739e5afedb94dd33c4263785eb00c04ba: Status 404 returned error can't find the container with id b4ee00518187ebc13d4e7075d489d78739e5afedb94dd33c4263785eb00c04ba
Aug 04 18:45:12.789824 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:12.789787    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75" event={"ID":"4d0fc3e5-1bac-439f-a494-b5d9b9b6164e","Type":"ContainerStarted","Data":"f8b2f65e250020cc2f9f5e64757baa10c9d65ad39ea3067199741d7d87b989bb"}
Aug 04 18:45:12.790196 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:12.789836    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75" event={"ID":"4d0fc3e5-1bac-439f-a494-b5d9b9b6164e","Type":"ContainerStarted","Data":"b4ee00518187ebc13d4e7075d489d78739e5afedb94dd33c4263785eb00c04ba"}
Aug 04 18:45:12.790196 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:12.789865    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"
Aug 04 18:45:12.806534 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:12.806488    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75" podStartSLOduration=1.806473189 podStartE2EDuration="1.806473189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:45:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:45:12.8031728 +0000 UTC m=+3497.713062388" watchObservedRunningTime="2026-08-04 18:45:12.806473189 +0000 UTC m=+3497.716362776"
Aug 04 18:45:14.182359 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:14.182326    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:45:23.798326 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:23.798246    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"
Aug 04 18:45:39.845867 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:39.845828    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"]
Aug 04 18:45:39.849374 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:39.849358    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"
Aug 04 18:45:39.851687 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:39.851665    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-c7bd98-serving-cert\""
Aug 04 18:45:39.851796 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:39.851685    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ww786\""
Aug 04 18:45:39.852620 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:39.852594    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 18:45:39.852736 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:39.852606    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:45:39.858263 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:39.858242    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"]
Aug 04 18:45:39.872102 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:39.872077    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh\" (UID: \"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"
Aug 04 18:45:39.872208 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:39.872151    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh\" (UID: \"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"
Aug 04 18:45:39.872250 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:39.872223    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h7mk\" (UniqueName: \"kubernetes.io/projected/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-kube-api-access-4h7mk\") pod \"maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh\" (UID: \"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"
Aug 04 18:45:39.973174 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:39.973141    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh\" (UID: \"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"
Aug 04 18:45:39.973342 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:39.973195    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh\" (UID: \"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"
Aug 04 18:45:39.973342 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:39.973230    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h7mk\" (UniqueName: \"kubernetes.io/projected/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-kube-api-access-4h7mk\") pod \"maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh\" (UID: \"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"
Aug 04 18:45:39.973436 ip-10-0-141-117 kubenswrapper[2572]: E0804 18:45:39.973362    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-serving-cert: secret "maas-api-e2e-ipp-b-c7bd98-serving-cert" not found
Aug 04 18:45:39.973477 ip-10-0-141-117 kubenswrapper[2572]: E0804 18:45:39.973463    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-maas-api-tls podName:c72673fb-3a9b-4c4c-a9b4-26bd4facb89f nodeName:}" failed. No retries permitted until 2026-08-04 18:45:40.47341682 +0000 UTC m=+3525.383306401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-maas-api-tls") pod "maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh" (UID: "c72673fb-3a9b-4c4c-a9b4-26bd4facb89f") : secret "maas-api-e2e-ipp-b-c7bd98-serving-cert" not found
Aug 04 18:45:39.973783 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:39.973764    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh\" (UID: \"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"
Aug 04 18:45:39.984417 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:39.984392    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h7mk\" (UniqueName: \"kubernetes.io/projected/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-kube-api-access-4h7mk\") pod \"maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh\" (UID: \"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"
Aug 04 18:45:40.478775 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:40.478738    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh\" (UID: \"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"
Aug 04 18:45:40.481243 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:40.481221    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh\" (UID: \"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"
Aug 04 18:45:40.761094 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:40.761013    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"
Aug 04 18:45:40.898760 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:40.898732    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"]
Aug 04 18:45:40.900253 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:45:40.900227    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72673fb_3a9b_4c4c_a9b4_26bd4facb89f.slice/crio-2d40220ed5a856f2c00920548c0a674ea7232253b24054176e00ee4dff0ae392 WatchSource:0}: Error finding container 2d40220ed5a856f2c00920548c0a674ea7232253b24054176e00ee4dff0ae392: Status 404 returned error can't find the container with id 2d40220ed5a856f2c00920548c0a674ea7232253b24054176e00ee4dff0ae392
Aug 04 18:45:40.960350 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:40.960319    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh" event={"ID":"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f","Type":"ContainerStarted","Data":"2d40220ed5a856f2c00920548c0a674ea7232253b24054176e00ee4dff0ae392"}
Aug 04 18:45:42.883055 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:42.883020    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:45:44.990626 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:44.990595    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh" event={"ID":"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f","Type":"ContainerStarted","Data":"b76d4cbdfc8fae6116375d8b8f5bc29f59536ad1a5578b8217e72a6ca924853b"}
Aug 04 18:45:44.991009 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:44.990673    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"
Aug 04 18:45:45.006590 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:45.006539    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh" podStartSLOduration=2.6075200670000003 podStartE2EDuration="6.006521456s" totalImagesPullingTime="3.399001389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:45:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:45:45.005677312 +0000 UTC m=+3529.915566899" watchObservedRunningTime="2026-08-04 18:45:45.006521456 +0000 UTC m=+3529.916411076"
Aug 04 18:45:51.002515 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:51.002486    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"
Aug 04 18:45:56.079493 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:45:56.079458    2572 scope.go:117] "RemoveContainer" containerID="67cb344a65139ffd9f68807e5aca1d55a8babfbb2eab59c768ccce02c1747177"
Aug 04 18:46:17.679903 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:17.679862    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:46:39.083553 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:39.083515    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:46:51.015021 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.014906    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"]
Aug 04 18:46:51.018861 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.018837    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.021304 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.021276    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 18:46:51.021413 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.021286    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-ecd1c1-openshift-default-dockercfg-tcwms\""
Aug 04 18:46:51.031867 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.031841    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"]
Aug 04 18:46:51.101069 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.101039    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da5621da-ef53-4100-a29a-75d9ff1f945a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.101226 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.101083    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-workload-socket\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.101226 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.101160    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-token\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.101226 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.101221    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-workload-certs\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.101329 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.101282    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-credential-socket\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.101329 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.101309    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-data\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.101400 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.101326    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-podinfo\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.101400 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.101351    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-envoy\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.101400 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.101370    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49b4j\" (UniqueName: \"kubernetes.io/projected/da5621da-ef53-4100-a29a-75d9ff1f945a-kube-api-access-49b4j\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.202652 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.202619    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-token\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.202858 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.202709    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-workload-certs\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.202858 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.202778    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-credential-socket\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.202858 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.202815    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-data\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.202858 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.202838    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-podinfo\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.203122 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.202968    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-envoy\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.203122 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.203102    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49b4j\" (UniqueName: \"kubernetes.io/projected/da5621da-ef53-4100-a29a-75d9ff1f945a-kube-api-access-49b4j\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.203226 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.203134    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da5621da-ef53-4100-a29a-75d9ff1f945a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.203226 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.203189    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-workload-socket\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.203226 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.203195    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-workload-certs\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.203391 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.203240    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-credential-socket\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.203391 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.203351    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-data\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.203507 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.203487    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-workload-socket\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.203884 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.203861    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da5621da-ef53-4100-a29a-75d9ff1f945a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.205430 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.205402    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-podinfo\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.205545 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.205478    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-envoy\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.210208 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.210179    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49b4j\" (UniqueName: \"kubernetes.io/projected/da5621da-ef53-4100-a29a-75d9ff1f945a-kube-api-access-49b4j\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.210305 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.210284    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-token\") pod \"e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") " pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.331846 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.331813    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:51.476849 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:51.476825    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"]
Aug 04 18:46:51.478654 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:46:51.478628    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda5621da_ef53_4100_a29a_75d9ff1f945a.slice/crio-ae447abf62ee784810eb1053bca413e296e1918c29d6c74a52c5285e656e335d WatchSource:0}: Error finding container ae447abf62ee784810eb1053bca413e296e1918c29d6c74a52c5285e656e335d: Status 404 returned error can't find the container with id ae447abf62ee784810eb1053bca413e296e1918c29d6c74a52c5285e656e335d
Aug 04 18:46:52.388550 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:52.388512    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh" event={"ID":"da5621da-ef53-4100-a29a-75d9ff1f945a","Type":"ContainerStarted","Data":"ae447abf62ee784810eb1053bca413e296e1918c29d6c74a52c5285e656e335d"}
Aug 04 18:46:56.615014 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:56.614981    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:46:56.616699 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:56.616680    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:46:56.644530 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:56.644495    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 18:46:56.644624 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:56.644565    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 18:46:56.644624 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:56.644595    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 18:46:57.426872 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:57.426835    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh" event={"ID":"da5621da-ef53-4100-a29a-75d9ff1f945a","Type":"ContainerStarted","Data":"dbb0ff64e2556abad074952512d5be63a9c3fa8d53b8f23a6012f7469baa9899"}
Aug 04 18:46:57.447709 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:57.447660    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh" podStartSLOduration=2.284308214 podStartE2EDuration="7.447647506s" totalImagesPullingTime="5.163339292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:46:57.446475708 +0000 UTC m=+3602.356365307" watchObservedRunningTime="2026-08-04 18:46:57.447647506 +0000 UTC m=+3602.357537093"
Aug 04 18:46:58.332868 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:58.332827    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:58.337899 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:58.337875    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:58.433776 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:58.433742    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:46:58.434576 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:46:58.434558    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:47:00.435736 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:00.435702    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"]
Aug 04 18:47:00.439673 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:00.439651    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"
Aug 04 18:47:00.441961 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:00.441939    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-ecd1c1-serving-cert\""
Aug 04 18:47:00.451181 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:00.451156    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"]
Aug 04 18:47:00.493457 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:00.493427    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e7a6f7-3c15-40bc-be68-76c3d9958419-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559\" (UID: \"65e7a6f7-3c15-40bc-be68-76c3d9958419\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"
Aug 04 18:47:00.493601 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:00.493472    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65e7a6f7-3c15-40bc-be68-76c3d9958419-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559\" (UID: \"65e7a6f7-3c15-40bc-be68-76c3d9958419\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"
Aug 04 18:47:00.493601 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:00.493585    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwltp\" (UniqueName: \"kubernetes.io/projected/65e7a6f7-3c15-40bc-be68-76c3d9958419-kube-api-access-zwltp\") pod \"maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559\" (UID: \"65e7a6f7-3c15-40bc-be68-76c3d9958419\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"
Aug 04 18:47:00.594146 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:00.594118    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e7a6f7-3c15-40bc-be68-76c3d9958419-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559\" (UID: \"65e7a6f7-3c15-40bc-be68-76c3d9958419\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"
Aug 04 18:47:00.594339 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:00.594180    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65e7a6f7-3c15-40bc-be68-76c3d9958419-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559\" (UID: \"65e7a6f7-3c15-40bc-be68-76c3d9958419\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"
Aug 04 18:47:00.594339 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:00.594258    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwltp\" (UniqueName: \"kubernetes.io/projected/65e7a6f7-3c15-40bc-be68-76c3d9958419-kube-api-access-zwltp\") pod \"maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559\" (UID: \"65e7a6f7-3c15-40bc-be68-76c3d9958419\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"
Aug 04 18:47:00.594339 ip-10-0-141-117 kubenswrapper[2572]: E0804 18:47:00.594308    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-serving-cert: secret "maas-api-e2e-ipp-cleanup-ecd1c1-serving-cert" not found
Aug 04 18:47:00.594522 ip-10-0-141-117 kubenswrapper[2572]: E0804 18:47:00.594412    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e7a6f7-3c15-40bc-be68-76c3d9958419-maas-api-tls podName:65e7a6f7-3c15-40bc-be68-76c3d9958419 nodeName:}" failed. No retries permitted until 2026-08-04 18:47:01.094379255 +0000 UTC m=+3606.004268860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/65e7a6f7-3c15-40bc-be68-76c3d9958419-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559" (UID: "65e7a6f7-3c15-40bc-be68-76c3d9958419") : secret "maas-api-e2e-ipp-cleanup-ecd1c1-serving-cert" not found
Aug 04 18:47:00.594835 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:00.594819    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e7a6f7-3c15-40bc-be68-76c3d9958419-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559\" (UID: \"65e7a6f7-3c15-40bc-be68-76c3d9958419\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"
Aug 04 18:47:00.602478 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:00.602457    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwltp\" (UniqueName: \"kubernetes.io/projected/65e7a6f7-3c15-40bc-be68-76c3d9958419-kube-api-access-zwltp\") pod \"maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559\" (UID: \"65e7a6f7-3c15-40bc-be68-76c3d9958419\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"
Aug 04 18:47:01.099280 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:01.099245    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65e7a6f7-3c15-40bc-be68-76c3d9958419-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559\" (UID: \"65e7a6f7-3c15-40bc-be68-76c3d9958419\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"
Aug 04 18:47:01.101969 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:01.101933    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65e7a6f7-3c15-40bc-be68-76c3d9958419-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559\" (UID: \"65e7a6f7-3c15-40bc-be68-76c3d9958419\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"
Aug 04 18:47:01.354403 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:01.354315    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"
Aug 04 18:47:01.491386 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:01.491361    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"]
Aug 04 18:47:01.493462 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:47:01.493431    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e7a6f7_3c15_40bc_be68_76c3d9958419.slice/crio-bba9bc0a27125c7cb6c4cecf2f2818adf532b25b96be4c5b2586c0679d7a8498 WatchSource:0}: Error finding container bba9bc0a27125c7cb6c4cecf2f2818adf532b25b96be4c5b2586c0679d7a8498: Status 404 returned error can't find the container with id bba9bc0a27125c7cb6c4cecf2f2818adf532b25b96be4c5b2586c0679d7a8498
Aug 04 18:47:02.464808 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:02.464710    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559" event={"ID":"65e7a6f7-3c15-40bc-be68-76c3d9958419","Type":"ContainerStarted","Data":"4d9a8ec9aeade8002bbae45290b9d9a77f994424d60824500d4cf8d579bfa7b0"}
Aug 04 18:47:02.464808 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:02.464779    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559" event={"ID":"65e7a6f7-3c15-40bc-be68-76c3d9958419","Type":"ContainerStarted","Data":"bba9bc0a27125c7cb6c4cecf2f2818adf532b25b96be4c5b2586c0679d7a8498"}
Aug 04 18:47:02.465071 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:02.464903    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"
Aug 04 18:47:02.480407 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:02.480358    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559" podStartSLOduration=1.819348591 podStartE2EDuration="2.48034351s" totalImagesPullingTime="660.994919ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:47:02.479411419 +0000 UTC m=+3607.389301020" watchObservedRunningTime="2026-08-04 18:47:02.48034351 +0000 UTC m=+3607.390233097"
Aug 04 18:47:03.878839 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:03.878798    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:47:08.477150 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:08.477116    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"
Aug 04 18:47:13.815535 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:13.815050    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": read tcp 10.134.0.2:36656->10.134.0.79:15021: read: connection reset by peer" start-of-body=
Aug 04 18:47:13.815535 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:13.815130    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh" podUID="da5621da-ef53-4100-a29a-75d9ff1f945a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": read tcp 10.134.0.2:36656->10.134.0.79:15021: read: connection reset by peer"
Aug 04 18:47:14.544710 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:14.544676    2572 generic.go:356] "Generic (PLEG): container finished" podID="da5621da-ef53-4100-a29a-75d9ff1f945a" containerID="dbb0ff64e2556abad074952512d5be63a9c3fa8d53b8f23a6012f7469baa9899" exitCode=0
Aug 04 18:47:14.544879 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:14.544748    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh" event={"ID":"da5621da-ef53-4100-a29a-75d9ff1f945a","Type":"ContainerDied","Data":"dbb0ff64e2556abad074952512d5be63a9c3fa8d53b8f23a6012f7469baa9899"}
Aug 04 18:47:14.545166 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:14.545152    2572 scope.go:117] "RemoveContainer" containerID="dbb0ff64e2556abad074952512d5be63a9c3fa8d53b8f23a6012f7469baa9899"
Aug 04 18:47:14.547251 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:14.547220    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 18:47:14.547334 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:14.547287    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 18:47:14.547334 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:14.547318    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 18:47:15.553160 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:15.553127    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh" event={"ID":"da5621da-ef53-4100-a29a-75d9ff1f945a","Type":"ContainerStarted","Data":"25f22898d436f2ce8e8a3e30c7041309d17f4c59d2337652a07ba34a6a1a0802"}
Aug 04 18:47:16.332523 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:16.332475    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:47:16.333012 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:16.332984    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Aug 04 18:47:16.333238 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:16.333206    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh" podUID="da5621da-ef53-4100-a29a-75d9ff1f945a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Aug 04 18:47:17.332992 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:17.332953    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Aug 04 18:47:17.333982 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:17.333560    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh" podUID="da5621da-ef53-4100-a29a-75d9ff1f945a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Aug 04 18:47:18.332875 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:18.332832    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Aug 04 18:47:18.333222 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:18.333185    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh" podUID="da5621da-ef53-4100-a29a-75d9ff1f945a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Aug 04 18:47:19.332690 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:19.332645    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Aug 04 18:47:19.332907 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:19.332723    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh" podUID="da5621da-ef53-4100-a29a-75d9ff1f945a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Aug 04 18:47:20.333367 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:20.333322    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Aug 04 18:47:20.333889 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:20.333408    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh" podUID="da5621da-ef53-4100-a29a-75d9ff1f945a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Aug 04 18:47:21.335872 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:21.335842    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:47:21.336358 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:21.336340    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:47:21.336892 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:21.336876    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:47:24.957427 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:24.957391    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28"]
Aug 04 18:47:24.966167 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:24.966140    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28"
Aug 04 18:47:24.968828 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:24.968807    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:47:24.969058 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:24.968968    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28"]
Aug 04 18:47:25.030201 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:25.030163    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad65c655-a421-43f3-a3e8-1a6b78de080a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28\" (UID: \"ad65c655-a421-43f3-a3e8-1a6b78de080a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28"
Aug 04 18:47:25.130614 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:25.130582    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad65c655-a421-43f3-a3e8-1a6b78de080a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28\" (UID: \"ad65c655-a421-43f3-a3e8-1a6b78de080a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28"
Aug 04 18:47:25.131270 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:25.131251    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad65c655-a421-43f3-a3e8-1a6b78de080a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28\" (UID: \"ad65c655-a421-43f3-a3e8-1a6b78de080a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28"
Aug 04 18:47:25.279333 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:25.279252    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28"
Aug 04 18:47:25.415535 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:25.415501    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28"]
Aug 04 18:47:25.417343 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:47:25.417315    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad65c655_a421_43f3_a3e8_1a6b78de080a.slice/crio-4b2e1c23d840c75b07fb946825e9f7825236b138cdabd443472a116fd06dcc88 WatchSource:0}: Error finding container 4b2e1c23d840c75b07fb946825e9f7825236b138cdabd443472a116fd06dcc88: Status 404 returned error can't find the container with id 4b2e1c23d840c75b07fb946825e9f7825236b138cdabd443472a116fd06dcc88
Aug 04 18:47:25.612302 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:25.612272    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28" event={"ID":"ad65c655-a421-43f3-a3e8-1a6b78de080a","Type":"ContainerStarted","Data":"4b2e1c23d840c75b07fb946825e9f7825236b138cdabd443472a116fd06dcc88"}
Aug 04 18:47:26.619763 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:26.619725    2572 generic.go:356] "Generic (PLEG): container finished" podID="ad65c655-a421-43f3-a3e8-1a6b78de080a" containerID="965878f5fb8366a66a36059be5eaa8845ab81feb57992fa8b082d5c3b49ad110" exitCode=0
Aug 04 18:47:26.620208 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:26.619771    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28" event={"ID":"ad65c655-a421-43f3-a3e8-1a6b78de080a","Type":"ContainerDied","Data":"965878f5fb8366a66a36059be5eaa8845ab81feb57992fa8b082d5c3b49ad110"}
Aug 04 18:47:27.755721 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:27.755700    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28"
Aug 04 18:47:27.854496 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:27.854464    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad65c655-a421-43f3-a3e8-1a6b78de080a-maas-api-service-ca\") pod \"ad65c655-a421-43f3-a3e8-1a6b78de080a\" (UID: \"ad65c655-a421-43f3-a3e8-1a6b78de080a\") "
Aug 04 18:47:27.854798 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:27.854776    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad65c655-a421-43f3-a3e8-1a6b78de080a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ad65c655-a421-43f3-a3e8-1a6b78de080a" (UID: "ad65c655-a421-43f3-a3e8-1a6b78de080a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:47:27.956175 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:27.956099    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad65c655-a421-43f3-a3e8-1a6b78de080a-maas-api-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:47:28.632635 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:28.632605    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28"
Aug 04 18:47:28.632635 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:28.632624    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28" event={"ID":"ad65c655-a421-43f3-a3e8-1a6b78de080a","Type":"ContainerDied","Data":"4b2e1c23d840c75b07fb946825e9f7825236b138cdabd443472a116fd06dcc88"}
Aug 04 18:47:28.632835 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:28.632669    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b2e1c23d840c75b07fb946825e9f7825236b138cdabd443472a116fd06dcc88"
Aug 04 18:47:31.015200 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.015164    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"]
Aug 04 18:47:31.015660 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.015497    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559" podUID="65e7a6f7-3c15-40bc-be68-76c3d9958419" containerName="maas-api" containerID="cri-o://4d9a8ec9aeade8002bbae45290b9d9a77f994424d60824500d4cf8d579bfa7b0" gracePeriod=30
Aug 04 18:47:31.201564 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.201519    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28"]
Aug 04 18:47:31.204191 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.204163    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ecd1c1-tbh28"]
Aug 04 18:47:31.281751 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.281689    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"
Aug 04 18:47:31.391201 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.391167    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e7a6f7-3c15-40bc-be68-76c3d9958419-openshift-service-ca\") pod \"65e7a6f7-3c15-40bc-be68-76c3d9958419\" (UID: \"65e7a6f7-3c15-40bc-be68-76c3d9958419\") "
Aug 04 18:47:31.391372 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.391226    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65e7a6f7-3c15-40bc-be68-76c3d9958419-maas-api-tls\") pod \"65e7a6f7-3c15-40bc-be68-76c3d9958419\" (UID: \"65e7a6f7-3c15-40bc-be68-76c3d9958419\") "
Aug 04 18:47:31.391422 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.391383    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwltp\" (UniqueName: \"kubernetes.io/projected/65e7a6f7-3c15-40bc-be68-76c3d9958419-kube-api-access-zwltp\") pod \"65e7a6f7-3c15-40bc-be68-76c3d9958419\" (UID: \"65e7a6f7-3c15-40bc-be68-76c3d9958419\") "
Aug 04 18:47:31.391792 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.391757    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65e7a6f7-3c15-40bc-be68-76c3d9958419-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "65e7a6f7-3c15-40bc-be68-76c3d9958419" (UID: "65e7a6f7-3c15-40bc-be68-76c3d9958419"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:47:31.392012 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.391992    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e7a6f7-3c15-40bc-be68-76c3d9958419-openshift-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:47:31.394043 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.394021    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65e7a6f7-3c15-40bc-be68-76c3d9958419-kube-api-access-zwltp" (OuterVolumeSpecName: "kube-api-access-zwltp") pod "65e7a6f7-3c15-40bc-be68-76c3d9958419" (UID: "65e7a6f7-3c15-40bc-be68-76c3d9958419"). InnerVolumeSpecName "kube-api-access-zwltp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:47:31.394043 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.394025    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65e7a6f7-3c15-40bc-be68-76c3d9958419-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "65e7a6f7-3c15-40bc-be68-76c3d9958419" (UID: "65e7a6f7-3c15-40bc-be68-76c3d9958419"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:47:31.493081 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.493054    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwltp\" (UniqueName: \"kubernetes.io/projected/65e7a6f7-3c15-40bc-be68-76c3d9958419-kube-api-access-zwltp\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:47:31.493081 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.493079    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65e7a6f7-3c15-40bc-be68-76c3d9958419-maas-api-tls\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:47:31.600172 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.600139    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad65c655-a421-43f3-a3e8-1a6b78de080a" path="/var/lib/kubelet/pods/ad65c655-a421-43f3-a3e8-1a6b78de080a/volumes"
Aug 04 18:47:31.651299 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.651268    2572 generic.go:356] "Generic (PLEG): container finished" podID="65e7a6f7-3c15-40bc-be68-76c3d9958419" containerID="4d9a8ec9aeade8002bbae45290b9d9a77f994424d60824500d4cf8d579bfa7b0" exitCode=0
Aug 04 18:47:31.651426 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.651308    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559" event={"ID":"65e7a6f7-3c15-40bc-be68-76c3d9958419","Type":"ContainerDied","Data":"4d9a8ec9aeade8002bbae45290b9d9a77f994424d60824500d4cf8d579bfa7b0"}
Aug 04 18:47:31.651426 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.651317    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"
Aug 04 18:47:31.651426 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.651347    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559" event={"ID":"65e7a6f7-3c15-40bc-be68-76c3d9958419","Type":"ContainerDied","Data":"bba9bc0a27125c7cb6c4cecf2f2818adf532b25b96be4c5b2586c0679d7a8498"}
Aug 04 18:47:31.651426 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.651374    2572 scope.go:117] "RemoveContainer" containerID="4d9a8ec9aeade8002bbae45290b9d9a77f994424d60824500d4cf8d579bfa7b0"
Aug 04 18:47:31.660788 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.660771    2572 scope.go:117] "RemoveContainer" containerID="4d9a8ec9aeade8002bbae45290b9d9a77f994424d60824500d4cf8d579bfa7b0"
Aug 04 18:47:31.661063 ip-10-0-141-117 kubenswrapper[2572]: E0804 18:47:31.661044    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d9a8ec9aeade8002bbae45290b9d9a77f994424d60824500d4cf8d579bfa7b0\": container with ID starting with 4d9a8ec9aeade8002bbae45290b9d9a77f994424d60824500d4cf8d579bfa7b0 not found: ID does not exist" containerID="4d9a8ec9aeade8002bbae45290b9d9a77f994424d60824500d4cf8d579bfa7b0"
Aug 04 18:47:31.661116 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.661071    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d9a8ec9aeade8002bbae45290b9d9a77f994424d60824500d4cf8d579bfa7b0"} err="failed to get container status \"4d9a8ec9aeade8002bbae45290b9d9a77f994424d60824500d4cf8d579bfa7b0\": rpc error: code = NotFound desc = could not find container \"4d9a8ec9aeade8002bbae45290b9d9a77f994424d60824500d4cf8d579bfa7b0\": container with ID starting with 4d9a8ec9aeade8002bbae45290b9d9a77f994424d60824500d4cf8d579bfa7b0 not found: ID does not exist"
Aug 04 18:47:31.667792 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.667771    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"]
Aug 04 18:47:31.670289 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:31.670267    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ecd1c1-7676557599-js559"]
Aug 04 18:47:33.599270 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:33.599237    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65e7a6f7-3c15-40bc-be68-76c3d9958419" path="/var/lib/kubelet/pods/65e7a6f7-3c15-40bc-be68-76c3d9958419/volumes"
Aug 04 18:47:34.178637 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:34.178602    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:47:37.670640 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:37.670607    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"]
Aug 04 18:47:37.671027 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:37.670830    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh" podUID="da5621da-ef53-4100-a29a-75d9ff1f945a" containerName="istio-proxy" containerID="cri-o://25f22898d436f2ce8e8a3e30c7041309d17f4c59d2337652a07ba34a6a1a0802" gracePeriod=30
Aug 04 18:47:41.189741 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:41.189702    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h"]
Aug 04 18:47:41.190190 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:41.190177    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65e7a6f7-3c15-40bc-be68-76c3d9958419" containerName="maas-api"
Aug 04 18:47:41.190190 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:41.190191    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="65e7a6f7-3c15-40bc-be68-76c3d9958419" containerName="maas-api"
Aug 04 18:47:41.190278 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:41.190226    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad65c655-a421-43f3-a3e8-1a6b78de080a" containerName="revoke-keys"
Aug 04 18:47:41.190278 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:41.190233    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad65c655-a421-43f3-a3e8-1a6b78de080a" containerName="revoke-keys"
Aug 04 18:47:41.190346 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:41.190299    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="65e7a6f7-3c15-40bc-be68-76c3d9958419" containerName="maas-api"
Aug 04 18:47:41.190346 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:41.190311    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad65c655-a421-43f3-a3e8-1a6b78de080a" containerName="revoke-keys"
Aug 04 18:47:41.193470 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:41.193455    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h"
Aug 04 18:47:41.196117 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:41.196075    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:47:41.199358 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:41.199333    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h"]
Aug 04 18:47:41.279548 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:41.279509    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c228e237-d35e-4b02-80ae-c81af0cf2e72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h\" (UID: \"c228e237-d35e-4b02-80ae-c81af0cf2e72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h"
Aug 04 18:47:41.380246 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:41.380205    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c228e237-d35e-4b02-80ae-c81af0cf2e72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h\" (UID: \"c228e237-d35e-4b02-80ae-c81af0cf2e72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h"
Aug 04 18:47:41.380845 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:41.380822    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c228e237-d35e-4b02-80ae-c81af0cf2e72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h\" (UID: \"c228e237-d35e-4b02-80ae-c81af0cf2e72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h"
Aug 04 18:47:41.505623 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:41.505539    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h"
Aug 04 18:47:41.642053 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:41.642026    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h"]
Aug 04 18:47:41.644377 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:47:41.644350    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc228e237_d35e_4b02_80ae_c81af0cf2e72.slice/crio-b0b249d10635d0392ad3ce8023cfcd54d724c8c1277f04936a4aa09aa370d4d2 WatchSource:0}: Error finding container b0b249d10635d0392ad3ce8023cfcd54d724c8c1277f04936a4aa09aa370d4d2: Status 404 returned error can't find the container with id b0b249d10635d0392ad3ce8023cfcd54d724c8c1277f04936a4aa09aa370d4d2
Aug 04 18:47:41.717343 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:41.717310    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h" event={"ID":"c228e237-d35e-4b02-80ae-c81af0cf2e72","Type":"ContainerStarted","Data":"b0b249d10635d0392ad3ce8023cfcd54d724c8c1277f04936a4aa09aa370d4d2"}
Aug 04 18:47:42.725462 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:42.725429    2572 generic.go:356] "Generic (PLEG): container finished" podID="c228e237-d35e-4b02-80ae-c81af0cf2e72" containerID="f9d80d1a76d079904b1b96ecf6854b3f014bc167bb0da1404643bc6ea7b14f8a" exitCode=0
Aug 04 18:47:42.725827 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:42.725512    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h" event={"ID":"c228e237-d35e-4b02-80ae-c81af0cf2e72","Type":"ContainerDied","Data":"f9d80d1a76d079904b1b96ecf6854b3f014bc167bb0da1404643bc6ea7b14f8a"}
Aug 04 18:47:42.945272 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:42.945216    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:47:43.093063 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093029    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-workload-socket\") pod \"da5621da-ef53-4100-a29a-75d9ff1f945a\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") "
Aug 04 18:47:43.093063 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093065    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-envoy\") pod \"da5621da-ef53-4100-a29a-75d9ff1f945a\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") "
Aug 04 18:47:43.093260 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093096    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da5621da-ef53-4100-a29a-75d9ff1f945a-istiod-ca-cert\") pod \"da5621da-ef53-4100-a29a-75d9ff1f945a\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") "
Aug 04 18:47:43.093260 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093127    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-token\") pod \"da5621da-ef53-4100-a29a-75d9ff1f945a\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") "
Aug 04 18:47:43.093260 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093153    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-data\") pod \"da5621da-ef53-4100-a29a-75d9ff1f945a\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") "
Aug 04 18:47:43.093260 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093198    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-credential-socket\") pod \"da5621da-ef53-4100-a29a-75d9ff1f945a\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") "
Aug 04 18:47:43.093260 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093254    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49b4j\" (UniqueName: \"kubernetes.io/projected/da5621da-ef53-4100-a29a-75d9ff1f945a-kube-api-access-49b4j\") pod \"da5621da-ef53-4100-a29a-75d9ff1f945a\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") "
Aug 04 18:47:43.093541 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093303    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-workload-certs\") pod \"da5621da-ef53-4100-a29a-75d9ff1f945a\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") "
Aug 04 18:47:43.093541 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093330    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-podinfo\") pod \"da5621da-ef53-4100-a29a-75d9ff1f945a\" (UID: \"da5621da-ef53-4100-a29a-75d9ff1f945a\") "
Aug 04 18:47:43.093541 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093367    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "da5621da-ef53-4100-a29a-75d9ff1f945a" (UID: "da5621da-ef53-4100-a29a-75d9ff1f945a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:47:43.093700 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093530    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-data" (OuterVolumeSpecName: "istio-data") pod "da5621da-ef53-4100-a29a-75d9ff1f945a" (UID: "da5621da-ef53-4100-a29a-75d9ff1f945a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:47:43.093700 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093539    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "da5621da-ef53-4100-a29a-75d9ff1f945a" (UID: "da5621da-ef53-4100-a29a-75d9ff1f945a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:47:43.093700 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093591    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "da5621da-ef53-4100-a29a-75d9ff1f945a" (UID: "da5621da-ef53-4100-a29a-75d9ff1f945a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:47:43.093700 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093670    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-workload-certs\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:47:43.093700 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093689    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-workload-socket\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:47:43.093973 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093703    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-data\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:47:43.093973 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093715    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-credential-socket\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:47:43.093973 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.093844    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da5621da-ef53-4100-a29a-75d9ff1f945a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "da5621da-ef53-4100-a29a-75d9ff1f945a" (UID: "da5621da-ef53-4100-a29a-75d9ff1f945a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:47:43.095539 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.095513    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da5621da-ef53-4100-a29a-75d9ff1f945a-kube-api-access-49b4j" (OuterVolumeSpecName: "kube-api-access-49b4j") pod "da5621da-ef53-4100-a29a-75d9ff1f945a" (UID: "da5621da-ef53-4100-a29a-75d9ff1f945a"). InnerVolumeSpecName "kube-api-access-49b4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:47:43.095654 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.095623    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-token" (OuterVolumeSpecName: "istio-token") pod "da5621da-ef53-4100-a29a-75d9ff1f945a" (UID: "da5621da-ef53-4100-a29a-75d9ff1f945a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:47:43.095778 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.095665    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "da5621da-ef53-4100-a29a-75d9ff1f945a" (UID: "da5621da-ef53-4100-a29a-75d9ff1f945a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:47:43.095778 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.095723    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "da5621da-ef53-4100-a29a-75d9ff1f945a" (UID: "da5621da-ef53-4100-a29a-75d9ff1f945a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 18:47:43.194693 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.194642    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-podinfo\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:47:43.194693 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.194685    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-envoy\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:47:43.194693 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.194695    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da5621da-ef53-4100-a29a-75d9ff1f945a-istiod-ca-cert\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:47:43.194693 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.194703    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da5621da-ef53-4100-a29a-75d9ff1f945a-istio-token\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:47:43.194693 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.194712    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49b4j\" (UniqueName: \"kubernetes.io/projected/da5621da-ef53-4100-a29a-75d9ff1f945a-kube-api-access-49b4j\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:47:43.733592 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.733561    2572 generic.go:356] "Generic (PLEG): container finished" podID="da5621da-ef53-4100-a29a-75d9ff1f945a" containerID="25f22898d436f2ce8e8a3e30c7041309d17f4c59d2337652a07ba34a6a1a0802" exitCode=0
Aug 04 18:47:43.734051 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.733608    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"
Aug 04 18:47:43.734051 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.733645    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh" event={"ID":"da5621da-ef53-4100-a29a-75d9ff1f945a","Type":"ContainerDied","Data":"25f22898d436f2ce8e8a3e30c7041309d17f4c59d2337652a07ba34a6a1a0802"}
Aug 04 18:47:43.734051 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.733706    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh" event={"ID":"da5621da-ef53-4100-a29a-75d9ff1f945a","Type":"ContainerDied","Data":"ae447abf62ee784810eb1053bca413e296e1918c29d6c74a52c5285e656e335d"}
Aug 04 18:47:43.734051 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.733725    2572 scope.go:117] "RemoveContainer" containerID="25f22898d436f2ce8e8a3e30c7041309d17f4c59d2337652a07ba34a6a1a0802"
Aug 04 18:47:43.743740 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.743721    2572 scope.go:117] "RemoveContainer" containerID="dbb0ff64e2556abad074952512d5be63a9c3fa8d53b8f23a6012f7469baa9899"
Aug 04 18:47:43.750820 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.750791    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"]
Aug 04 18:47:43.754401 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.754381    2572 scope.go:117] "RemoveContainer" containerID="25f22898d436f2ce8e8a3e30c7041309d17f4c59d2337652a07ba34a6a1a0802"
Aug 04 18:47:43.754788 ip-10-0-141-117 kubenswrapper[2572]: E0804 18:47:43.754767    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25f22898d436f2ce8e8a3e30c7041309d17f4c59d2337652a07ba34a6a1a0802\": container with ID starting with 25f22898d436f2ce8e8a3e30c7041309d17f4c59d2337652a07ba34a6a1a0802 not found: ID does not exist" containerID="25f22898d436f2ce8e8a3e30c7041309d17f4c59d2337652a07ba34a6a1a0802"
Aug 04 18:47:43.754868 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.754796    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25f22898d436f2ce8e8a3e30c7041309d17f4c59d2337652a07ba34a6a1a0802"} err="failed to get container status \"25f22898d436f2ce8e8a3e30c7041309d17f4c59d2337652a07ba34a6a1a0802\": rpc error: code = NotFound desc = could not find container \"25f22898d436f2ce8e8a3e30c7041309d17f4c59d2337652a07ba34a6a1a0802\": container with ID starting with 25f22898d436f2ce8e8a3e30c7041309d17f4c59d2337652a07ba34a6a1a0802 not found: ID does not exist"
Aug 04 18:47:43.754868 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.754814    2572 scope.go:117] "RemoveContainer" containerID="dbb0ff64e2556abad074952512d5be63a9c3fa8d53b8f23a6012f7469baa9899"
Aug 04 18:47:43.755117 ip-10-0-141-117 kubenswrapper[2572]: E0804 18:47:43.755098    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbb0ff64e2556abad074952512d5be63a9c3fa8d53b8f23a6012f7469baa9899\": container with ID starting with dbb0ff64e2556abad074952512d5be63a9c3fa8d53b8f23a6012f7469baa9899 not found: ID does not exist" containerID="dbb0ff64e2556abad074952512d5be63a9c3fa8d53b8f23a6012f7469baa9899"
Aug 04 18:47:43.755184 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.755121    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb0ff64e2556abad074952512d5be63a9c3fa8d53b8f23a6012f7469baa9899"} err="failed to get container status \"dbb0ff64e2556abad074952512d5be63a9c3fa8d53b8f23a6012f7469baa9899\": rpc error: code = NotFound desc = could not find container \"dbb0ff64e2556abad074952512d5be63a9c3fa8d53b8f23a6012f7469baa9899\": container with ID starting with dbb0ff64e2556abad074952512d5be63a9c3fa8d53b8f23a6012f7469baa9899 not found: ID does not exist"
Aug 04 18:47:43.756435 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.756413    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ecd1c1-openshift-default-79b497f98-cn6lh"]
Aug 04 18:47:43.880926 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:43.880887    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h"
Aug 04 18:47:44.000111 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:44.000081    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c228e237-d35e-4b02-80ae-c81af0cf2e72-maas-api-service-ca\") pod \"c228e237-d35e-4b02-80ae-c81af0cf2e72\" (UID: \"c228e237-d35e-4b02-80ae-c81af0cf2e72\") "
Aug 04 18:47:44.000451 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:44.000427    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c228e237-d35e-4b02-80ae-c81af0cf2e72-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c228e237-d35e-4b02-80ae-c81af0cf2e72" (UID: "c228e237-d35e-4b02-80ae-c81af0cf2e72"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:47:44.101838 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:44.101803    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c228e237-d35e-4b02-80ae-c81af0cf2e72-maas-api-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:47:44.741881 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:44.741836    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h" event={"ID":"c228e237-d35e-4b02-80ae-c81af0cf2e72","Type":"ContainerDied","Data":"b0b249d10635d0392ad3ce8023cfcd54d724c8c1277f04936a4aa09aa370d4d2"}
Aug 04 18:47:44.742283 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:44.741893    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0b249d10635d0392ad3ce8023cfcd54d724c8c1277f04936a4aa09aa370d4d2"
Aug 04 18:47:44.742283 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:44.741860    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h"
Aug 04 18:47:45.599699 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:45.599665    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da5621da-ef53-4100-a29a-75d9ff1f945a" path="/var/lib/kubelet/pods/da5621da-ef53-4100-a29a-75d9ff1f945a/volumes"
Aug 04 18:47:54.683512 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:54.683470    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:47:56.809088 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:56.809054    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"]
Aug 04 18:47:56.810063 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:56.810030    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75" podUID="4d0fc3e5-1bac-439f-a494-b5d9b9b6164e" containerName="payload-pre-processing" containerID="cri-o://f8b2f65e250020cc2f9f5e64757baa10c9d65ad39ea3067199741d7d87b989bb" gracePeriod=30
Aug 04 18:47:56.938108 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:56.938073    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h"]
Aug 04 18:47:56.940475 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:56.940447    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e72e63-gqv9h"]
Aug 04 18:47:57.078233 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.078202    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"
Aug 04 18:47:57.220502 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.220452    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9dmm\" (UniqueName: \"kubernetes.io/projected/4d0fc3e5-1bac-439f-a494-b5d9b9b6164e-kube-api-access-r9dmm\") pod \"4d0fc3e5-1bac-439f-a494-b5d9b9b6164e\" (UID: \"4d0fc3e5-1bac-439f-a494-b5d9b9b6164e\") "
Aug 04 18:47:57.220687 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.220648    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d0fc3e5-1bac-439f-a494-b5d9b9b6164e-plugins-config-volume\") pod \"4d0fc3e5-1bac-439f-a494-b5d9b9b6164e\" (UID: \"4d0fc3e5-1bac-439f-a494-b5d9b9b6164e\") "
Aug 04 18:47:57.221064 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.221030    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d0fc3e5-1bac-439f-a494-b5d9b9b6164e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d0fc3e5-1bac-439f-a494-b5d9b9b6164e" (UID: "4d0fc3e5-1bac-439f-a494-b5d9b9b6164e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:47:57.222820 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.222790    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d0fc3e5-1bac-439f-a494-b5d9b9b6164e-kube-api-access-r9dmm" (OuterVolumeSpecName: "kube-api-access-r9dmm") pod "4d0fc3e5-1bac-439f-a494-b5d9b9b6164e" (UID: "4d0fc3e5-1bac-439f-a494-b5d9b9b6164e"). InnerVolumeSpecName "kube-api-access-r9dmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:47:57.322145 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.322068    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d0fc3e5-1bac-439f-a494-b5d9b9b6164e-plugins-config-volume\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:47:57.322145 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.322106    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9dmm\" (UniqueName: \"kubernetes.io/projected/4d0fc3e5-1bac-439f-a494-b5d9b9b6164e-kube-api-access-r9dmm\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:47:57.600080 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.599999    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c228e237-d35e-4b02-80ae-c81af0cf2e72" path="/var/lib/kubelet/pods/c228e237-d35e-4b02-80ae-c81af0cf2e72/volumes"
Aug 04 18:47:57.824386 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.824347    2572 generic.go:356] "Generic (PLEG): container finished" podID="4d0fc3e5-1bac-439f-a494-b5d9b9b6164e" containerID="f8b2f65e250020cc2f9f5e64757baa10c9d65ad39ea3067199741d7d87b989bb" exitCode=0
Aug 04 18:47:57.824979 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.824419    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"
Aug 04 18:47:57.824979 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.824430    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75" event={"ID":"4d0fc3e5-1bac-439f-a494-b5d9b9b6164e","Type":"ContainerDied","Data":"f8b2f65e250020cc2f9f5e64757baa10c9d65ad39ea3067199741d7d87b989bb"}
Aug 04 18:47:57.824979 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.824517    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75" event={"ID":"4d0fc3e5-1bac-439f-a494-b5d9b9b6164e","Type":"ContainerDied","Data":"b4ee00518187ebc13d4e7075d489d78739e5afedb94dd33c4263785eb00c04ba"}
Aug 04 18:47:57.824979 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.824552    2572 scope.go:117] "RemoveContainer" containerID="f8b2f65e250020cc2f9f5e64757baa10c9d65ad39ea3067199741d7d87b989bb"
Aug 04 18:47:57.834141 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.834117    2572 scope.go:117] "RemoveContainer" containerID="f8b2f65e250020cc2f9f5e64757baa10c9d65ad39ea3067199741d7d87b989bb"
Aug 04 18:47:57.834421 ip-10-0-141-117 kubenswrapper[2572]: E0804 18:47:57.834401    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8b2f65e250020cc2f9f5e64757baa10c9d65ad39ea3067199741d7d87b989bb\": container with ID starting with f8b2f65e250020cc2f9f5e64757baa10c9d65ad39ea3067199741d7d87b989bb not found: ID does not exist" containerID="f8b2f65e250020cc2f9f5e64757baa10c9d65ad39ea3067199741d7d87b989bb"
Aug 04 18:47:57.834473 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.834434    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8b2f65e250020cc2f9f5e64757baa10c9d65ad39ea3067199741d7d87b989bb"} err="failed to get container status \"f8b2f65e250020cc2f9f5e64757baa10c9d65ad39ea3067199741d7d87b989bb\": rpc error: code = NotFound desc = could not find container \"f8b2f65e250020cc2f9f5e64757baa10c9d65ad39ea3067199741d7d87b989bb\": container with ID starting with f8b2f65e250020cc2f9f5e64757baa10c9d65ad39ea3067199741d7d87b989bb not found: ID does not exist"
Aug 04 18:47:57.840483 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.840458    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"]
Aug 04 18:47:57.844528 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:57.844497    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e72e63-fd78ddbd4-x9l75"]
Aug 04 18:47:59.599505 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:47:59.599463    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d0fc3e5-1bac-439f-a494-b5d9b9b6164e" path="/var/lib/kubelet/pods/4d0fc3e5-1bac-439f-a494-b5d9b9b6164e/volumes"
Aug 04 18:48:03.680293 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:03.680257    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:48:45.774878 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.774843    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv"]
Aug 04 18:48:45.775382 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.775264    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c228e237-d35e-4b02-80ae-c81af0cf2e72" containerName="revoke-keys"
Aug 04 18:48:45.775382 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.775275    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c228e237-d35e-4b02-80ae-c81af0cf2e72" containerName="revoke-keys"
Aug 04 18:48:45.775382 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.775299    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da5621da-ef53-4100-a29a-75d9ff1f945a" containerName="istio-proxy"
Aug 04 18:48:45.775382 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.775306    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="da5621da-ef53-4100-a29a-75d9ff1f945a" containerName="istio-proxy"
Aug 04 18:48:45.775382 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.775313    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d0fc3e5-1bac-439f-a494-b5d9b9b6164e" containerName="payload-pre-processing"
Aug 04 18:48:45.775382 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.775318    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d0fc3e5-1bac-439f-a494-b5d9b9b6164e" containerName="payload-pre-processing"
Aug 04 18:48:45.775382 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.775324    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da5621da-ef53-4100-a29a-75d9ff1f945a" containerName="istio-proxy"
Aug 04 18:48:45.775382 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.775329    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="da5621da-ef53-4100-a29a-75d9ff1f945a" containerName="istio-proxy"
Aug 04 18:48:45.775631 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.775394    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c228e237-d35e-4b02-80ae-c81af0cf2e72" containerName="revoke-keys"
Aug 04 18:48:45.775631 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.775404    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="da5621da-ef53-4100-a29a-75d9ff1f945a" containerName="istio-proxy"
Aug 04 18:48:45.775631 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.775410    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d0fc3e5-1bac-439f-a494-b5d9b9b6164e" containerName="payload-pre-processing"
Aug 04 18:48:45.775631 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.775417    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="da5621da-ef53-4100-a29a-75d9ff1f945a" containerName="istio-proxy"
Aug 04 18:48:45.778619 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.778603    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv"
Aug 04 18:48:45.780762 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.780740    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:48:45.784955 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.784932    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv"]
Aug 04 18:48:45.819358 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.819322    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/026cb5ce-4aa7-4884-a6e7-13eae565df66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv\" (UID: \"026cb5ce-4aa7-4884-a6e7-13eae565df66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv"
Aug 04 18:48:45.920630 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.920596    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/026cb5ce-4aa7-4884-a6e7-13eae565df66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv\" (UID: \"026cb5ce-4aa7-4884-a6e7-13eae565df66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv"
Aug 04 18:48:45.921309 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:45.921283    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/026cb5ce-4aa7-4884-a6e7-13eae565df66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv\" (UID: \"026cb5ce-4aa7-4884-a6e7-13eae565df66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv"
Aug 04 18:48:46.090702 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:46.090663    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv"
Aug 04 18:48:46.240981 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:46.240948    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv"]
Aug 04 18:48:47.132780 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:47.132738    2572 generic.go:356] "Generic (PLEG): container finished" podID="026cb5ce-4aa7-4884-a6e7-13eae565df66" containerID="5b889ce05c59127d5ac281649a0070bdbad6ea40f9f70ddef3468e89b46740aa" exitCode=0
Aug 04 18:48:47.133288 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:47.132819    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv" event={"ID":"026cb5ce-4aa7-4884-a6e7-13eae565df66","Type":"ContainerDied","Data":"5b889ce05c59127d5ac281649a0070bdbad6ea40f9f70ddef3468e89b46740aa"}
Aug 04 18:48:47.133288 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:47.132873    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv" event={"ID":"026cb5ce-4aa7-4884-a6e7-13eae565df66","Type":"ContainerStarted","Data":"0a66c90667bdfd4ffbb427552351da5736ff662b24ec9a60ae06ccfe1bb1a64b"}
Aug 04 18:48:48.277195 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:48.277166    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv"
Aug 04 18:48:48.342424 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:48.342392    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/026cb5ce-4aa7-4884-a6e7-13eae565df66-maas-api-service-ca\") pod \"026cb5ce-4aa7-4884-a6e7-13eae565df66\" (UID: \"026cb5ce-4aa7-4884-a6e7-13eae565df66\") "
Aug 04 18:48:48.342759 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:48.342735    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/026cb5ce-4aa7-4884-a6e7-13eae565df66-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "026cb5ce-4aa7-4884-a6e7-13eae565df66" (UID: "026cb5ce-4aa7-4884-a6e7-13eae565df66"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:48:48.443527 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:48.443450    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/026cb5ce-4aa7-4884-a6e7-13eae565df66-maas-api-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:48:49.146877 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:49.146841    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv" event={"ID":"026cb5ce-4aa7-4884-a6e7-13eae565df66","Type":"ContainerDied","Data":"0a66c90667bdfd4ffbb427552351da5736ff662b24ec9a60ae06ccfe1bb1a64b"}
Aug 04 18:48:49.146877 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:49.146864    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv"
Aug 04 18:48:49.147112 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:49.146897    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a66c90667bdfd4ffbb427552351da5736ff662b24ec9a60ae06ccfe1bb1a64b"
Aug 04 18:48:56.130859 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:56.130815    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"]
Aug 04 18:48:56.131339 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:56.131091    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh" podUID="c72673fb-3a9b-4c4c-a9b4-26bd4facb89f" containerName="maas-api" containerID="cri-o://b76d4cbdfc8fae6116375d8b8f5bc29f59536ad1a5578b8217e72a6ca924853b" gracePeriod=30
Aug 04 18:48:56.315013 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:56.314978    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv"]
Aug 04 18:48:56.319540 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:56.319513    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c7bd98-hkldv"]
Aug 04 18:48:56.381974 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:56.381905    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"
Aug 04 18:48:56.516565 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:56.516531    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-openshift-service-ca\") pod \"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f\" (UID: \"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f\") "
Aug 04 18:48:56.516743 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:56.516594    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-maas-api-tls\") pod \"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f\" (UID: \"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f\") "
Aug 04 18:48:56.516743 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:56.516621    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h7mk\" (UniqueName: \"kubernetes.io/projected/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-kube-api-access-4h7mk\") pod \"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f\" (UID: \"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f\") "
Aug 04 18:48:56.516975 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:56.516952    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c72673fb-3a9b-4c4c-a9b4-26bd4facb89f" (UID: "c72673fb-3a9b-4c4c-a9b4-26bd4facb89f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:48:56.518720 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:56.518694    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-kube-api-access-4h7mk" (OuterVolumeSpecName: "kube-api-access-4h7mk") pod "c72673fb-3a9b-4c4c-a9b4-26bd4facb89f" (UID: "c72673fb-3a9b-4c4c-a9b4-26bd4facb89f"). InnerVolumeSpecName "kube-api-access-4h7mk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:48:56.518786 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:56.518706    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c72673fb-3a9b-4c4c-a9b4-26bd4facb89f" (UID: "c72673fb-3a9b-4c4c-a9b4-26bd4facb89f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:48:56.617904 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:56.617859    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-maas-api-tls\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:48:56.617904 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:56.617898    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h7mk\" (UniqueName: \"kubernetes.io/projected/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-kube-api-access-4h7mk\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:48:56.617904 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:56.617908    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f-openshift-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:48:57.199161 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:57.199122    2572 generic.go:356] "Generic (PLEG): container finished" podID="c72673fb-3a9b-4c4c-a9b4-26bd4facb89f" containerID="b76d4cbdfc8fae6116375d8b8f5bc29f59536ad1a5578b8217e72a6ca924853b" exitCode=0
Aug 04 18:48:57.199542 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:57.199169    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"
Aug 04 18:48:57.199542 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:57.199206    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh" event={"ID":"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f","Type":"ContainerDied","Data":"b76d4cbdfc8fae6116375d8b8f5bc29f59536ad1a5578b8217e72a6ca924853b"}
Aug 04 18:48:57.199542 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:57.199263    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh" event={"ID":"c72673fb-3a9b-4c4c-a9b4-26bd4facb89f","Type":"ContainerDied","Data":"2d40220ed5a856f2c00920548c0a674ea7232253b24054176e00ee4dff0ae392"}
Aug 04 18:48:57.199542 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:57.199291    2572 scope.go:117] "RemoveContainer" containerID="b76d4cbdfc8fae6116375d8b8f5bc29f59536ad1a5578b8217e72a6ca924853b"
Aug 04 18:48:57.215761 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:57.215730    2572 scope.go:117] "RemoveContainer" containerID="b76d4cbdfc8fae6116375d8b8f5bc29f59536ad1a5578b8217e72a6ca924853b"
Aug 04 18:48:57.216177 ip-10-0-141-117 kubenswrapper[2572]: E0804 18:48:57.216134    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b76d4cbdfc8fae6116375d8b8f5bc29f59536ad1a5578b8217e72a6ca924853b\": container with ID starting with b76d4cbdfc8fae6116375d8b8f5bc29f59536ad1a5578b8217e72a6ca924853b not found: ID does not exist" containerID="b76d4cbdfc8fae6116375d8b8f5bc29f59536ad1a5578b8217e72a6ca924853b"
Aug 04 18:48:57.216254 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:57.216191    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b76d4cbdfc8fae6116375d8b8f5bc29f59536ad1a5578b8217e72a6ca924853b"} err="failed to get container status \"b76d4cbdfc8fae6116375d8b8f5bc29f59536ad1a5578b8217e72a6ca924853b\": rpc error: code = NotFound desc = could not find container \"b76d4cbdfc8fae6116375d8b8f5bc29f59536ad1a5578b8217e72a6ca924853b\": container with ID starting with b76d4cbdfc8fae6116375d8b8f5bc29f59536ad1a5578b8217e72a6ca924853b not found: ID does not exist"
Aug 04 18:48:57.225051 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:57.225024    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"]
Aug 04 18:48:57.227704 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:57.227672    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c7bd98-688ffdd895-z2dqh"]
Aug 04 18:48:57.600506 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:57.600470    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="026cb5ce-4aa7-4884-a6e7-13eae565df66" path="/var/lib/kubelet/pods/026cb5ce-4aa7-4884-a6e7-13eae565df66/volumes"
Aug 04 18:48:57.600872 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:57.600859    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c72673fb-3a9b-4c4c-a9b4-26bd4facb89f" path="/var/lib/kubelet/pods/c72673fb-3a9b-4c4c-a9b4-26bd4facb89f/volumes"
Aug 04 18:48:58.520226 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:48:58.520185    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:49:03.132015 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:03.131983    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw"]
Aug 04 18:49:03.132453 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:03.132439    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="026cb5ce-4aa7-4884-a6e7-13eae565df66" containerName="revoke-keys"
Aug 04 18:49:03.132494 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:03.132455    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="026cb5ce-4aa7-4884-a6e7-13eae565df66" containerName="revoke-keys"
Aug 04 18:49:03.132494 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:03.132473    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c72673fb-3a9b-4c4c-a9b4-26bd4facb89f" containerName="maas-api"
Aug 04 18:49:03.132494 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:03.132479    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c72673fb-3a9b-4c4c-a9b4-26bd4facb89f" containerName="maas-api"
Aug 04 18:49:03.132587 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:03.132561    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c72673fb-3a9b-4c4c-a9b4-26bd4facb89f" containerName="maas-api"
Aug 04 18:49:03.132587 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:03.132571    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="026cb5ce-4aa7-4884-a6e7-13eae565df66" containerName="revoke-keys"
Aug 04 18:49:03.137697 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:03.137666    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw"
Aug 04 18:49:03.140093 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:03.140067    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:49:03.140298 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:03.140166    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:49:03.141623 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:03.141595    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw"]
Aug 04 18:49:03.275731 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:03.275696    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/feb25bc5-a5b0-4837-ba5a-81de51b12134-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw\" (UID: \"feb25bc5-a5b0-4837-ba5a-81de51b12134\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw"
Aug 04 18:49:03.376853 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:03.376816    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/feb25bc5-a5b0-4837-ba5a-81de51b12134-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw\" (UID: \"feb25bc5-a5b0-4837-ba5a-81de51b12134\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw"
Aug 04 18:49:03.377506 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:03.377481    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/feb25bc5-a5b0-4837-ba5a-81de51b12134-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw\" (UID: \"feb25bc5-a5b0-4837-ba5a-81de51b12134\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw"
Aug 04 18:49:03.449969 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:03.449862    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw"
Aug 04 18:49:03.795070 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:03.795033    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw"]
Aug 04 18:49:03.796908 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:49:03.796878    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb25bc5_a5b0_4837_ba5a_81de51b12134.slice/crio-f1d0c0b1fbb73c6d86da01980d86f99569c045e5fc4751d4bc99c8be879a5727 WatchSource:0}: Error finding container f1d0c0b1fbb73c6d86da01980d86f99569c045e5fc4751d4bc99c8be879a5727: Status 404 returned error can't find the container with id f1d0c0b1fbb73c6d86da01980d86f99569c045e5fc4751d4bc99c8be879a5727
Aug 04 18:49:04.245958 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:04.245900    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw" event={"ID":"feb25bc5-a5b0-4837-ba5a-81de51b12134","Type":"ContainerStarted","Data":"6ab99b4cbc6f4f5f56987b711a3474bd278060aa3e0ea38ba4d8c150a06645f4"}
Aug 04 18:49:04.246351 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:04.245980    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw" event={"ID":"feb25bc5-a5b0-4837-ba5a-81de51b12134","Type":"ContainerStarted","Data":"f1d0c0b1fbb73c6d86da01980d86f99569c045e5fc4751d4bc99c8be879a5727"}
Aug 04 18:49:04.263022 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:04.262980    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw" podStartSLOduration=1.262966701 podStartE2EDuration="1.262966701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:49:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:49:04.261010778 +0000 UTC m=+3729.170900384" watchObservedRunningTime="2026-08-04 18:49:04.262966701 +0000 UTC m=+3729.172856288"
Aug 04 18:49:05.256217 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:05.256181    2572 generic.go:356] "Generic (PLEG): container finished" podID="feb25bc5-a5b0-4837-ba5a-81de51b12134" containerID="6ab99b4cbc6f4f5f56987b711a3474bd278060aa3e0ea38ba4d8c150a06645f4" exitCode=0
Aug 04 18:49:05.256618 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:05.256222    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw" event={"ID":"feb25bc5-a5b0-4837-ba5a-81de51b12134","Type":"ContainerDied","Data":"6ab99b4cbc6f4f5f56987b711a3474bd278060aa3e0ea38ba4d8c150a06645f4"}
Aug 04 18:49:06.396677 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:06.396652    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw"
Aug 04 18:49:06.504929 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:06.504896    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/feb25bc5-a5b0-4837-ba5a-81de51b12134-maas-api-service-ca\") pod \"feb25bc5-a5b0-4837-ba5a-81de51b12134\" (UID: \"feb25bc5-a5b0-4837-ba5a-81de51b12134\") "
Aug 04 18:49:06.505258 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:06.505235    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feb25bc5-a5b0-4837-ba5a-81de51b12134-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "feb25bc5-a5b0-4837-ba5a-81de51b12134" (UID: "feb25bc5-a5b0-4837-ba5a-81de51b12134"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:49:06.605574 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:06.605539    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/feb25bc5-a5b0-4837-ba5a-81de51b12134-maas-api-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:49:07.269088 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:07.269054    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw"
Aug 04 18:49:07.269265 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:07.269092    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw" event={"ID":"feb25bc5-a5b0-4837-ba5a-81de51b12134","Type":"ContainerDied","Data":"f1d0c0b1fbb73c6d86da01980d86f99569c045e5fc4751d4bc99c8be879a5727"}
Aug 04 18:49:07.269265 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:07.269138    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1d0c0b1fbb73c6d86da01980d86f99569c045e5fc4751d4bc99c8be879a5727"
Aug 04 18:49:13.617241 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:13.617208    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4659f1-29764485-jflvz"]
Aug 04 18:49:13.619615 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:13.619589    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4659f1-29764485-jflvz"]
Aug 04 18:49:13.786638 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:13.786607    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw"]
Aug 04 18:49:13.789406 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:13.789381    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4659f1-vdclw"]
Aug 04 18:49:15.599957 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:15.599897    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="071e13b8-ad5b-4b8b-b53f-77d6256de910" path="/var/lib/kubelet/pods/071e13b8-ad5b-4b8b-b53f-77d6256de910/volumes"
Aug 04 18:49:15.600443 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:15.600339    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feb25bc5-a5b0-4837-ba5a-81de51b12134" path="/var/lib/kubelet/pods/feb25bc5-a5b0-4837-ba5a-81de51b12134/volumes"
Aug 04 18:49:15.687498 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:15.687455    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:49:20.910193 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:20.910148    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd"]
Aug 04 18:49:20.910654 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:20.910627    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb25bc5-a5b0-4837-ba5a-81de51b12134" containerName="revoke-keys"
Aug 04 18:49:20.910654 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:20.910641    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb25bc5-a5b0-4837-ba5a-81de51b12134" containerName="revoke-keys"
Aug 04 18:49:20.910738 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:20.910727    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="feb25bc5-a5b0-4837-ba5a-81de51b12134" containerName="revoke-keys"
Aug 04 18:49:20.915120 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:20.915104    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd"
Aug 04 18:49:20.917635 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:20.917606    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:49:20.917860 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:20.917839    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:49:20.920024 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:20.919997    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd"]
Aug 04 18:49:20.950981 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:20.950954    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/592b491d-05a8-4ea6-864c-19ab28b24210-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd\" (UID: \"592b491d-05a8-4ea6-864c-19ab28b24210\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd"
Aug 04 18:49:21.052206 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:21.052169    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/592b491d-05a8-4ea6-864c-19ab28b24210-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd\" (UID: \"592b491d-05a8-4ea6-864c-19ab28b24210\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd"
Aug 04 18:49:21.052842 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:21.052821    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/592b491d-05a8-4ea6-864c-19ab28b24210-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd\" (UID: \"592b491d-05a8-4ea6-864c-19ab28b24210\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd"
Aug 04 18:49:21.228620 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:21.228535    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd"
Aug 04 18:49:21.360287 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:21.360259    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd"]
Aug 04 18:49:21.362138 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:49:21.362112    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592b491d_05a8_4ea6_864c_19ab28b24210.slice/crio-fc89e8c4ff1c0625fff7b89c4871b509db3473b585246b126a119d5373d8d66d WatchSource:0}: Error finding container fc89e8c4ff1c0625fff7b89c4871b509db3473b585246b126a119d5373d8d66d: Status 404 returned error can't find the container with id fc89e8c4ff1c0625fff7b89c4871b509db3473b585246b126a119d5373d8d66d
Aug 04 18:49:22.363934 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:22.363888    2572 generic.go:356] "Generic (PLEG): container finished" podID="592b491d-05a8-4ea6-864c-19ab28b24210" containerID="b966d0ff168f37eca4d132795a7fb2c3b6ab878b3eadd6040c482cd2ebe026f4" exitCode=0
Aug 04 18:49:22.364321 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:22.363975    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd" event={"ID":"592b491d-05a8-4ea6-864c-19ab28b24210","Type":"ContainerDied","Data":"b966d0ff168f37eca4d132795a7fb2c3b6ab878b3eadd6040c482cd2ebe026f4"}
Aug 04 18:49:22.364321 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:22.364029    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd" event={"ID":"592b491d-05a8-4ea6-864c-19ab28b24210","Type":"ContainerStarted","Data":"fc89e8c4ff1c0625fff7b89c4871b509db3473b585246b126a119d5373d8d66d"}
Aug 04 18:49:23.500494 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:23.500470    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd"
Aug 04 18:49:23.575200 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:23.575162    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/592b491d-05a8-4ea6-864c-19ab28b24210-maas-api-service-ca\") pod \"592b491d-05a8-4ea6-864c-19ab28b24210\" (UID: \"592b491d-05a8-4ea6-864c-19ab28b24210\") "
Aug 04 18:49:23.575508 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:23.575484    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/592b491d-05a8-4ea6-864c-19ab28b24210-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "592b491d-05a8-4ea6-864c-19ab28b24210" (UID: "592b491d-05a8-4ea6-864c-19ab28b24210"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:49:23.680046 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:23.678415    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/592b491d-05a8-4ea6-864c-19ab28b24210-maas-api-service-ca\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:49:24.378242 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:24.378207    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd"
Aug 04 18:49:24.378242 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:24.378229    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd" event={"ID":"592b491d-05a8-4ea6-864c-19ab28b24210","Type":"ContainerDied","Data":"fc89e8c4ff1c0625fff7b89c4871b509db3473b585246b126a119d5373d8d66d"}
Aug 04 18:49:24.378449 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:24.378313    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc89e8c4ff1c0625fff7b89c4871b509db3473b585246b126a119d5373d8d66d"
Aug 04 18:49:31.311236 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:31.311202    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e9be3f-29764485-2xm26"]
Aug 04 18:49:31.313459 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:31.313435    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e9be3f-29764485-2xm26"]
Aug 04 18:49:31.343461 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:31.343428    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"]
Aug 04 18:49:31.343777 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:31.343720    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr" podUID="894be2d4-46c0-4725-8ea2-b8081ec5ddf7" containerName="payload-processing" containerID="cri-o://ab2079e22b5a4a069e0ecaea3ad4d759547a12bdd4462b0cee7d5cff25e1987f" gracePeriod=30
Aug 04 18:49:31.473334 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:31.473295    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd"]
Aug 04 18:49:31.475759 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:31.475736    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9be3f-5vtkd"]
Aug 04 18:49:31.595754 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:31.595730    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"
Aug 04 18:49:31.599556 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:31.599531    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="592b491d-05a8-4ea6-864c-19ab28b24210" path="/var/lib/kubelet/pods/592b491d-05a8-4ea6-864c-19ab28b24210/volumes"
Aug 04 18:49:31.599814 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:31.599800    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f05befd4-ff50-4ed5-bf4f-3e8d88dacf10" path="/var/lib/kubelet/pods/f05befd4-ff50-4ed5-bf4f-3e8d88dacf10/volumes"
Aug 04 18:49:31.650502 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:31.650460    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/894be2d4-46c0-4725-8ea2-b8081ec5ddf7-plugins-config-volume\") pod \"894be2d4-46c0-4725-8ea2-b8081ec5ddf7\" (UID: \"894be2d4-46c0-4725-8ea2-b8081ec5ddf7\") "
Aug 04 18:49:31.650502 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:31.650500    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-444w2\" (UniqueName: \"kubernetes.io/projected/894be2d4-46c0-4725-8ea2-b8081ec5ddf7-kube-api-access-444w2\") pod \"894be2d4-46c0-4725-8ea2-b8081ec5ddf7\" (UID: \"894be2d4-46c0-4725-8ea2-b8081ec5ddf7\") "
Aug 04 18:49:31.650965 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:31.650904    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/894be2d4-46c0-4725-8ea2-b8081ec5ddf7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "894be2d4-46c0-4725-8ea2-b8081ec5ddf7" (UID: "894be2d4-46c0-4725-8ea2-b8081ec5ddf7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:49:31.652707 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:31.652683    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/894be2d4-46c0-4725-8ea2-b8081ec5ddf7-kube-api-access-444w2" (OuterVolumeSpecName: "kube-api-access-444w2") pod "894be2d4-46c0-4725-8ea2-b8081ec5ddf7" (UID: "894be2d4-46c0-4725-8ea2-b8081ec5ddf7"). InnerVolumeSpecName "kube-api-access-444w2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:49:31.751254 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:31.751218    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/894be2d4-46c0-4725-8ea2-b8081ec5ddf7-plugins-config-volume\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:49:31.751254 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:31.751247    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-444w2\" (UniqueName: \"kubernetes.io/projected/894be2d4-46c0-4725-8ea2-b8081ec5ddf7-kube-api-access-444w2\") on node \"ip-10-0-141-117.ec2.internal\" DevicePath \"\""
Aug 04 18:49:32.431973 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:32.431932    2572 generic.go:356] "Generic (PLEG): container finished" podID="894be2d4-46c0-4725-8ea2-b8081ec5ddf7" containerID="ab2079e22b5a4a069e0ecaea3ad4d759547a12bdd4462b0cee7d5cff25e1987f" exitCode=0
Aug 04 18:49:32.432431 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:32.431977    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"
Aug 04 18:49:32.432431 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:32.431996    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr" event={"ID":"894be2d4-46c0-4725-8ea2-b8081ec5ddf7","Type":"ContainerDied","Data":"ab2079e22b5a4a069e0ecaea3ad4d759547a12bdd4462b0cee7d5cff25e1987f"}
Aug 04 18:49:32.432431 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:32.432049    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr" event={"ID":"894be2d4-46c0-4725-8ea2-b8081ec5ddf7","Type":"ContainerDied","Data":"d18e05b65acc7e455efa167e0fb56160508ba1d2c92f49ae34ab04fe14ac99d6"}
Aug 04 18:49:32.432431 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:32.432071    2572 scope.go:117] "RemoveContainer" containerID="ab2079e22b5a4a069e0ecaea3ad4d759547a12bdd4462b0cee7d5cff25e1987f"
Aug 04 18:49:32.442234 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:32.442219    2572 scope.go:117] "RemoveContainer" containerID="ab2079e22b5a4a069e0ecaea3ad4d759547a12bdd4462b0cee7d5cff25e1987f"
Aug 04 18:49:32.442483 ip-10-0-141-117 kubenswrapper[2572]: E0804 18:49:32.442465    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab2079e22b5a4a069e0ecaea3ad4d759547a12bdd4462b0cee7d5cff25e1987f\": container with ID starting with ab2079e22b5a4a069e0ecaea3ad4d759547a12bdd4462b0cee7d5cff25e1987f not found: ID does not exist" containerID="ab2079e22b5a4a069e0ecaea3ad4d759547a12bdd4462b0cee7d5cff25e1987f"
Aug 04 18:49:32.442532 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:32.442491    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab2079e22b5a4a069e0ecaea3ad4d759547a12bdd4462b0cee7d5cff25e1987f"} err="failed to get container status \"ab2079e22b5a4a069e0ecaea3ad4d759547a12bdd4462b0cee7d5cff25e1987f\": rpc error: code = NotFound desc = could not find container \"ab2079e22b5a4a069e0ecaea3ad4d759547a12bdd4462b0cee7d5cff25e1987f\": container with ID starting with ab2079e22b5a4a069e0ecaea3ad4d759547a12bdd4462b0cee7d5cff25e1987f not found: ID does not exist"
Aug 04 18:49:32.453474 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:32.453453    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"]
Aug 04 18:49:32.459810 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:32.459791    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e9be3f-b9845dc94-6bnkr"]
Aug 04 18:49:32.875613 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:32.875581    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tpbnv"]
Aug 04 18:49:33.599200 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:33.599168    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="894be2d4-46c0-4725-8ea2-b8081ec5ddf7" path="/var/lib/kubelet/pods/894be2d4-46c0-4725-8ea2-b8081ec5ddf7/volumes"
Aug 04 18:49:44.129701 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:44.129673    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9gdvk_4b8dc637-4e77-4f3e-9194-771eb05bdae7/manager/0.log"
Aug 04 18:49:44.246465 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:44.246433    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zbh6c_653c2e36-9ae7-4881-bdda-e13d02a7c77e/manager/0.log"
Aug 04 18:49:44.471353 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:44.471261    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-k6x85_e80ca94a-bea1-469d-88b5-fb74e601de0c/server/0.log"
Aug 04 18:49:44.934201 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:44.934176    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cddfbf4d9-znjr5_ad213a4a-2bf0-4e0f-a21d-73d0e880de31/copy-manifests/0.log"
Aug 04 18:49:44.939789 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:44.939765    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cddfbf4d9-znjr5_ad213a4a-2bf0-4e0f-a21d-73d0e880de31/manager/0.log"
Aug 04 18:49:45.618134 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:45.618102    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764485-w7lls_41cf0a28-44f0-435b-af52-bce385839d33/cleanup/0.log"
Aug 04 18:49:46.583386 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:46.583357    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-gf68n_97eed660-d9d9-4956-b248-54ff5973d910/manager/0.log"
Aug 04 18:49:46.688661 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:46.688634    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-9g6kj_56fdff5e-2741-4b96-9227-1f4bac31d1a7/manager/0.log"
Aug 04 18:49:46.794400 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:46.794372    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-zglcd_21566f9c-fa05-47de-8163-963ad05a75de/kuadrant-console-plugin/0.log"
Aug 04 18:49:46.914391 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:46.914322    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-g2wfb_c729cee2-cfb4-4dac-b2a5-ee25ed405aa5/manager/0.log"
Aug 04 18:49:47.031728 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:47.031691    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-tpbnv_6becd9bf-c47b-45e7-8d5a-f199fe3fd6e6/limitador/0.log"
Aug 04 18:49:47.149691 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:47.149658    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-q4kdk_077c7648-08bd-40ed-9202-356d1390afbc/manager/0.log"
Aug 04 18:49:47.850703 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:47.850649    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99b5d7fdc-grwv2_6fbcadd4-7b82-47fb-9eeb-87d54670157d/kube-auth-proxy/0.log"
Aug 04 18:49:48.314626 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:48.314599    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-555484c5bd-f27lq_0e22064c-5296-4c38-8d82-dca1e4d6a209/router/0.log"
Aug 04 18:49:48.881473 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:48.881447    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-vzwhz_7e9ca766-63bb-4f9d-b452-0faa221e53be/main/0.log"
Aug 04 18:49:49.110299 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:49.110261    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-8mntw_99424fc3-2e45-43f4-aab6-a9257bfd00fc/main/0.log"
Aug 04 18:49:55.020745 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.020713    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8lbkp/must-gather-pq9mx"]
Aug 04 18:49:55.021425 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.021311    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="894be2d4-46c0-4725-8ea2-b8081ec5ddf7" containerName="payload-processing"
Aug 04 18:49:55.021425 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.021332    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="894be2d4-46c0-4725-8ea2-b8081ec5ddf7" containerName="payload-processing"
Aug 04 18:49:55.021425 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.021354    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="592b491d-05a8-4ea6-864c-19ab28b24210" containerName="revoke-keys"
Aug 04 18:49:55.021425 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.021360    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="592b491d-05a8-4ea6-864c-19ab28b24210" containerName="revoke-keys"
Aug 04 18:49:55.021571 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.021440    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="592b491d-05a8-4ea6-864c-19ab28b24210" containerName="revoke-keys"
Aug 04 18:49:55.021571 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.021453    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="894be2d4-46c0-4725-8ea2-b8081ec5ddf7" containerName="payload-processing"
Aug 04 18:49:55.024711 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.024693    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8lbkp/must-gather-pq9mx"
Aug 04 18:49:55.027141 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.027117    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8lbkp\"/\"kube-root-ca.crt\""
Aug 04 18:49:55.027241 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.027191    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8lbkp\"/\"default-dockercfg-4g7qg\""
Aug 04 18:49:55.027307 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.027262    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8lbkp\"/\"openshift-service-ca.crt\""
Aug 04 18:49:55.032439 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.032421    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8lbkp/must-gather-pq9mx"]
Aug 04 18:49:55.149104 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.149075    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b057fd72-ca05-4c73-a170-7d59c2528c8f-must-gather-output\") pod \"must-gather-pq9mx\" (UID: \"b057fd72-ca05-4c73-a170-7d59c2528c8f\") " pod="openshift-must-gather-8lbkp/must-gather-pq9mx"
Aug 04 18:49:55.149251 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.149129    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrffh\" (UniqueName: \"kubernetes.io/projected/b057fd72-ca05-4c73-a170-7d59c2528c8f-kube-api-access-jrffh\") pod \"must-gather-pq9mx\" (UID: \"b057fd72-ca05-4c73-a170-7d59c2528c8f\") " pod="openshift-must-gather-8lbkp/must-gather-pq9mx"
Aug 04 18:49:55.249903 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.249872    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrffh\" (UniqueName: \"kubernetes.io/projected/b057fd72-ca05-4c73-a170-7d59c2528c8f-kube-api-access-jrffh\") pod \"must-gather-pq9mx\" (UID: \"b057fd72-ca05-4c73-a170-7d59c2528c8f\") " pod="openshift-must-gather-8lbkp/must-gather-pq9mx"
Aug 04 18:49:55.250074 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.249974    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b057fd72-ca05-4c73-a170-7d59c2528c8f-must-gather-output\") pod \"must-gather-pq9mx\" (UID: \"b057fd72-ca05-4c73-a170-7d59c2528c8f\") " pod="openshift-must-gather-8lbkp/must-gather-pq9mx"
Aug 04 18:49:55.250272 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.250257    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b057fd72-ca05-4c73-a170-7d59c2528c8f-must-gather-output\") pod \"must-gather-pq9mx\" (UID: \"b057fd72-ca05-4c73-a170-7d59c2528c8f\") " pod="openshift-must-gather-8lbkp/must-gather-pq9mx"
Aug 04 18:49:55.263521 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.263493    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrffh\" (UniqueName: \"kubernetes.io/projected/b057fd72-ca05-4c73-a170-7d59c2528c8f-kube-api-access-jrffh\") pod \"must-gather-pq9mx\" (UID: \"b057fd72-ca05-4c73-a170-7d59c2528c8f\") " pod="openshift-must-gather-8lbkp/must-gather-pq9mx"
Aug 04 18:49:55.334638 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.334617    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8lbkp/must-gather-pq9mx"
Aug 04 18:49:55.472952 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.467096    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8lbkp/must-gather-pq9mx"]
Aug 04 18:49:55.474838 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.474823    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:49:55.574465 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:55.574435    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8lbkp/must-gather-pq9mx" event={"ID":"b057fd72-ca05-4c73-a170-7d59c2528c8f","Type":"ContainerStarted","Data":"9ca74a029f44585a7cc2655d0175d1a50413b16b9417f093b0bdd408446c995f"}
Aug 04 18:49:58.602610 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:58.601995    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8lbkp/must-gather-pq9mx" event={"ID":"b057fd72-ca05-4c73-a170-7d59c2528c8f","Type":"ContainerStarted","Data":"965d1cdc814d4f6d2f6147d663d31fbf33f3cc07de764f970f62db37c663f3fa"}
Aug 04 18:49:58.602610 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:58.602055    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8lbkp/must-gather-pq9mx" event={"ID":"b057fd72-ca05-4c73-a170-7d59c2528c8f","Type":"ContainerStarted","Data":"a63fa1b4d15400ff8486aa9cd101f5581699589dd1e74721bd788d8b42f19400"}
Aug 04 18:49:58.617719 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:58.617657    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8lbkp/must-gather-pq9mx" podStartSLOduration=1.555780696 podStartE2EDuration="3.61763645s" totalImagesPullingTime="2.061855754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:49:58.615826879 +0000 UTC m=+3783.525716462" watchObservedRunningTime="2026-08-04 18:49:58.61763645 +0000 UTC m=+3783.527526039"
Aug 04 18:49:59.126812 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:59.126775    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q8sr8_7a807e47-6a40-4d63-bc6f-3d2b1c5a3725/global-pull-secret-syncer/0.log"
Aug 04 18:49:59.246129 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:59.246095    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-znb94_1c74287e-62ab-4f8d-8f3b-55bce380c99d/konnectivity-agent/0.log"
Aug 04 18:49:59.294375 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:49:59.294346    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-117.ec2.internal_739cbf3763c2362a5b179b6a7695be8f/haproxy/0.log"
Aug 04 18:50:03.655352 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:03.655312    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-gf68n_97eed660-d9d9-4956-b248-54ff5973d910/manager/0.log"
Aug 04 18:50:03.682347 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:03.682313    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-9g6kj_56fdff5e-2741-4b96-9227-1f4bac31d1a7/manager/0.log"
Aug 04 18:50:03.722422 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:03.721624    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-zglcd_21566f9c-fa05-47de-8163-963ad05a75de/kuadrant-console-plugin/0.log"
Aug 04 18:50:03.853073 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:03.853031    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-g2wfb_c729cee2-cfb4-4dac-b2a5-ee25ed405aa5/manager/0.log"
Aug 04 18:50:03.874141 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:03.874078    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-tpbnv_6becd9bf-c47b-45e7-8d5a-f199fe3fd6e6/limitador/0.log"
Aug 04 18:50:04.005766 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:04.005676    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-q4kdk_077c7648-08bd-40ed-9202-356d1390afbc/manager/0.log"
Aug 04 18:50:05.413516 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:05.413414    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c30f500c-b0a5-424b-9eff-6193992a748e/alertmanager/0.log"
Aug 04 18:50:05.438576 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:05.438549    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c30f500c-b0a5-424b-9eff-6193992a748e/config-reloader/0.log"
Aug 04 18:50:05.458734 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:05.458708    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c30f500c-b0a5-424b-9eff-6193992a748e/kube-rbac-proxy-web/0.log"
Aug 04 18:50:05.483251 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:05.483220    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c30f500c-b0a5-424b-9eff-6193992a748e/kube-rbac-proxy/0.log"
Aug 04 18:50:05.514739 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:05.514708    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c30f500c-b0a5-424b-9eff-6193992a748e/kube-rbac-proxy-metric/0.log"
Aug 04 18:50:05.535236 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:05.535200    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c30f500c-b0a5-424b-9eff-6193992a748e/prom-label-proxy/0.log"
Aug 04 18:50:05.556337 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:05.556308    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c30f500c-b0a5-424b-9eff-6193992a748e/init-config-reloader/0.log"
Aug 04 18:50:05.837179 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:05.837142    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-szdrk_442bbd6a-e4d9-4901-b3b0-0689a7537b12/node-exporter/0.log"
Aug 04 18:50:05.859354 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:05.859327    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-szdrk_442bbd6a-e4d9-4901-b3b0-0689a7537b12/kube-rbac-proxy/0.log"
Aug 04 18:50:05.883559 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:05.883531    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-szdrk_442bbd6a-e4d9-4901-b3b0-0689a7537b12/init-textfile/0.log"
Aug 04 18:50:05.996550 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:05.996526    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-z9k6g_a0f1705b-dffb-42f1-8f4b-33a632a35088/kube-rbac-proxy-main/0.log"
Aug 04 18:50:06.030738 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:06.030710    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-z9k6g_a0f1705b-dffb-42f1-8f4b-33a632a35088/kube-rbac-proxy-self/0.log"
Aug 04 18:50:06.059055 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:06.059021    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-z9k6g_a0f1705b-dffb-42f1-8f4b-33a632a35088/openshift-state-metrics/0.log"
Aug 04 18:50:06.356879 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:06.356853    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b4f556ff6-frrkh_429255f8-4691-4e98-9f48-2e7241400012/telemeter-client/0.log"
Aug 04 18:50:06.379912 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:06.379885    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b4f556ff6-frrkh_429255f8-4691-4e98-9f48-2e7241400012/reload/0.log"
Aug 04 18:50:06.401091 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:06.401046    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b4f556ff6-frrkh_429255f8-4691-4e98-9f48-2e7241400012/kube-rbac-proxy/0.log"
Aug 04 18:50:09.077449 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.077409    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b546b58cd-p6wnc_c8e4f148-7c4a-421b-8091-e41bc99fa874/console/0.log"
Aug 04 18:50:09.114397 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.114367    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-skr89_8bf06a04-e3ab-4711-b939-f1495b47263f/download-server/0.log"
Aug 04 18:50:09.502681 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.502593    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"]
Aug 04 18:50:09.505448 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.505425    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:09.515620 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.515590    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"]
Aug 04 18:50:09.609237 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.609194    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e02ba852-d1ad-47d3-b81c-2c4a53547367-proc\") pod \"perf-node-gather-daemonset-vwkjj\" (UID: \"e02ba852-d1ad-47d3-b81c-2c4a53547367\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:09.609435 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.609247    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e02ba852-d1ad-47d3-b81c-2c4a53547367-sys\") pod \"perf-node-gather-daemonset-vwkjj\" (UID: \"e02ba852-d1ad-47d3-b81c-2c4a53547367\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:09.609435 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.609321    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e02ba852-d1ad-47d3-b81c-2c4a53547367-podres\") pod \"perf-node-gather-daemonset-vwkjj\" (UID: \"e02ba852-d1ad-47d3-b81c-2c4a53547367\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:09.609435 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.609412    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e02ba852-d1ad-47d3-b81c-2c4a53547367-lib-modules\") pod \"perf-node-gather-daemonset-vwkjj\" (UID: \"e02ba852-d1ad-47d3-b81c-2c4a53547367\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:09.609615 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.609443    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7swl\" (UniqueName: \"kubernetes.io/projected/e02ba852-d1ad-47d3-b81c-2c4a53547367-kube-api-access-x7swl\") pod \"perf-node-gather-daemonset-vwkjj\" (UID: \"e02ba852-d1ad-47d3-b81c-2c4a53547367\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:09.710944 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.710892    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e02ba852-d1ad-47d3-b81c-2c4a53547367-lib-modules\") pod \"perf-node-gather-daemonset-vwkjj\" (UID: \"e02ba852-d1ad-47d3-b81c-2c4a53547367\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:09.711172 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.711098    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e02ba852-d1ad-47d3-b81c-2c4a53547367-lib-modules\") pod \"perf-node-gather-daemonset-vwkjj\" (UID: \"e02ba852-d1ad-47d3-b81c-2c4a53547367\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:09.711323 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.711168    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7swl\" (UniqueName: \"kubernetes.io/projected/e02ba852-d1ad-47d3-b81c-2c4a53547367-kube-api-access-x7swl\") pod \"perf-node-gather-daemonset-vwkjj\" (UID: \"e02ba852-d1ad-47d3-b81c-2c4a53547367\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:09.711323 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.711310    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e02ba852-d1ad-47d3-b81c-2c4a53547367-proc\") pod \"perf-node-gather-daemonset-vwkjj\" (UID: \"e02ba852-d1ad-47d3-b81c-2c4a53547367\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:09.711439 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.711353    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e02ba852-d1ad-47d3-b81c-2c4a53547367-sys\") pod \"perf-node-gather-daemonset-vwkjj\" (UID: \"e02ba852-d1ad-47d3-b81c-2c4a53547367\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:09.711496 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.711451    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e02ba852-d1ad-47d3-b81c-2c4a53547367-podres\") pod \"perf-node-gather-daemonset-vwkjj\" (UID: \"e02ba852-d1ad-47d3-b81c-2c4a53547367\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:09.711670 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.711648    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e02ba852-d1ad-47d3-b81c-2c4a53547367-sys\") pod \"perf-node-gather-daemonset-vwkjj\" (UID: \"e02ba852-d1ad-47d3-b81c-2c4a53547367\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:09.711771 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.711748    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e02ba852-d1ad-47d3-b81c-2c4a53547367-podres\") pod \"perf-node-gather-daemonset-vwkjj\" (UID: \"e02ba852-d1ad-47d3-b81c-2c4a53547367\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:09.711850 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.711672    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e02ba852-d1ad-47d3-b81c-2c4a53547367-proc\") pod \"perf-node-gather-daemonset-vwkjj\" (UID: \"e02ba852-d1ad-47d3-b81c-2c4a53547367\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:09.720357 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.720329    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7swl\" (UniqueName: \"kubernetes.io/projected/e02ba852-d1ad-47d3-b81c-2c4a53547367-kube-api-access-x7swl\") pod \"perf-node-gather-daemonset-vwkjj\" (UID: \"e02ba852-d1ad-47d3-b81c-2c4a53547367\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:09.819044 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:09.818997    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:10.028484 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:10.028453    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"]
Aug 04 18:50:10.030341 ip-10-0-141-117 kubenswrapper[2572]: W0804 18:50:10.030298    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode02ba852_d1ad_47d3_b81c_2c4a53547367.slice/crio-c3b2c355af8cee60aeb07df23962dbfb0eb0c77e6ed125086757ceb7a3a3d4dd WatchSource:0}: Error finding container c3b2c355af8cee60aeb07df23962dbfb0eb0c77e6ed125086757ceb7a3a3d4dd: Status 404 returned error can't find the container with id c3b2c355af8cee60aeb07df23962dbfb0eb0c77e6ed125086757ceb7a3a3d4dd
Aug 04 18:50:10.728142 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:10.728092    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj" event={"ID":"e02ba852-d1ad-47d3-b81c-2c4a53547367","Type":"ContainerStarted","Data":"88147781137cbf335c10499f46f46f598725404b1aad89c69cf83a86c1ee0d34"}
Aug 04 18:50:10.728625 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:10.728170    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj" event={"ID":"e02ba852-d1ad-47d3-b81c-2c4a53547367","Type":"ContainerStarted","Data":"c3b2c355af8cee60aeb07df23962dbfb0eb0c77e6ed125086757ceb7a3a3d4dd"}
Aug 04 18:50:10.728625 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:10.728287    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:10.745981 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:10.745905    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj" podStartSLOduration=1.745883744 podStartE2EDuration="1.745883744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:50:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:50:10.741714552 +0000 UTC m=+3795.651604140" watchObservedRunningTime="2026-08-04 18:50:10.745883744 +0000 UTC m=+3795.655773332"
Aug 04 18:50:11.167044 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:11.167013    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9v6j5_9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9/dns/0.log"
Aug 04 18:50:11.187248 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:11.187216    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9v6j5_9fbc8f8f-1dfc-4cf1-8ecf-ad0e6a3e42d9/kube-rbac-proxy/0.log"
Aug 04 18:50:11.256104 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:11.256064    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v9vlx_b132d677-de62-4ae6-8819-70add7cd8664/dns-node-resolver/0.log"
Aug 04 18:50:11.855367 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:11.855329    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hhd6t_d075b2ff-c092-4dd0-86ca-90badefc19e2/node-ca/0.log"
Aug 04 18:50:12.978705 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:12.978673    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99b5d7fdc-grwv2_6fbcadd4-7b82-47fb-9eeb-87d54670157d/kube-auth-proxy/0.log"
Aug 04 18:50:13.098900 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:13.098847    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-555484c5bd-f27lq_0e22064c-5296-4c38-8d82-dca1e4d6a209/router/0.log"
Aug 04 18:50:13.949581 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:13.949555    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x8fdb_571b97b3-7164-4be6-96f6-70ae0783e371/serve-healthcheck-canary/0.log"
Aug 04 18:50:14.406309 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:14.406276    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-wxw48_cb785aa2-a9a1-4501-ad29-0ec94b0675ca/insights-operator/0.log"
Aug 04 18:50:14.407501 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:14.407460    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-wxw48_cb785aa2-a9a1-4501-ad29-0ec94b0675ca/insights-operator/1.log"
Aug 04 18:50:14.428050 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:14.428024    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6dbtk_c69247c0-d792-4110-89f6-abd9b723d10a/kube-rbac-proxy/0.log"
Aug 04 18:50:14.447461 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:14.447429    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6dbtk_c69247c0-d792-4110-89f6-abd9b723d10a/exporter/0.log"
Aug 04 18:50:14.466540 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:14.466510    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6dbtk_c69247c0-d792-4110-89f6-abd9b723d10a/extractor/0.log"
Aug 04 18:50:16.681708 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:16.681679    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9gdvk_4b8dc637-4e77-4f3e-9194-771eb05bdae7/manager/0.log"
Aug 04 18:50:16.750629 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:16.750581    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-vwkjj"
Aug 04 18:50:16.973121 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:16.973042    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zbh6c_653c2e36-9ae7-4881-bdda-e13d02a7c77e/manager/0.log"
Aug 04 18:50:17.162719 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:17.162684    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-k6x85_e80ca94a-bea1-469d-88b5-fb74e601de0c/server/0.log"
Aug 04 18:50:17.411047 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:17.410997    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cddfbf4d9-znjr5_ad213a4a-2bf0-4e0f-a21d-73d0e880de31/manager/0.log"
Aug 04 18:50:17.432490 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:17.432462    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cddfbf4d9-znjr5_ad213a4a-2bf0-4e0f-a21d-73d0e880de31/copy-manifests/0.log"
Aug 04 18:50:19.942963 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:19.942858    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99b5d7fdc-grwv2_6fbcadd4-7b82-47fb-9eeb-87d54670157d/kube-auth-proxy/0.log"
Aug 04 18:50:20.024701 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:20.024668    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-555484c5bd-f27lq_0e22064c-5296-4c38-8d82-dca1e4d6a209/router/0.log"
Aug 04 18:50:21.599391 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:21.599364    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99b5d7fdc-grwv2_6fbcadd4-7b82-47fb-9eeb-87d54670157d/kube-auth-proxy/0.log"
Aug 04 18:50:21.702145 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:21.702116    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-555484c5bd-f27lq_0e22064c-5296-4c38-8d82-dca1e4d6a209/router/0.log"
Aug 04 18:50:24.158731 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:24.158704    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-v6nfr_a78b03fa-ab27-4065-915a-9b9658f59304/kube-storage-version-migrator-operator/1.log"
Aug 04 18:50:24.159581 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:24.159563    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-v6nfr_a78b03fa-ab27-4065-915a-9b9658f59304/kube-storage-version-migrator-operator/0.log"
Aug 04 18:50:25.388676 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:25.388647    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vnbxn_d075f732-ebb5-4bee-bd7a-4ebf3427dc6a/kube-multus-additional-cni-plugins/0.log"
Aug 04 18:50:25.407978 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:25.407953    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vnbxn_d075f732-ebb5-4bee-bd7a-4ebf3427dc6a/egress-router-binary-copy/0.log"
Aug 04 18:50:25.427082 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:25.427054    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vnbxn_d075f732-ebb5-4bee-bd7a-4ebf3427dc6a/cni-plugins/0.log"
Aug 04 18:50:25.445981 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:25.445952    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vnbxn_d075f732-ebb5-4bee-bd7a-4ebf3427dc6a/bond-cni-plugin/0.log"
Aug 04 18:50:25.466549 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:25.466511    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vnbxn_d075f732-ebb5-4bee-bd7a-4ebf3427dc6a/routeoverride-cni/0.log"
Aug 04 18:50:25.484957 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:25.484907    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vnbxn_d075f732-ebb5-4bee-bd7a-4ebf3427dc6a/whereabouts-cni-bincopy/0.log"
Aug 04 18:50:25.504681 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:25.504655    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vnbxn_d075f732-ebb5-4bee-bd7a-4ebf3427dc6a/whereabouts-cni/0.log"
Aug 04 18:50:25.546199 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:25.546169    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kzb4p_f2241cc8-8250-4928-8766-3baa44e0244a/kube-multus/0.log"
Aug 04 18:50:25.685224 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:25.685140    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sftls_7acf398c-a516-4d37-9792-38cf40564333/network-metrics-daemon/0.log"
Aug 04 18:50:25.700871 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:25.700842    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sftls_7acf398c-a516-4d37-9792-38cf40564333/kube-rbac-proxy/0.log"
Aug 04 18:50:26.886473 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:26.886443    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-controller/0.log"
Aug 04 18:50:26.901497 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:26.901468    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/0.log"
Aug 04 18:50:26.901497 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:26.901490    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/ovn-acl-logging/1.log"
Aug 04 18:50:26.922820 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:26.922794    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/kube-rbac-proxy-node/0.log"
Aug 04 18:50:26.943877 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:26.943848    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/kube-rbac-proxy-ovn-metrics/0.log"
Aug 04 18:50:26.959963 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:26.959937    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/northd/0.log"
Aug 04 18:50:26.980159 ip-10-0-141-117 kubenswrapper[2572]: I0804 18:50:26.980123    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfjqr_4cce1fb4-a6cb-4481-b1e2-a828f22547b3/nbdb/0.log"