Jul 21 04:02:21.730741 ip-10-0-130-0 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 04:02:21.730753 ip-10-0-130-0 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 04:02:21.730760 ip-10-0-130-0 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 04:02:21.730990 ip-10-0-130-0 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 04:02:31.906069 ip-10-0-130-0 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 04:02:31.906088 ip-10-0-130-0 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d52c9ae5c4aa48e3a9f5ef7b4cd0c54a --
Jul 21 04:04:10.073091 ip-10-0-130-0 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 04:04:10.441553 ip-10-0-130-0 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 04:04:10.441553 ip-10-0-130-0 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 04:04:10.441553 ip-10-0-130-0 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 04:04:10.441553 ip-10-0-130-0 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 04:04:10.441553 ip-10-0-130-0 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 04:04:10.442563 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.442463    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 04:04:10.446740 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446721    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:10.446740 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446737    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:10.446740 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446743    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:10.446740 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446747    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446751    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446757    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446763    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446773    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446777    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446781    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446785    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446789    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446792    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446795    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446799    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446803    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446807    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446811    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446814    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446818    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446822    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446826    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446830    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:10.446982 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446834    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446838    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446842    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446846    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446850    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446855    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446861    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446867    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446871    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446876    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446881    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446885    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446890    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446894    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446899    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446904    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446909    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446913    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446918    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446922    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:10.447823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446927    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446931    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446935    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446939    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446943    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446947    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446951    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446960    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446966    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446971    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446976    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446980    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446984    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446989    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446993    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.446998    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447002    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447006    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447011    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447015    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:10.448758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447019    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447024    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447028    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447032    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447036    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447041    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447046    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447051    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447056    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447060    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447066    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447070    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447075    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447079    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447083    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447087    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447091    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447095    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447099    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447103    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:10.449589 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447107    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447111    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447115    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447119    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447123    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447127    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447132    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447136    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447140    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447145    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447149    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447153    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447157    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447161    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447165    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.447169    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448327    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448336    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448342    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448346    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:10.450471 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448351    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448356    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448360    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448365    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448369    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448373    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448377    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448381    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448385    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448389    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448393    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448397    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448402    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448406    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448410    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448414    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448418    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448422    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448426    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448430    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:10.451330 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448434    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448438    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448443    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448447    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448451    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448455    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448459    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448463    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448468    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448472    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448479    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448483    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448487    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448491    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448496    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448500    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448504    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448509    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448512    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448517    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:10.451863 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448521    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448525    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448529    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448533    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448537    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448541    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448545    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448553    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448559    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448565    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448573    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448578    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448582    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448586    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448591    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448595    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448599    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448603    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448608    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:10.452552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448612    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448616    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448620    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448626    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448630    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448655    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448661    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448665    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448670    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448674    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448679    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448682    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448689    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448694    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448699    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448703    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448707    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448711    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448715    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:10.453099 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448720    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448724    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448728    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448732    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448737    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448741    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448745    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448749    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448753    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448756    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448760    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448764    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448767    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448771    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448776    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448780    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.448786    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449338    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449345    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449349    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:10.453775 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449354    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449358    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449362    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449367    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449371    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449375    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449381    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449387    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449393    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449398    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449404    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449408    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449412    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449416    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449420    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449424    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449428    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449433    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449437    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:10.454263 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449441    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449445    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449449    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449453    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449457    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449461    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449465    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449470    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449475    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449481    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449485    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449490    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449494    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449498    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449502    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449507    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449511    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449515    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449519    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449523    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:10.454829 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449527    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449531    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449535    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449539    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449543    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449547    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449551    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449554    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449558    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449562    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449567    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449570    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449575    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449579    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449583    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449587    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449591    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449594    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449598    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449604    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:10.455318 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449611    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449618    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449623    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449628    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449632    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449655    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449660    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449664    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449670    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449674    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449678    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449683    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449687    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449691    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449695    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449699    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449702    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449707    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449710    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449714    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:10.455839 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449718    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449722    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449726    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449730    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449734    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449739    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449743    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449747    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449751    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449755    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449759    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449766    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449770    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449776    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449780    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449784    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.449788    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449876    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449893    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449902    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449908    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 04:04:10.456326 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449916    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449921    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449927    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449933    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449937    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449942    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449948    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449953    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449958    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449962    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449967    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449971    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449975    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449980    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449987    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449991    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.449996    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450001    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450006    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450012    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450016    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450021    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450028    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450033    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 04:04:10.456846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450039    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450043    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450048    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450052    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450059    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450064    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450068    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450072    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450077    2576 flags.go:64] FLAG: --enable-server="true"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450082    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450089    2576 flags.go:64] FLAG: --event-burst="100"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450093    2576 flags.go:64] FLAG: --event-qps="50"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450098    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450103    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450107    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450113    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450118    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450122    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450127    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450131    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450136    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450141    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450146    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450150    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450154    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 04:04:10.457412 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450159    2576 flags.go:64] FLAG: --feature-gates=""
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450165    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450170    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450174    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450179    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450185    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450190    2576 flags.go:64] FLAG: --help="false"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450196    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-130-0.ec2.internal"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450200    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450205    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450209    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450215    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450220    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450225    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450229    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450234    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450238    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450244    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450248    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450253    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450257    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450262    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450266    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450271    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 04:04:10.458147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450275    2576 flags.go:64] FLAG: --lock-file=""
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450279    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450284    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450290    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450298    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450303    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450307    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450312    2576 flags.go:64] FLAG: --logging-format="text"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450316    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450321    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450325    2576 flags.go:64] FLAG: --manifest-url=""
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450329    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450340    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450348    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450354    2576 flags.go:64] FLAG: --max-pods="110"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450360    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450365    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450369    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450374    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450378    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450383    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450387    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450398    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450403    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450407    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 04:04:10.458793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450412    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450417    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450425    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450430    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450434    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450439    2576 flags.go:64] FLAG: --port="10250"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450443    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450448    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09d02e246c280adae"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450453    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450458    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450462    2576 flags.go:64] FLAG: --register-node="true"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450467    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450472    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450476    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450480    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450484    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450490    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450494    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450499    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450504    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450508    2576 flags.go:64] FLAG: --runonce="false"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450513    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450518    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450522    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450527    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 04:04:10.459386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450531    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450536    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450540    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450544    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450549    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450553    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450557    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450562    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450566    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450572    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450576    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450584    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450588    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450593    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450599    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450603    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450607    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450612    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450616    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450620    2576 flags.go:64] FLAG: --v="2"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450626    2576 flags.go:64] FLAG: --version="false"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450632    2576 flags.go:64] FLAG: --vmodule=""
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450658    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.450663    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450837    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:10.460014 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450844    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450849    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450854    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450858    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450862    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450867    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450872    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450876    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450880    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450884    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450889    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450893    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450897    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450901    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450905    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450909    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450913    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450918    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450922    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450927    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:10.460617 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450931    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450935    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450939    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450943    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450948    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450953    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450956    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450961    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450965    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450969    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450973    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450977    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450981    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450985    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450990    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450994    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.450999    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451003    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451007    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451011    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:10.461112 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451015    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451019    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451023    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451027    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451031    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451035    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451041    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451047    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451052    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451056    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451060    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451065    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451069    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451073    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451077    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451081    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451084    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451091    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451096    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:10.461592 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451101    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451105    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451109    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451113    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451117    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451121    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451125    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451129    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451133    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451137    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451141    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451145    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451149    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451153    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451158    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451162    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451166    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451170    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451176    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:10.462105 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451180    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451184    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451189    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451193    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451197    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451203    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451207    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451212    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451216    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451220    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451224    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451227    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451231    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451236    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451240    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451244    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451248    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451252    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451256    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:10.462553 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.451262    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:10.463031 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.452254    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 04:04:10.463031 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.459160    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 04:04:10.463031 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.459175    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 04:04:10.463031 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.459187    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 04:04:10.463031 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.459193    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 04:04:10.463031 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459262    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:10.463031 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459266    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:10.463031 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459270    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:10.463031 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459273    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:10.463031 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459276    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:10.463031 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459279    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:10.463031 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459281    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:10.463031 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459284    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:10.463031 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459287    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459290    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459293    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459295    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459297    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459301    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459303    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459306    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459309    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459311    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459314    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459316    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459319    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459322    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459324    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459327    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459329    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459332    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459334    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:10.463373 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459337    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459341    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459345    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459348    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459351    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459354    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459357    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459359    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459362    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459365    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459367    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459370    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459372    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459375    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459377    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459379    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459382    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459384    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459386    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:10.463862 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459389    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459391    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459394    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459397    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459400    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459403    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459407    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459410    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459413    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459415    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459418    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459420    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459422    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459425    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459427    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459430    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459432    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459435    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459437    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459440    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:10.464313 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459442    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459444    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459447    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459449    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459452    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459454    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459456    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459459    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459462    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459465    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459468    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459471    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459473    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459476    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459478    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459481    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459483    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459485    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459488    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459490    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:10.464807 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459492    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:10.465315 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459495    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:10.465315 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459498    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:10.465315 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459500    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:10.465315 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459503    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:10.465315 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459505    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:10.465315 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459507    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:10.465315 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459510    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:10.465315 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459512    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:10.465315 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459515    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:10.465315 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459517    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:10.465315 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459520    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:10.465315 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459523    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:10.465315 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.459528    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 04:04:10.465315 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459660    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:10.465315 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459665    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459668    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459671    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459674    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459676    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459680    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459683    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459686    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459689    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459691    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459693    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459696    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459699    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459701    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459704    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459706    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459709    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459711    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459714    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:10.465793 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459716    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459718    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459721    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459723    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459732    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459735    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459738    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459740    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459744    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459746    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459748    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459751    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459753    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459756    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459758    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459761    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459763    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459765    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459768    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:10.466572 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459770    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459773    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459775    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459778    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459780    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459782    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459785    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459788    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459790    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459792    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459795    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459797    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459800    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459802    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459804    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459807    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459809    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459812    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459814    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459816    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459819    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:10.467205 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459821    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459824    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459827    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459829    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459831    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459834    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459836    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459839    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459843    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459845    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459848    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459850    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459852    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459854    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459858    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459861    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459864    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459866    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459869    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:10.467778 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459871    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459874    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459877    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459879    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459881    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459883    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459886    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459888    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459891    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459893    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459895    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459900    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459902    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459905    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459907    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459910    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459912    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459915    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459917    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:10.468227 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:10.459920    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:10.468694 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.459924    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 04:04:10.468694 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.460014    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 04:04:10.468694 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.462971    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 04:04:10.468694 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.464255    2576 server.go:1019] "Starting client certificate rotation"
Jul 21 04:04:10.468694 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.464359    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 04:04:10.468694 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.464398    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 04:04:10.468847 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.468725    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 04:04:10.476447 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.476430    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 04:04:10.488800 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.488780    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 21 04:04:10.490900 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.490884    2576 log.go:25] "Validated CRI v1 image API"
Jul 21 04:04:10.491717 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.491705    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 04:04:10.492545 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.492531    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 04:04:10.495231 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.495212    2576 fs.go:135] Filesystem UUIDs: map[64615540-dfa8-4d93-97b7-b0e95b68d11c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b5e5e9bf-2714-4b80-a344-113210fa0944:/dev/nvme0n1p3]
Jul 21 04:04:10.495298 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.495230    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 04:04:10.500187 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.500089    2576 manager.go:216] Machine: {Timestamp:2026-07-21 04:04:10.498760244 +0000 UTC m=+0.316327019 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098588 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27bbf5560857537773116174fb3498 SystemUUID:ec27bbf5-5608-5753-7773-116174fb3498 BootID:d52c9ae5-c4aa-48e3-a9f5-ef7b4cd0c54a Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4c:40:ba:53:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4c:40:ba:53:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:78:0a:64:8b:7c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 04:04:10.500187 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.500186    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 04:04:10.500286 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.500252    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 04:04:10.502849 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.502824    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 04:04:10.502975 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.502852    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-0.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 04:04:10.503600 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.503591    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 04:04:10.503632 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.503603    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 04:04:10.503632 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.503610    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 04:04:10.504321 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.504309    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 04:04:10.505499 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.505489    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 04:04:10.508737 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.508726    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 04:04:10.508849 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.508840    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 04:04:10.508877 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.508869    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 04:04:10.508908 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.508878    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 04:04:10.508908 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.508897    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 04:04:10.508908 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.508906    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 21 04:04:10.508997 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.508919    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 04:04:10.509253 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.509240    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 04:04:10.509305 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.509259    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 04:04:10.511557 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.511543    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 04:04:10.513545 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.513526    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 04:04:10.513615 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.513576    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 04:04:10.515099 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.515082    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 04:04:10.515155 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.515109    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 04:04:10.515155 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.515120    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 04:04:10.515155 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.515128    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 04:04:10.515155 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.515142    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 04:04:10.515155 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.515148    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 04:04:10.515155 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.515156    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 04:04:10.515313 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.515162    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 04:04:10.515313 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.515170    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 04:04:10.515313 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.515176    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 04:04:10.515313 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.515184    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 04:04:10.515313 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.515190    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 04:04:10.516816 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.516798    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 04:04:10.516816 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.516819    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 04:04:10.519503 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.519484    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-0.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 04:04:10.519973 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.519955    2576 server.go:1268] "Started kubelet"
Jul 21 04:04:10.520072 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.520023    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 04:04:10.520176 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.520141    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 04:04:10.520282 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.520199    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 04:04:10.520354 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.520327    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 04:04:10.520418 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.520334    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 04:04:10.520750 ip-10-0-130-0 systemd[1]: Started Kubernetes Kubelet.
Jul 21 04:04:10.522455 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.522438    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 04:04:10.523869 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.523852    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 04:04:10.525519 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.525501    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 04:04:10.528976 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.527904    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-0.ec2.internal.18c4324b1c0a4004  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-0.ec2.internal,UID:ip-10-0-130-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-0.ec2.internal,},FirstTimestamp:2026-07-21 04:04:10.519928836 +0000 UTC m=+0.337495610,LastTimestamp:2026-07-21 04:04:10.519928836 +0000 UTC m=+0.337495610,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-0.ec2.internal,}"
Jul 21 04:04:10.529839 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.529820    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 04:04:10.529935 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.529822    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 04:04:10.529935 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.529905    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-0.ec2.internal\" not found"
Jul 21 04:04:10.530414 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.530399    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 04:04:10.530414 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.530416    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 04:04:10.530534 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.530402    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 04:04:10.530534 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.530532    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 04:04:10.530624 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.530540    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 04:04:10.530714 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.530702    2576 factory.go:55] Registering systemd factory
Jul 21 04:04:10.530756 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.530718    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 21 04:04:10.530952 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.530932    2576 factory.go:153] Registering CRI-O factory
Jul 21 04:04:10.530952 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.530952    2576 factory.go:223] Registration of the crio container factory successfully
Jul 21 04:04:10.531090 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.531002    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 04:04:10.531090 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.531025    2576 factory.go:103] Registering Raw factory
Jul 21 04:04:10.531090 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.531039    2576 manager.go:1196] Started watching for new ooms in manager
Jul 21 04:04:10.531602 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.531587    2576 manager.go:349] Starting recovery of all containers
Jul 21 04:04:10.534799 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.534777    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 04:04:10.534868 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.534829    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 04:04:10.541348 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.541336    2576 manager.go:354] Recovery completed
Jul 21 04:04:10.547191 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.547174    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:10.547267 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.547195    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vf6f6"
Jul 21 04:04:10.549040 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.548937    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:10.549121 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.549059    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:10.549121 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.549074    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:10.549651 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.549619    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 04:04:10.549651 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.549626    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:10.549651 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.549631    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 04:04:10.549790 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.549662    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 04:04:10.550831 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.550814    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:10.550933 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.550783    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-0.ec2.internal.18c4324b1dc67b50  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-0.ec2.internal,UID:ip-10-0-130-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-0.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-0.ec2.internal,},FirstTimestamp:2026-07-21 04:04:10.549042 +0000 UTC m=+0.366608785,LastTimestamp:2026-07-21 04:04:10.549042 +0000 UTC m=+0.366608785,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-0.ec2.internal,}"
Jul 21 04:04:10.550933 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.550851    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:10.550933 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.550861    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:10.550933 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.550822    2576 policy_none.go:49] "None policy: Start"
Jul 21 04:04:10.550933 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.550914    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 04:04:10.550933 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.550927    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 04:04:10.551934 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.551922    2576 policy_none.go:47] "Start"
Jul 21 04:04:10.554225 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.554208    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vf6f6"
Jul 21 04:04:10.559076 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.559016    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-0.ec2.internal.18c4324b1dc6da34  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-0.ec2.internal,UID:ip-10-0-130-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-0.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-0.ec2.internal,},FirstTimestamp:2026-07-21 04:04:10.549066292 +0000 UTC m=+0.366633069,LastTimestamp:2026-07-21 04:04:10.549066292 +0000 UTC m=+0.366633069,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-0.ec2.internal,}"
Jul 21 04:04:10.589297 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.589279    2576 manager.go:337] "Starting Device Plugin manager"
Jul 21 04:04:10.600794 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.589315    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 04:04:10.600794 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.589328    2576 server.go:87] "Starting device plugin registration server"
Jul 21 04:04:10.600794 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.589553    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 04:04:10.600794 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.589564    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 04:04:10.600794 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.589653    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 04:04:10.600794 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.589737    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 04:04:10.600794 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.589749    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 04:04:10.600794 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.590376    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 04:04:10.600794 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.590414    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-0.ec2.internal\" not found"
Jul 21 04:04:10.656767 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.656742    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 04:04:10.658020 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.657998    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 04:04:10.658108 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.658040    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 04:04:10.658108 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.658065    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 04:04:10.658108 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.658101    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 04:04:10.660674 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.660655    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:10.690581 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.690557    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:10.691324 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.691298    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:10.691402 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.691330    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:10.691402 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.691341    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:10.691402 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.691366    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-0.ec2.internal"
Jul 21 04:04:10.700224 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.700186    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-0.ec2.internal"
Jul 21 04:04:10.700224 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.700204    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-0.ec2.internal\": node \"ip-10-0-130-0.ec2.internal\" not found"
Jul 21 04:04:10.726201 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.726179    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-0.ec2.internal\" not found"
Jul 21 04:04:10.758337 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.758316    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-0.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal"]
Jul 21 04:04:10.758395 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.758365    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:10.759820 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.759804    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:10.759896 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.759832    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:10.759896 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.759843    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:10.760910 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.760898    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:10.761051 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.761036    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-0.ec2.internal"
Jul 21 04:04:10.761089 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.761066    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:10.761598 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.761585    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:10.761677 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.761604    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:10.761677 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.761616    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:10.761677 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.761664    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:10.761784 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.761691    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:10.761784 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.761706    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:10.762726 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.762710    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal"
Jul 21 04:04:10.762790 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.762734    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:10.763366 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.763351    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:10.763425 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.763376    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:10.763425 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.763386    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:10.791136 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.791120    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-0.ec2.internal\" not found" node="ip-10-0-130-0.ec2.internal"
Jul 21 04:04:10.795555 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.795537    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-0.ec2.internal\" not found" node="ip-10-0-130-0.ec2.internal"
Jul 21 04:04:10.826820 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.826802    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-0.ec2.internal\" not found"
Jul 21 04:04:10.832216 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.832202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35d034690d2db0b8212daaa6bd5c8a40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal\" (UID: \"35d034690d2db0b8212daaa6bd5c8a40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal"
Jul 21 04:04:10.832270 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.832222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/20a6a41a7a65b6e98b711844aad515ac-config\") pod \"kube-apiserver-proxy-ip-10-0-130-0.ec2.internal\" (UID: \"20a6a41a7a65b6e98b711844aad515ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-0.ec2.internal"
Jul 21 04:04:10.832270 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.832242    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/35d034690d2db0b8212daaa6bd5c8a40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal\" (UID: \"35d034690d2db0b8212daaa6bd5c8a40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal"
Jul 21 04:04:10.927184 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:10.927164    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-0.ec2.internal\" not found"
Jul 21 04:04:10.932490 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.932477    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/35d034690d2db0b8212daaa6bd5c8a40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal\" (UID: \"35d034690d2db0b8212daaa6bd5c8a40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal"
Jul 21 04:04:10.932532 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.932498    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35d034690d2db0b8212daaa6bd5c8a40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal\" (UID: \"35d034690d2db0b8212daaa6bd5c8a40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal"
Jul 21 04:04:10.932532 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.932515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/20a6a41a7a65b6e98b711844aad515ac-config\") pod \"kube-apiserver-proxy-ip-10-0-130-0.ec2.internal\" (UID: \"20a6a41a7a65b6e98b711844aad515ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-0.ec2.internal"
Jul 21 04:04:10.932594 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.932549    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/20a6a41a7a65b6e98b711844aad515ac-config\") pod \"kube-apiserver-proxy-ip-10-0-130-0.ec2.internal\" (UID: \"20a6a41a7a65b6e98b711844aad515ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-0.ec2.internal"
Jul 21 04:04:10.932594 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.932582    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/35d034690d2db0b8212daaa6bd5c8a40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal\" (UID: \"35d034690d2db0b8212daaa6bd5c8a40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal"
Jul 21 04:04:10.932673 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:10.932589    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35d034690d2db0b8212daaa6bd5c8a40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal\" (UID: \"35d034690d2db0b8212daaa6bd5c8a40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal"
Jul 21 04:04:11.027922 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:11.027876    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-0.ec2.internal\" not found"
Jul 21 04:04:11.094363 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.094337    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-0.ec2.internal"
Jul 21 04:04:11.098907 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.098436    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal"
Jul 21 04:04:11.127969 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:11.127931    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-0.ec2.internal\" not found"
Jul 21 04:04:11.228446 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:11.228403    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-0.ec2.internal\" not found"
Jul 21 04:04:11.328953 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:11.328874    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-0.ec2.internal\" not found"
Jul 21 04:04:11.429418 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:11.429392    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-0.ec2.internal\" not found"
Jul 21 04:04:11.463773 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.463756    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 04:04:11.464203 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.463886    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 04:04:11.502488 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.502463    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:11.509548 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.509534    2576 apiserver.go:52] "Watching apiserver"
Jul 21 04:04:11.517833 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.517809    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 04:04:11.518182 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.518164    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-jqwz8","openshift-image-registry/node-ca-b8j9r","openshift-multus/multus-additional-cni-plugins-hbcl2","openshift-multus/multus-x6d78","openshift-multus/network-metrics-daemon-l5vv7","openshift-network-diagnostics/network-check-target-dj45n","openshift-ovn-kubernetes/ovnkube-node-whzmq","kube-system/global-pull-secret-syncer-ksnr2","kube-system/konnectivity-agent-t5crf","openshift-dns/node-resolver-7dwjx","openshift-network-operator/iptables-alerter-6k24s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"]
Jul 21 04:04:11.519546 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.519532    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.520927 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.520909    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b8j9r"
Jul 21 04:04:11.522245 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.522217    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 04:04:11.522873 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.522711    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8wnc9\""
Jul 21 04:04:11.522873 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.522765    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:04:11.523047 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.523030    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 04:04:11.523096 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.523059    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jnpwg\""
Jul 21 04:04:11.523248 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.523227    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 04:04:11.523361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.523300    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 04:04:11.523677 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.523659    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.525141 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.525112    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.525878 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.525861    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 04:04:11.525991 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.525948    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z7hbh\""
Jul 21 04:04:11.526060 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.526016    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 04:04:11.526149 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.526136    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:11.526215 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:11.526198    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:11.526464 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.526452    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 04:04:11.526515 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.526491    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 04:04:11.526601 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.526568    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 04:04:11.526982 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.526969    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-65rwg\""
Jul 21 04:04:11.527106 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.527094    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:11.527165 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:11.527149    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:11.528010 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.527997    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 04:04:11.528218 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.528203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.529250 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.529237    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:11.529316 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:11.529285    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:11.529953 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.529938    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 04:04:11.530025 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.530017    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal"
Jul 21 04:04:11.530674 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.530307    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t5crf"
Jul 21 04:04:11.531590 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.531576    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7dwjx"
Jul 21 04:04:11.532140 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.532024    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 04:04:11.532140 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.532066    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 04:04:11.532140 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.532108    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 04:04:11.532558 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.532540    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 04:04:11.532663 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.532603    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 04:04:11.532974 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.532959    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6k24s"
Jul 21 04:04:11.534229 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.534068    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 04:04:11.534229 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.534078    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 04:04:11.534591 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.534574    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 04:04:11.534693 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.534670    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kvlh7\""
Jul 21 04:04:11.534693 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.534682    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fhpm7\""
Jul 21 04:04:11.534805 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.534708    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.534805 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.534791    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 04:04:11.535125 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.535110    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 04:04:11.535200 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.535184    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:04:11.535257 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.535207    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dhwkm\""
Jul 21 04:04:11.535419 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.535404    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 04:04:11.535419 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.535413    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fqqqw\""
Jul 21 04:04:11.535518 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.535437    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 04:04:11.535837 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.535823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7064679-0f8e-4ec6-9f79-d057bf54717f-cni-binary-copy\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.535885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.535845    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-var-lib-cni-bin\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.535885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.535861    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62b33fd8-dca9-4044-af2f-c5b95fa52da7-ovnkube-config\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.535885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.535876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-slash\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.536020 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.535894    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-modprobe-d\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.536020 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.535931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-run\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.536020 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.535962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7400550c-210d-4e1b-ba64-51235944a675-os-release\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.536020 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.535988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx8m2\" (UniqueName: \"kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2\") pod \"network-check-target-dj45n\" (UID: \"d511a328-a4d5-4253-bb43-1fb8a6b22d84\") " pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:11.536020 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-run-openvswitch\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.536299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536053    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62b33fd8-dca9-4044-af2f-c5b95fa52da7-ovnkube-script-lib\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.536299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-tuned\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.536299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7400550c-210d-4e1b-ba64-51235944a675-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.536299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-var-lib-kubelet\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.536299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59ceecb0-f7c0-4130-b056-ffd1e11e2757-konnectivity-ca\") pod \"konnectivity-agent-t5crf\" (UID: \"59ceecb0-f7c0-4130-b056-ffd1e11e2757\") " pod="kube-system/konnectivity-agent-t5crf"
Jul 21 04:04:11.536299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536170    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44ddbc6a-4723-445d-a5b9-6882cb587ba1-hosts-file\") pod \"node-resolver-7dwjx\" (UID: \"44ddbc6a-4723-445d-a5b9-6882cb587ba1\") " pod="openshift-dns/node-resolver-7dwjx"
Jul 21 04:04:11.536299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-sysctl-d\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.536299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjmzx\" (UniqueName: \"kubernetes.io/projected/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-kube-api-access-bjmzx\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.536299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536243    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de4cd546-b39a-405f-a0d0-91a5d42434ba-host\") pod \"node-ca-b8j9r\" (UID: \"de4cd546-b39a-405f-a0d0-91a5d42434ba\") " pod="openshift-image-registry/node-ca-b8j9r"
Jul 21 04:04:11.536299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7400550c-210d-4e1b-ba64-51235944a675-system-cni-dir\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.536299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7400550c-210d-4e1b-ba64-51235944a675-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-multus-socket-dir-parent\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536336    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs\") pod \"network-metrics-daemon-l5vv7\" (UID: \"3ed75b9c-b7ed-4efd-94c5-c58c202e510b\") " pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7400550c-210d-4e1b-ba64-51235944a675-cnibin\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536379    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-system-cni-dir\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-run-multus-certs\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536427    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-kubelet-config\") pod \"global-pull-secret-syncer-ksnr2\" (UID: \"f6567b22-8a1e-4d92-a2ee-6eedb17d3679\") " pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/de4cd546-b39a-405f-a0d0-91a5d42434ba-serviceca\") pod \"node-ca-b8j9r\" (UID: \"de4cd546-b39a-405f-a0d0-91a5d42434ba\") " pod="openshift-image-registry/node-ca-b8j9r"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536475    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-run-k8s-cni-cncf-io\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536495    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-sysconfig\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-tmp\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536539    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-hostroot\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-systemd\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-etc-kubernetes\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536613    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-etc-openvswitch\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536653    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-log-socket\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536680    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-sysctl-conf\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.536818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536702    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bpnz\" (UniqueName: \"kubernetes.io/projected/7400550c-210d-4e1b-ba64-51235944a675-kube-api-access-2bpnz\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.537485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536730    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-run-netns\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.537485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536767    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-node-log\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.537485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536798    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk9dg\" (UniqueName: \"kubernetes.io/projected/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-kube-api-access-sk9dg\") pod \"network-metrics-daemon-l5vv7\" (UID: \"3ed75b9c-b7ed-4efd-94c5-c58c202e510b\") " pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:11.537485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536821    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59ceecb0-f7c0-4130-b056-ffd1e11e2757-agent-certs\") pod \"konnectivity-agent-t5crf\" (UID: \"59ceecb0-f7c0-4130-b056-ffd1e11e2757\") " pod="kube-system/konnectivity-agent-t5crf"
Jul 21 04:04:11.537485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536860    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-systemd-units\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.537485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-run-systemd\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.537485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.537485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536928    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62b33fd8-dca9-4044-af2f-c5b95fa52da7-env-overrides\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.537485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfsp2\" (UniqueName: \"kubernetes.io/projected/f7064679-0f8e-4ec6-9f79-d057bf54717f-kube-api-access-zfsp2\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.537485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwmrk\" (UniqueName: \"kubernetes.io/projected/44ddbc6a-4723-445d-a5b9-6882cb587ba1-kube-api-access-cwmrk\") pod \"node-resolver-7dwjx\" (UID: \"44ddbc6a-4723-445d-a5b9-6882cb587ba1\") " pod="openshift-dns/node-resolver-7dwjx"
Jul 21 04:04:11.537485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.536994    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzd6r\" (UniqueName: \"kubernetes.io/projected/de4cd546-b39a-405f-a0d0-91a5d42434ba-kube-api-access-jzd6r\") pod \"node-ca-b8j9r\" (UID: \"de4cd546-b39a-405f-a0d0-91a5d42434ba\") " pod="openshift-image-registry/node-ca-b8j9r"
Jul 21 04:04:11.537485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7400550c-210d-4e1b-ba64-51235944a675-cni-binary-copy\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.537485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7400550c-210d-4e1b-ba64-51235944a675-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.537485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-cni-bin\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.537485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-dbus\") pod \"global-pull-secret-syncer-ksnr2\" (UID: \"f6567b22-8a1e-4d92-a2ee-6eedb17d3679\") " pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:11.537485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537098    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-sys\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-var-lib-kubelet\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-var-lib-openvswitch\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret\") pod \"global-pull-secret-syncer-ksnr2\" (UID: \"f6567b22-8a1e-4d92-a2ee-6eedb17d3679\") " pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537186    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537188    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f7064679-0f8e-4ec6-9f79-d057bf54717f-multus-daemon-config\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537232    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-run-netns\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537252    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44ddbc6a-4723-445d-a5b9-6882cb587ba1-tmp-dir\") pod \"node-resolver-7dwjx\" (UID: \"44ddbc6a-4723-445d-a5b9-6882cb587ba1\") " pod="openshift-dns/node-resolver-7dwjx"
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-multus-cni-dir\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537278    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-os-release\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-run-ovn-kubernetes\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537322    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-cni-netd\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537339    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62b33fd8-dca9-4044-af2f-c5b95fa52da7-ovn-node-metrics-cert\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537351    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7cml\" (UniqueName: \"kubernetes.io/projected/62b33fd8-dca9-4044-af2f-c5b95fa52da7-kube-api-access-d7cml\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537367    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-var-lib-cni-multus\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537379    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-multus-conf-dir\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537402    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-run-ovn\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.538008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-kubelet\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.538467 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537446    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-kubernetes\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.538467 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-lib-modules\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.538467 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537500    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-host\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.538467 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.537529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-cnibin\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.538739 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.538725    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2fzw7\""
Jul 21 04:04:11.538806 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.538762    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 04:04:11.538806 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.538780    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 04:04:11.553109 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.553095    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 04:04:11.557860 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.557829    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 03:59:11 +0000 UTC" deadline="2028-02-18 07:17:47.570239465 +0000 UTC"
Jul 21 04:04:11.557947 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.557861    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13851h13m36.01238272s"
Jul 21 04:04:11.558059 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.557977    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 04:04:11.558975 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.558296    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-0.ec2.internal"
Jul 21 04:04:11.561250 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.561233    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal"]
Jul 21 04:04:11.577548 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.577529    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 04:04:11.578375 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.578360    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-0.ec2.internal"]
Jul 21 04:04:11.601339 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.601322    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zzl9x"
Jul 21 04:04:11.616947 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.616931    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zzl9x"
Jul 21 04:04:11.631461 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.631445    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 04:04:11.638221 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638206    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-sysconfig\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.638283 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638239    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-tmp\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.638283 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-hostroot\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.638283 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-device-dir\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.638416 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638304    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-systemd\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.638416 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638344    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-sysconfig\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.638416 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638374    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-systemd\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.638416 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638382    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-etc-kubernetes\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.638416 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638393    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-hostroot\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.638662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638423    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-etc-openvswitch\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.638662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-log-socket\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.638662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-sysctl-conf\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.638662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638468    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-etc-openvswitch\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.638662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638471    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-etc-kubernetes\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.638662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638494    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-log-socket\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.638662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638503    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bpnz\" (UniqueName: \"kubernetes.io/projected/7400550c-210d-4e1b-ba64-51235944a675-kube-api-access-2bpnz\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.638662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-run-netns\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.638662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-node-log\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.638662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-sysctl-conf\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.638662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638612    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-registration-dir\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.638662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638650    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-node-log\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.638662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638654    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-run-netns\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638634    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638681    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk9dg\" (UniqueName: \"kubernetes.io/projected/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-kube-api-access-sk9dg\") pod \"network-metrics-daemon-l5vv7\" (UID: \"3ed75b9c-b7ed-4efd-94c5-c58c202e510b\") " pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59ceecb0-f7c0-4130-b056-ffd1e11e2757-agent-certs\") pod \"konnectivity-agent-t5crf\" (UID: \"59ceecb0-f7c0-4130-b056-ffd1e11e2757\") " pod="kube-system/konnectivity-agent-t5crf"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-systemd-units\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-run-systemd\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638754    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638776    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-systemd-units\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638783    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-run-systemd\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638778    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62b33fd8-dca9-4044-af2f-c5b95fa52da7-env-overrides\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638815    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfsp2\" (UniqueName: \"kubernetes.io/projected/f7064679-0f8e-4ec6-9f79-d057bf54717f-kube-api-access-zfsp2\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638817    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwmrk\" (UniqueName: \"kubernetes.io/projected/44ddbc6a-4723-445d-a5b9-6882cb587ba1-kube-api-access-cwmrk\") pod \"node-resolver-7dwjx\" (UID: \"44ddbc6a-4723-445d-a5b9-6882cb587ba1\") " pod="openshift-dns/node-resolver-7dwjx"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638865    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzd6r\" (UniqueName: \"kubernetes.io/projected/de4cd546-b39a-405f-a0d0-91a5d42434ba-kube-api-access-jzd6r\") pod \"node-ca-b8j9r\" (UID: \"de4cd546-b39a-405f-a0d0-91a5d42434ba\") " pod="openshift-image-registry/node-ca-b8j9r"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7400550c-210d-4e1b-ba64-51235944a675-cni-binary-copy\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638910    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7400550c-210d-4e1b-ba64-51235944a675-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638935    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-cni-bin\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.639204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-dbus\") pod \"global-pull-secret-syncer-ksnr2\" (UID: \"f6567b22-8a1e-4d92-a2ee-6eedb17d3679\") " pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.638982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-sys\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-var-lib-kubelet\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639019    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-cni-bin\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639026    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-var-lib-openvswitch\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639063    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-var-lib-openvswitch\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639069    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret\") pod \"global-pull-secret-syncer-ksnr2\" (UID: \"f6567b22-8a1e-4d92-a2ee-6eedb17d3679\") " pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639093    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-sys\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639110    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7400550c-210d-4e1b-ba64-51235944a675-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639119    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-var-lib-kubelet\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639153    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bskdt\" (UniqueName: \"kubernetes.io/projected/53310a05-992d-43d3-8e03-590c7ca9c140-kube-api-access-bskdt\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:11.639164    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639182    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f7064679-0f8e-4ec6-9f79-d057bf54717f-multus-daemon-config\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639185    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-dbus\") pod \"global-pull-secret-syncer-ksnr2\" (UID: \"f6567b22-8a1e-4d92-a2ee-6eedb17d3679\") " pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-run-netns\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:11.639219    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret podName:f6567b22-8a1e-4d92-a2ee-6eedb17d3679 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:12.139201125 +0000 UTC m=+1.956767901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret") pod "global-pull-secret-syncer-ksnr2" (UID: "f6567b22-8a1e-4d92-a2ee-6eedb17d3679") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-run-netns\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.640068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639247    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44ddbc6a-4723-445d-a5b9-6882cb587ba1-tmp-dir\") pod \"node-resolver-7dwjx\" (UID: \"44ddbc6a-4723-445d-a5b9-6882cb587ba1\") " pod="openshift-dns/node-resolver-7dwjx"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62b33fd8-dca9-4044-af2f-c5b95fa52da7-env-overrides\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-multus-cni-dir\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639281    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-os-release\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639301    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-run-ovn-kubernetes\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-cni-netd\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62b33fd8-dca9-4044-af2f-c5b95fa52da7-ovn-node-metrics-cert\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-socket-dir\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-etc-selinux\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7cml\" (UniqueName: \"kubernetes.io/projected/62b33fd8-dca9-4044-af2f-c5b95fa52da7-kube-api-access-d7cml\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639417    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-cni-netd\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-sys-fs\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-os-release\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-var-lib-cni-multus\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639429    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-multus-cni-dir\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639602    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44ddbc6a-4723-445d-a5b9-6882cb587ba1-tmp-dir\") pod \"node-resolver-7dwjx\" (UID: \"44ddbc6a-4723-445d-a5b9-6882cb587ba1\") " pod="openshift-dns/node-resolver-7dwjx"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-multus-conf-dir\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.640885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-run-ovn\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639682    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-run-ovn-kubernetes\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639686    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-kubelet\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639721    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-kubelet\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639783    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-kubernetes\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639806    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-var-lib-cni-multus\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639809    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-lib-modules\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639825    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-kubernetes\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639821    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f7064679-0f8e-4ec6-9f79-d057bf54717f-multus-daemon-config\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-host\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639867    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-run-ovn\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639893    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-multus-conf-dir\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639897    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-lib-modules\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639933    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-cnibin\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639942    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-host\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.639963    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7064679-0f8e-4ec6-9f79-d057bf54717f-cni-binary-copy\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-var-lib-cni-bin\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640098    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7400550c-210d-4e1b-ba64-51235944a675-cni-binary-copy\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.641628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62b33fd8-dca9-4044-af2f-c5b95fa52da7-ovnkube-config\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640160    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-cnibin\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640148    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-var-lib-cni-bin\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-slash\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-modprobe-d\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-run\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7400550c-210d-4e1b-ba64-51235944a675-os-release\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640329    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-host-slash\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640340    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx8m2\" (UniqueName: \"kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2\") pod \"network-check-target-dj45n\" (UID: \"d511a328-a4d5-4253-bb43-1fb8a6b22d84\") " pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640313    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-run\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640369    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7400550c-210d-4e1b-ba64-51235944a675-os-release\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-run-openvswitch\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62b33fd8-dca9-4044-af2f-c5b95fa52da7-ovnkube-script-lib\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640441    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-modprobe-d\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640437    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/07851962-81af-4d0c-b3aa-4a526587297b-iptables-alerter-script\") pod \"iptables-alerter-6k24s\" (UID: \"07851962-81af-4d0c-b3aa-4a526587297b\") " pod="openshift-network-operator/iptables-alerter-6k24s"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640474    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-tuned\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640554    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7064679-0f8e-4ec6-9f79-d057bf54717f-cni-binary-copy\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.642420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7400550c-210d-4e1b-ba64-51235944a675-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640657    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-var-lib-kubelet\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640661    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62b33fd8-dca9-4044-af2f-c5b95fa52da7-ovnkube-config\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640671    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62b33fd8-dca9-4044-af2f-c5b95fa52da7-run-openvswitch\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640793    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59ceecb0-f7c0-4130-b056-ffd1e11e2757-konnectivity-ca\") pod \"konnectivity-agent-t5crf\" (UID: \"59ceecb0-f7c0-4130-b056-ffd1e11e2757\") " pod="kube-system/konnectivity-agent-t5crf"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640822    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44ddbc6a-4723-445d-a5b9-6882cb587ba1-hosts-file\") pod \"node-resolver-7dwjx\" (UID: \"44ddbc6a-4723-445d-a5b9-6882cb587ba1\") " pod="openshift-dns/node-resolver-7dwjx"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640874    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-sysctl-d\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640900    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjmzx\" (UniqueName: \"kubernetes.io/projected/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-kube-api-access-bjmzx\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640928    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44ddbc6a-4723-445d-a5b9-6882cb587ba1-hosts-file\") pod \"node-resolver-7dwjx\" (UID: \"44ddbc6a-4723-445d-a5b9-6882cb587ba1\") " pod="openshift-dns/node-resolver-7dwjx"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640942    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de4cd546-b39a-405f-a0d0-91a5d42434ba-host\") pod \"node-ca-b8j9r\" (UID: \"de4cd546-b39a-405f-a0d0-91a5d42434ba\") " pod="openshift-image-registry/node-ca-b8j9r"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.640980    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62b33fd8-dca9-4044-af2f-c5b95fa52da7-ovnkube-script-lib\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641000    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-var-lib-kubelet\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641030    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de4cd546-b39a-405f-a0d0-91a5d42434ba-host\") pod \"node-ca-b8j9r\" (UID: \"de4cd546-b39a-405f-a0d0-91a5d42434ba\") " pod="openshift-image-registry/node-ca-b8j9r"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641033    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7400550c-210d-4e1b-ba64-51235944a675-system-cni-dir\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641062    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7400550c-210d-4e1b-ba64-51235944a675-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-multus-socket-dir-parent\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.642919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641153    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs\") pod \"network-metrics-daemon-l5vv7\" (UID: \"3ed75b9c-b7ed-4efd-94c5-c58c202e510b\") " pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7400550c-210d-4e1b-ba64-51235944a675-cnibin\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641206    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-system-cni-dir\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:11.641286    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641310    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-sysctl-d\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:11.641341    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs podName:3ed75b9c-b7ed-4efd-94c5-c58c202e510b nodeName:}" failed. No retries permitted until 2026-07-21 04:04:12.141325855 +0000 UTC m=+1.958892619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs") pod "network-metrics-daemon-l5vv7" (UID: "3ed75b9c-b7ed-4efd-94c5-c58c202e510b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-run-multus-certs\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641367    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-multus-socket-dir-parent\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-kubelet-config\") pod \"global-pull-secret-syncer-ksnr2\" (UID: \"f6567b22-8a1e-4d92-a2ee-6eedb17d3679\") " pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641597    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59ceecb0-f7c0-4130-b056-ffd1e11e2757-konnectivity-ca\") pod \"konnectivity-agent-t5crf\" (UID: \"59ceecb0-f7c0-4130-b056-ffd1e11e2757\") " pod="kube-system/konnectivity-agent-t5crf"
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641692    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07851962-81af-4d0c-b3aa-4a526587297b-host-slash\") pod \"iptables-alerter-6k24s\" (UID: \"07851962-81af-4d0c-b3aa-4a526587297b\") " pod="openshift-network-operator/iptables-alerter-6k24s"
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641701    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-system-cni-dir\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641740    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-run-multus-certs\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbhn2\" (UniqueName: \"kubernetes.io/projected/07851962-81af-4d0c-b3aa-4a526587297b-kube-api-access-zbhn2\") pod \"iptables-alerter-6k24s\" (UID: \"07851962-81af-4d0c-b3aa-4a526587297b\") " pod="openshift-network-operator/iptables-alerter-6k24s"
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641783    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/de4cd546-b39a-405f-a0d0-91a5d42434ba-serviceca\") pod \"node-ca-b8j9r\" (UID: \"de4cd546-b39a-405f-a0d0-91a5d42434ba\") " pod="openshift-image-registry/node-ca-b8j9r"
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641774    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7400550c-210d-4e1b-ba64-51235944a675-system-cni-dir\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641847    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7400550c-210d-4e1b-ba64-51235944a675-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.643361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641860    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-run-k8s-cni-cncf-io\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.643848 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641877    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7400550c-210d-4e1b-ba64-51235944a675-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.643848 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.641967    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f7064679-0f8e-4ec6-9f79-d057bf54717f-host-run-k8s-cni-cncf-io\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.643848 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.642101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7400550c-210d-4e1b-ba64-51235944a675-cnibin\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.643848 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.642103    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-kubelet-config\") pod \"global-pull-secret-syncer-ksnr2\" (UID: \"f6567b22-8a1e-4d92-a2ee-6eedb17d3679\") " pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:11.643848 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.642289    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62b33fd8-dca9-4044-af2f-c5b95fa52da7-ovn-node-metrics-cert\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.643848 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.642301    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-tmp\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.643848 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.642732    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59ceecb0-f7c0-4130-b056-ffd1e11e2757-agent-certs\") pod \"konnectivity-agent-t5crf\" (UID: \"59ceecb0-f7c0-4130-b056-ffd1e11e2757\") " pod="kube-system/konnectivity-agent-t5crf"
Jul 21 04:04:11.643848 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.642824    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/de4cd546-b39a-405f-a0d0-91a5d42434ba-serviceca\") pod \"node-ca-b8j9r\" (UID: \"de4cd546-b39a-405f-a0d0-91a5d42434ba\") " pod="openshift-image-registry/node-ca-b8j9r"
Jul 21 04:04:11.643848 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.643490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-etc-tuned\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.653599 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:11.653152    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:11.653599 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:11.653172    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:11.653599 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:11.653184    2576 projected.go:196] Error preparing data for projected volume kube-api-access-cx8m2 for pod openshift-network-diagnostics/network-check-target-dj45n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:11.653599 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:11.653230    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2 podName:d511a328-a4d5-4253-bb43-1fb8a6b22d84 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:12.153216782 +0000 UTC m=+1.970783545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cx8m2" (UniqueName: "kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2") pod "network-check-target-dj45n" (UID: "d511a328-a4d5-4253-bb43-1fb8a6b22d84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:11.653599 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.653539    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfsp2\" (UniqueName: \"kubernetes.io/projected/f7064679-0f8e-4ec6-9f79-d057bf54717f-kube-api-access-zfsp2\") pod \"multus-x6d78\" (UID: \"f7064679-0f8e-4ec6-9f79-d057bf54717f\") " pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.654915 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.654891    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzd6r\" (UniqueName: \"kubernetes.io/projected/de4cd546-b39a-405f-a0d0-91a5d42434ba-kube-api-access-jzd6r\") pod \"node-ca-b8j9r\" (UID: \"de4cd546-b39a-405f-a0d0-91a5d42434ba\") " pod="openshift-image-registry/node-ca-b8j9r"
Jul 21 04:04:11.655012 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.654920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bpnz\" (UniqueName: \"kubernetes.io/projected/7400550c-210d-4e1b-ba64-51235944a675-kube-api-access-2bpnz\") pod \"multus-additional-cni-plugins-hbcl2\" (UID: \"7400550c-210d-4e1b-ba64-51235944a675\") " pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.655368 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.655347    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwmrk\" (UniqueName: \"kubernetes.io/projected/44ddbc6a-4723-445d-a5b9-6882cb587ba1-kube-api-access-cwmrk\") pod \"node-resolver-7dwjx\" (UID: \"44ddbc6a-4723-445d-a5b9-6882cb587ba1\") " pod="openshift-dns/node-resolver-7dwjx"
Jul 21 04:04:11.655439 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.655366    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7cml\" (UniqueName: \"kubernetes.io/projected/62b33fd8-dca9-4044-af2f-c5b95fa52da7-kube-api-access-d7cml\") pod \"ovnkube-node-whzmq\" (UID: \"62b33fd8-dca9-4044-af2f-c5b95fa52da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.656002 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.655986    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk9dg\" (UniqueName: \"kubernetes.io/projected/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-kube-api-access-sk9dg\") pod \"network-metrics-daemon-l5vv7\" (UID: \"3ed75b9c-b7ed-4efd-94c5-c58c202e510b\") " pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:11.656095 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.656071    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjmzx\" (UniqueName: \"kubernetes.io/projected/dae5f236-b3b9-4ef6-bd6e-aeff788c92df-kube-api-access-bjmzx\") pod \"tuned-jqwz8\" (UID: \"dae5f236-b3b9-4ef6-bd6e-aeff788c92df\") " pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.742246 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/07851962-81af-4d0c-b3aa-4a526587297b-iptables-alerter-script\") pod \"iptables-alerter-6k24s\" (UID: \"07851962-81af-4d0c-b3aa-4a526587297b\") " pod="openshift-network-operator/iptables-alerter-6k24s"
Jul 21 04:04:11.742392 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.742392 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742339    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.742483 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742388    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07851962-81af-4d0c-b3aa-4a526587297b-host-slash\") pod \"iptables-alerter-6k24s\" (UID: \"07851962-81af-4d0c-b3aa-4a526587297b\") " pod="openshift-network-operator/iptables-alerter-6k24s"
Jul 21 04:04:11.742483 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbhn2\" (UniqueName: \"kubernetes.io/projected/07851962-81af-4d0c-b3aa-4a526587297b-kube-api-access-zbhn2\") pod \"iptables-alerter-6k24s\" (UID: \"07851962-81af-4d0c-b3aa-4a526587297b\") " pod="openshift-network-operator/iptables-alerter-6k24s"
Jul 21 04:04:11.742483 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-device-dir\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.742617 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742487    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-device-dir\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.742617 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742495    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07851962-81af-4d0c-b3aa-4a526587297b-host-slash\") pod \"iptables-alerter-6k24s\" (UID: \"07851962-81af-4d0c-b3aa-4a526587297b\") " pod="openshift-network-operator/iptables-alerter-6k24s"
Jul 21 04:04:11.742617 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-registration-dir\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.742617 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742564    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-registration-dir\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.742617 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742603    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bskdt\" (UniqueName: \"kubernetes.io/projected/53310a05-992d-43d3-8e03-590c7ca9c140-kube-api-access-bskdt\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.742930 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742657    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-socket-dir\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.742930 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742690    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-etc-selinux\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.742930 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-sys-fs\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.742930 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742767    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-socket-dir\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.742930 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742780    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/07851962-81af-4d0c-b3aa-4a526587297b-iptables-alerter-script\") pod \"iptables-alerter-6k24s\" (UID: \"07851962-81af-4d0c-b3aa-4a526587297b\") " pod="openshift-network-operator/iptables-alerter-6k24s"
Jul 21 04:04:11.742930 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-etc-selinux\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.742930 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.742847    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53310a05-992d-43d3-8e03-590c7ca9c140-sys-fs\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.750280 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.750256    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bskdt\" (UniqueName: \"kubernetes.io/projected/53310a05-992d-43d3-8e03-590c7ca9c140-kube-api-access-bskdt\") pod \"aws-ebs-csi-driver-node-ljg9h\" (UID: \"53310a05-992d-43d3-8e03-590c7ca9c140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.750623 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.750601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbhn2\" (UniqueName: \"kubernetes.io/projected/07851962-81af-4d0c-b3aa-4a526587297b-kube-api-access-zbhn2\") pod \"iptables-alerter-6k24s\" (UID: \"07851962-81af-4d0c-b3aa-4a526587297b\") " pod="openshift-network-operator/iptables-alerter-6k24s"
Jul 21 04:04:11.779524 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:11.779498    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a6a41a7a65b6e98b711844aad515ac.slice/crio-128e70d5b408f1f9acb9fd3b2c769a7fae555ae088ae25a4a80ab4660c5011d0 WatchSource:0}: Error finding container 128e70d5b408f1f9acb9fd3b2c769a7fae555ae088ae25a4a80ab4660c5011d0: Status 404 returned error can't find the container with id 128e70d5b408f1f9acb9fd3b2c769a7fae555ae088ae25a4a80ab4660c5011d0
Jul 21 04:04:11.779917 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:11.779895    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d034690d2db0b8212daaa6bd5c8a40.slice/crio-60a771a7db6b03e82145a455e8127d162ef4dc759e6f0539ba61a62cca7bfb3b WatchSource:0}: Error finding container 60a771a7db6b03e82145a455e8127d162ef4dc759e6f0539ba61a62cca7bfb3b: Status 404 returned error can't find the container with id 60a771a7db6b03e82145a455e8127d162ef4dc759e6f0539ba61a62cca7bfb3b
Jul 21 04:04:11.784192 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.784180    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:04:11.844405 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.844360    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jqwz8"
Jul 21 04:04:11.852503 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:11.852481    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae5f236_b3b9_4ef6_bd6e_aeff788c92df.slice/crio-1bd000b49049409b5dab60ba43a4b8a0e86ff0bca82172311588c208d660db67 WatchSource:0}: Error finding container 1bd000b49049409b5dab60ba43a4b8a0e86ff0bca82172311588c208d660db67: Status 404 returned error can't find the container with id 1bd000b49049409b5dab60ba43a4b8a0e86ff0bca82172311588c208d660db67
Jul 21 04:04:11.863435 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.863422    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b8j9r"
Jul 21 04:04:11.870827 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:11.870812    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4cd546_b39a_405f_a0d0_91a5d42434ba.slice/crio-b9c687f1416b3ef15e13967af71b559033924dd318880f92d83be5296b50824d WatchSource:0}: Error finding container b9c687f1416b3ef15e13967af71b559033924dd318880f92d83be5296b50824d: Status 404 returned error can't find the container with id b9c687f1416b3ef15e13967af71b559033924dd318880f92d83be5296b50824d
Jul 21 04:04:11.881828 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.881809    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hbcl2"
Jul 21 04:04:11.896538 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.896523    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x6d78"
Jul 21 04:04:11.903883 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:11.903862    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7064679_0f8e_4ec6_9f79_d057bf54717f.slice/crio-735d2a2e09a5dfd2fcf31a35871835cf139fe2c869fabdcff5aa1a1620c10e74 WatchSource:0}: Error finding container 735d2a2e09a5dfd2fcf31a35871835cf139fe2c869fabdcff5aa1a1620c10e74: Status 404 returned error can't find the container with id 735d2a2e09a5dfd2fcf31a35871835cf139fe2c869fabdcff5aa1a1620c10e74
Jul 21 04:04:11.913930 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.913915    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:11.920858 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:11.920837    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b33fd8_dca9_4044_af2f_c5b95fa52da7.slice/crio-326a48c4c982f23d0301b3a08b21a4779e0c0e73c7109f766e73112f555fd0a0 WatchSource:0}: Error finding container 326a48c4c982f23d0301b3a08b21a4779e0c0e73c7109f766e73112f555fd0a0: Status 404 returned error can't find the container with id 326a48c4c982f23d0301b3a08b21a4779e0c0e73c7109f766e73112f555fd0a0
Jul 21 04:04:11.934425 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.934408    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t5crf"
Jul 21 04:04:11.942158 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:11.942138    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ceecb0_f7c0_4130_b056_ffd1e11e2757.slice/crio-7760ba8d4b76d0ec9d763496c2c9baf6b0397944fc0ecc2c9ce122263d748287 WatchSource:0}: Error finding container 7760ba8d4b76d0ec9d763496c2c9baf6b0397944fc0ecc2c9ce122263d748287: Status 404 returned error can't find the container with id 7760ba8d4b76d0ec9d763496c2c9baf6b0397944fc0ecc2c9ce122263d748287
Jul 21 04:04:11.946475 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.946458    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:11.954917 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.954895    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7dwjx"
Jul 21 04:04:11.962296 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:11.962280    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ddbc6a_4723_445d_a5b9_6882cb587ba1.slice/crio-80035155c1eda046687087053cddbe847e53e15469463a99542f19b47f755ad8 WatchSource:0}: Error finding container 80035155c1eda046687087053cddbe847e53e15469463a99542f19b47f755ad8: Status 404 returned error can't find the container with id 80035155c1eda046687087053cddbe847e53e15469463a99542f19b47f755ad8
Jul 21 04:04:11.978399 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.978379    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6k24s"
Jul 21 04:04:11.985794 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:11.985776    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h"
Jul 21 04:04:11.986153 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:11.986137    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07851962_81af_4d0c_b3aa_4a526587297b.slice/crio-a4895f279f6ea262c14f55e405fc1f54a76ed4abbc437e4a28553d7bbf182d3d WatchSource:0}: Error finding container a4895f279f6ea262c14f55e405fc1f54a76ed4abbc437e4a28553d7bbf182d3d: Status 404 returned error can't find the container with id a4895f279f6ea262c14f55e405fc1f54a76ed4abbc437e4a28553d7bbf182d3d
Jul 21 04:04:11.993228 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:11.993210    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53310a05_992d_43d3_8e03_590c7ca9c140.slice/crio-0205b4abf7a72e17505137007ff00935ddd5c68e601aa061d357442cebec9cb2 WatchSource:0}: Error finding container 0205b4abf7a72e17505137007ff00935ddd5c68e601aa061d357442cebec9cb2: Status 404 returned error can't find the container with id 0205b4abf7a72e17505137007ff00935ddd5c68e601aa061d357442cebec9cb2
Jul 21 04:04:12.020255 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.020237    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:12.145750 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.145683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret\") pod \"global-pull-secret-syncer-ksnr2\" (UID: \"f6567b22-8a1e-4d92-a2ee-6eedb17d3679\") " pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:12.145862 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.145731    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs\") pod \"network-metrics-daemon-l5vv7\" (UID: \"3ed75b9c-b7ed-4efd-94c5-c58c202e510b\") " pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:12.145862 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:12.145824    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:12.145862 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:12.145832    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:12.145954 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:12.145873    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs podName:3ed75b9c-b7ed-4efd-94c5-c58c202e510b nodeName:}" failed. No retries permitted until 2026-07-21 04:04:13.145860651 +0000 UTC m=+2.963427413 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs") pod "network-metrics-daemon-l5vv7" (UID: "3ed75b9c-b7ed-4efd-94c5-c58c202e510b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:12.145954 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:12.145884    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret podName:f6567b22-8a1e-4d92-a2ee-6eedb17d3679 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:13.145878847 +0000 UTC m=+2.963445609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret") pod "global-pull-secret-syncer-ksnr2" (UID: "f6567b22-8a1e-4d92-a2ee-6eedb17d3679") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:12.246874 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.246849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx8m2\" (UniqueName: \"kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2\") pod \"network-check-target-dj45n\" (UID: \"d511a328-a4d5-4253-bb43-1fb8a6b22d84\") " pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:12.247031 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:12.246991    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:12.247031 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:12.247009    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:12.247031 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:12.247018    2576 projected.go:196] Error preparing data for projected volume kube-api-access-cx8m2 for pod openshift-network-diagnostics/network-check-target-dj45n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:12.247126 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:12.247059    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2 podName:d511a328-a4d5-4253-bb43-1fb8a6b22d84 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:13.247047217 +0000 UTC m=+3.064613978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cx8m2" (UniqueName: "kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2") pod "network-check-target-dj45n" (UID: "d511a328-a4d5-4253-bb43-1fb8a6b22d84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:12.619124 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.619044    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 03:59:12 +0000 UTC" deadline="2028-04-17 01:26:54.753177166 +0000 UTC"
Jul 21 04:04:12.619124 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.619120    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15261h22m42.134061724s"
Jul 21 04:04:12.660138 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.660110    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:12.660301 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:12.660243    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:12.664520 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.664279    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h" event={"ID":"53310a05-992d-43d3-8e03-590c7ca9c140","Type":"ContainerStarted","Data":"0205b4abf7a72e17505137007ff00935ddd5c68e601aa061d357442cebec9cb2"}
Jul 21 04:04:12.671637 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.671612    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6k24s" event={"ID":"07851962-81af-4d0c-b3aa-4a526587297b","Type":"ContainerStarted","Data":"a4895f279f6ea262c14f55e405fc1f54a76ed4abbc437e4a28553d7bbf182d3d"}
Jul 21 04:04:12.674338 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.674296    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7dwjx" event={"ID":"44ddbc6a-4723-445d-a5b9-6882cb587ba1","Type":"ContainerStarted","Data":"80035155c1eda046687087053cddbe847e53e15469463a99542f19b47f755ad8"}
Jul 21 04:04:12.684960 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.684931    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x6d78" event={"ID":"f7064679-0f8e-4ec6-9f79-d057bf54717f","Type":"ContainerStarted","Data":"735d2a2e09a5dfd2fcf31a35871835cf139fe2c869fabdcff5aa1a1620c10e74"}
Jul 21 04:04:12.696599 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.696574    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbcl2" event={"ID":"7400550c-210d-4e1b-ba64-51235944a675","Type":"ContainerStarted","Data":"6479c73522025ce716553b20c9da5b0e0792d82a2ab51f468190953182b2466e"}
Jul 21 04:04:12.705830 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.705783    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b8j9r" event={"ID":"de4cd546-b39a-405f-a0d0-91a5d42434ba","Type":"ContainerStarted","Data":"b9c687f1416b3ef15e13967af71b559033924dd318880f92d83be5296b50824d"}
Jul 21 04:04:12.742741 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.729476    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal" event={"ID":"35d034690d2db0b8212daaa6bd5c8a40","Type":"ContainerStarted","Data":"60a771a7db6b03e82145a455e8127d162ef4dc759e6f0539ba61a62cca7bfb3b"}
Jul 21 04:04:12.742741 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.735155    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t5crf" event={"ID":"59ceecb0-f7c0-4130-b056-ffd1e11e2757","Type":"ContainerStarted","Data":"7760ba8d4b76d0ec9d763496c2c9baf6b0397944fc0ecc2c9ce122263d748287"}
Jul 21 04:04:12.742741 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.738161    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq" event={"ID":"62b33fd8-dca9-4044-af2f-c5b95fa52da7","Type":"ContainerStarted","Data":"326a48c4c982f23d0301b3a08b21a4779e0c0e73c7109f766e73112f555fd0a0"}
Jul 21 04:04:12.753238 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.753212    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jqwz8" event={"ID":"dae5f236-b3b9-4ef6-bd6e-aeff788c92df","Type":"ContainerStarted","Data":"1bd000b49049409b5dab60ba43a4b8a0e86ff0bca82172311588c208d660db67"}
Jul 21 04:04:12.756557 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:12.756526    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-0.ec2.internal" event={"ID":"20a6a41a7a65b6e98b711844aad515ac","Type":"ContainerStarted","Data":"128e70d5b408f1f9acb9fd3b2c769a7fae555ae088ae25a4a80ab4660c5011d0"}
Jul 21 04:04:13.036185 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:13.036154    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:13.154694 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:13.154638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret\") pod \"global-pull-secret-syncer-ksnr2\" (UID: \"f6567b22-8a1e-4d92-a2ee-6eedb17d3679\") " pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:13.154879 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:13.154742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs\") pod \"network-metrics-daemon-l5vv7\" (UID: \"3ed75b9c-b7ed-4efd-94c5-c58c202e510b\") " pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:13.154960 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:13.154893    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:13.155017 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:13.154957    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs podName:3ed75b9c-b7ed-4efd-94c5-c58c202e510b nodeName:}" failed. No retries permitted until 2026-07-21 04:04:15.154937301 +0000 UTC m=+4.972504076 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs") pod "network-metrics-daemon-l5vv7" (UID: "3ed75b9c-b7ed-4efd-94c5-c58c202e510b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:13.155441 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:13.155401    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:13.155563 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:13.155474    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret podName:f6567b22-8a1e-4d92-a2ee-6eedb17d3679 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:15.155457812 +0000 UTC m=+4.973024592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret") pod "global-pull-secret-syncer-ksnr2" (UID: "f6567b22-8a1e-4d92-a2ee-6eedb17d3679") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:13.255393 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:13.255350    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx8m2\" (UniqueName: \"kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2\") pod \"network-check-target-dj45n\" (UID: \"d511a328-a4d5-4253-bb43-1fb8a6b22d84\") " pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:13.255603 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:13.255586    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:13.255670 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:13.255615    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:13.255670 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:13.255628    2576 projected.go:196] Error preparing data for projected volume kube-api-access-cx8m2 for pod openshift-network-diagnostics/network-check-target-dj45n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:13.255811 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:13.255707    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2 podName:d511a328-a4d5-4253-bb43-1fb8a6b22d84 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:15.255668653 +0000 UTC m=+5.073235421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cx8m2" (UniqueName: "kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2") pod "network-check-target-dj45n" (UID: "d511a328-a4d5-4253-bb43-1fb8a6b22d84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:13.619589 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:13.619535    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 03:59:12 +0000 UTC" deadline="2028-03-23 05:00:16.585800295 +0000 UTC"
Jul 21 04:04:13.619589 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:13.619587    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14664h56m2.966218487s"
Jul 21 04:04:13.659737 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:13.659701    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:13.659897 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:13.659856    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:13.660307 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:13.660285    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:13.660499 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:13.660475    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:14.663746 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:14.661070    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:14.663746 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:14.661196    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:15.171140 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:15.171099    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs\") pod \"network-metrics-daemon-l5vv7\" (UID: \"3ed75b9c-b7ed-4efd-94c5-c58c202e510b\") " pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:15.171338 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:15.171180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret\") pod \"global-pull-secret-syncer-ksnr2\" (UID: \"f6567b22-8a1e-4d92-a2ee-6eedb17d3679\") " pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:15.171338 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:15.171311    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:15.171450 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:15.171372    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret podName:f6567b22-8a1e-4d92-a2ee-6eedb17d3679 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:19.171352768 +0000 UTC m=+8.988919531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret") pod "global-pull-secret-syncer-ksnr2" (UID: "f6567b22-8a1e-4d92-a2ee-6eedb17d3679") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:15.171450 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:15.171443    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:15.171569 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:15.171485    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs podName:3ed75b9c-b7ed-4efd-94c5-c58c202e510b nodeName:}" failed. No retries permitted until 2026-07-21 04:04:19.171471169 +0000 UTC m=+8.989037949 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs") pod "network-metrics-daemon-l5vv7" (UID: "3ed75b9c-b7ed-4efd-94c5-c58c202e510b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:15.272636 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:15.271887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx8m2\" (UniqueName: \"kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2\") pod \"network-check-target-dj45n\" (UID: \"d511a328-a4d5-4253-bb43-1fb8a6b22d84\") " pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:15.272636 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:15.272098    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:15.272636 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:15.272118    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:15.272636 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:15.272132    2576 projected.go:196] Error preparing data for projected volume kube-api-access-cx8m2 for pod openshift-network-diagnostics/network-check-target-dj45n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:15.272636 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:15.272189    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2 podName:d511a328-a4d5-4253-bb43-1fb8a6b22d84 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:19.272169769 +0000 UTC m=+9.089736539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cx8m2" (UniqueName: "kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2") pod "network-check-target-dj45n" (UID: "d511a328-a4d5-4253-bb43-1fb8a6b22d84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:15.659201 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:15.659166    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:15.659390 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:15.659322    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:15.659768 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:15.659745    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:15.659877 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:15.659854    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:16.659420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:16.659386    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:16.659931 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:16.659521    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:17.658921 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:17.658887    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:17.659118 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:17.659026    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:17.659187 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:17.659114    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:17.659187 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:17.659024    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:18.659898 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:18.659854    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:18.660360 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:18.659995    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:19.207435 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:19.207072    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs\") pod \"network-metrics-daemon-l5vv7\" (UID: \"3ed75b9c-b7ed-4efd-94c5-c58c202e510b\") " pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:19.207435 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:19.207171    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret\") pod \"global-pull-secret-syncer-ksnr2\" (UID: \"f6567b22-8a1e-4d92-a2ee-6eedb17d3679\") " pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:19.207435 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:19.207248    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:19.207435 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:19.207315    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:19.207435 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:19.207320    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs podName:3ed75b9c-b7ed-4efd-94c5-c58c202e510b nodeName:}" failed. No retries permitted until 2026-07-21 04:04:27.207300619 +0000 UTC m=+17.024867387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs") pod "network-metrics-daemon-l5vv7" (UID: "3ed75b9c-b7ed-4efd-94c5-c58c202e510b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:19.207435 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:19.207408    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret podName:f6567b22-8a1e-4d92-a2ee-6eedb17d3679 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:27.207364992 +0000 UTC m=+17.024931769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret") pod "global-pull-secret-syncer-ksnr2" (UID: "f6567b22-8a1e-4d92-a2ee-6eedb17d3679") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:19.308108 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:19.308071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx8m2\" (UniqueName: \"kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2\") pod \"network-check-target-dj45n\" (UID: \"d511a328-a4d5-4253-bb43-1fb8a6b22d84\") " pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:19.308301 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:19.308263    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:19.308301 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:19.308284    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:19.308405 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:19.308321    2576 projected.go:196] Error preparing data for projected volume kube-api-access-cx8m2 for pod openshift-network-diagnostics/network-check-target-dj45n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:19.308405 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:19.308370    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2 podName:d511a328-a4d5-4253-bb43-1fb8a6b22d84 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:27.308356618 +0000 UTC m=+17.125923381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cx8m2" (UniqueName: "kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2") pod "network-check-target-dj45n" (UID: "d511a328-a4d5-4253-bb43-1fb8a6b22d84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:19.658780 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:19.658526    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:19.658969 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:19.658886    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:19.659260 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:19.659239    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:19.659357 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:19.659335    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:20.659819 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:20.659792    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:20.660259 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:20.659881    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:21.659205 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:21.659174    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:21.659347 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:21.659310    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:21.659426 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:21.659370    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:21.659481 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:21.659441    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:22.660338 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:22.660308    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:22.660958 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:22.660418    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:23.659319 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:23.659287    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:23.659497 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:23.659336    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:23.659497 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:23.659425    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:23.659919 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:23.659869    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:24.658325 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:24.658294    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:24.658736 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:24.658410    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:25.658693 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:25.658662    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:25.658693 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:25.658694    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:25.659111 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:25.658780    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:25.659111 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:25.658875    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:26.658345 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:26.658323    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:26.658523 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:26.658432    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:27.271031 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:27.270996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs\") pod \"network-metrics-daemon-l5vv7\" (UID: \"3ed75b9c-b7ed-4efd-94c5-c58c202e510b\") " pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:27.271528 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:27.271053    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret\") pod \"global-pull-secret-syncer-ksnr2\" (UID: \"f6567b22-8a1e-4d92-a2ee-6eedb17d3679\") " pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:27.271528 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:27.271156    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:27.271528 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:27.271160    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:27.271528 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:27.271214    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret podName:f6567b22-8a1e-4d92-a2ee-6eedb17d3679 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:43.271195376 +0000 UTC m=+33.088762141 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret") pod "global-pull-secret-syncer-ksnr2" (UID: "f6567b22-8a1e-4d92-a2ee-6eedb17d3679") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:27.271528 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:27.271233    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs podName:3ed75b9c-b7ed-4efd-94c5-c58c202e510b nodeName:}" failed. No retries permitted until 2026-07-21 04:04:43.271223872 +0000 UTC m=+33.088790633 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs") pod "network-metrics-daemon-l5vv7" (UID: "3ed75b9c-b7ed-4efd-94c5-c58c202e510b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:27.372352 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:27.372324    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx8m2\" (UniqueName: \"kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2\") pod \"network-check-target-dj45n\" (UID: \"d511a328-a4d5-4253-bb43-1fb8a6b22d84\") " pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:27.372496 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:27.372443    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:27.372496 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:27.372468    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:27.372496 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:27.372478    2576 projected.go:196] Error preparing data for projected volume kube-api-access-cx8m2 for pod openshift-network-diagnostics/network-check-target-dj45n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:27.372627 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:27.372523    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2 podName:d511a328-a4d5-4253-bb43-1fb8a6b22d84 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:43.372509591 +0000 UTC m=+33.190076354 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cx8m2" (UniqueName: "kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2") pod "network-check-target-dj45n" (UID: "d511a328-a4d5-4253-bb43-1fb8a6b22d84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:27.658633 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:27.658582    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:27.658830 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:27.658659    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:27.658830 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:27.658750    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:27.658948 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:27.658888    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:28.658675 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:28.658623    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:28.659004 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:28.658781    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:29.659253 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:29.658797    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:29.659253 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:29.658845    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:29.659253 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:29.658933    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:29.659253 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:29.659082    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:30.659681 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:30.659628    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:30.660071 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:30.659763    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:31.659261 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:31.659224    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:31.659261 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:31.659250    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:31.659494 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:31.659356    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:31.659553 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:31.659514    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:32.658975 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:32.658930    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:32.659378 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:32.659057    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:33.658485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.658320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:33.658660 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.658329    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:33.658660 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:33.658594    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:33.658660 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:33.658628    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:33.814337 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.814108    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jqwz8" event={"ID":"dae5f236-b3b9-4ef6-bd6e-aeff788c92df","Type":"ContainerStarted","Data":"ca78c520c8944fdb1532a9e0153e7247da28f2cda3dfce36aa452b5d3d581e25"}
Jul 21 04:04:33.818084 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.818061    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-0.ec2.internal" event={"ID":"20a6a41a7a65b6e98b711844aad515ac","Type":"ContainerStarted","Data":"8e98fecc6dd2baa707597435eb91a9fbc108269d9567efc7be186a83dd78985d"}
Jul 21 04:04:33.823042 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.822862    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7dwjx" event={"ID":"44ddbc6a-4723-445d-a5b9-6882cb587ba1","Type":"ContainerStarted","Data":"82077ba9e4818b567243708de8a4d1dadf02e17abe315682384a81ecd95427a3"}
Jul 21 04:04:33.824632 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.824582    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x6d78" event={"ID":"f7064679-0f8e-4ec6-9f79-d057bf54717f","Type":"ContainerStarted","Data":"2d76266fbcbebabd5861610caf912708faa2a3b2ea34420135a8b42fb743c463"}
Jul 21 04:04:33.826407 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.826382    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbcl2" event={"ID":"7400550c-210d-4e1b-ba64-51235944a675","Type":"ContainerStarted","Data":"dda46d379a41312e410aacd0e1f5c46bef6694feb51f3b44c1efba142fb5a4bf"}
Jul 21 04:04:33.828616 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.828594    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b8j9r" event={"ID":"de4cd546-b39a-405f-a0d0-91a5d42434ba","Type":"ContainerStarted","Data":"15f85f112e38c5a446667a7dce07e1cc037e37c9740e7f90f94f21356eb09ed3"}
Jul 21 04:04:33.831101 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.831083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t5crf" event={"ID":"59ceecb0-f7c0-4130-b056-ffd1e11e2757","Type":"ContainerStarted","Data":"85521857ec127fee724d2628db04105d089a7cde9b0914129147175c8a6ee620"}
Jul 21 04:04:33.833808 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.833793    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:04:33.834088 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.834070    2576 generic.go:356] "Generic (PLEG): container finished" podID="62b33fd8-dca9-4044-af2f-c5b95fa52da7" containerID="16e7f11ccc135095dc25d82901a8fd75dc9e8f41eaac03245161eb474d329608" exitCode=1
Jul 21 04:04:33.834136 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.834102    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq" event={"ID":"62b33fd8-dca9-4044-af2f-c5b95fa52da7","Type":"ContainerStarted","Data":"aa6f234e1c6a45e089c5cde205634e20c5b8347cc4ca1788b75b856c0d0fc30c"}
Jul 21 04:04:33.834176 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.834146    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq" event={"ID":"62b33fd8-dca9-4044-af2f-c5b95fa52da7","Type":"ContainerStarted","Data":"203cd9895e09901eced051369427b65e76ee94a3968d848231a3e369be67c0f0"}
Jul 21 04:04:33.834176 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.834175    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq" event={"ID":"62b33fd8-dca9-4044-af2f-c5b95fa52da7","Type":"ContainerStarted","Data":"a9ad8581c92ed28554cf6a153b5d3bad66c7ac294a3576671cb2ce8423bd3b33"}
Jul 21 04:04:33.834237 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.834212    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq" event={"ID":"62b33fd8-dca9-4044-af2f-c5b95fa52da7","Type":"ContainerDied","Data":"16e7f11ccc135095dc25d82901a8fd75dc9e8f41eaac03245161eb474d329608"}
Jul 21 04:04:33.834276 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.834248    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq" event={"ID":"62b33fd8-dca9-4044-af2f-c5b95fa52da7","Type":"ContainerStarted","Data":"fa5a2dffe9d0a7aeee50babaa64a3c1242d8cb884b96cf9660b4118d96116d48"}
Jul 21 04:04:33.880466 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.880414    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jqwz8" podStartSLOduration=1.559097697 podStartE2EDuration="22.8804007s" totalImagesPullingTime="21.321303003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:33.84753245 +0000 UTC m=+23.665099233" watchObservedRunningTime="2026-07-21 04:04:33.8804007 +0000 UTC m=+23.697967486"
Jul 21 04:04:33.880698 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:33.880670    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x6d78" podStartSLOduration=1.5833198670000002 podStartE2EDuration="22.88065983s" totalImagesPullingTime="21.297339963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:33.880244816 +0000 UTC m=+23.697811600" watchObservedRunningTime="2026-07-21 04:04:33.88065983 +0000 UTC m=+23.698226615"
Jul 21 04:04:34.034364 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:34.034319    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t5crf" podStartSLOduration=1.8263327409999999 podStartE2EDuration="23.034303804s" totalImagesPullingTime="21.207971063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:33.923029048 +0000 UTC m=+23.740595833" watchObservedRunningTime="2026-07-21 04:04:34.034303804 +0000 UTC m=+23.851870588"
Jul 21 04:04:34.034630 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:34.034610    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b8j9r" podStartSLOduration=6.297330124 podStartE2EDuration="23.034604275s" totalImagesPullingTime="16.737274151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:34.034436966 +0000 UTC m=+23.852003729" watchObservedRunningTime="2026-07-21 04:04:34.034604275 +0000 UTC m=+23.852171064"
Jul 21 04:04:34.098613 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:34.098565    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7dwjx" podStartSLOduration=1.910350331 podStartE2EDuration="23.098550362s" totalImagesPullingTime="21.188200031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:34.098061034 +0000 UTC m=+23.915627819" watchObservedRunningTime="2026-07-21 04:04:34.098550362 +0000 UTC m=+23.916117146"
Jul 21 04:04:34.139178 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:34.139144    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-0.ec2.internal" podStartSLOduration=22.139130256 podStartE2EDuration="22.139130256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:34.134355112 +0000 UTC m=+23.951921896" watchObservedRunningTime="2026-07-21 04:04:34.139130256 +0000 UTC m=+23.956697039"
Jul 21 04:04:34.659267 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:34.659240    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:34.659402 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:34.659330    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:34.836991 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:34.836962    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h" event={"ID":"53310a05-992d-43d3-8e03-590c7ca9c140","Type":"ContainerStarted","Data":"302d8ca1caa6dfc367f259bf7958291fc922557962d000da9d84be84eb926375"}
Jul 21 04:04:34.838293 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:34.838271    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6k24s" event={"ID":"07851962-81af-4d0c-b3aa-4a526587297b","Type":"ContainerStarted","Data":"74813ff53c1846e82f8508077f12cfb92c78c57b8a3a8d3c327f392c9d969d51"}
Jul 21 04:04:34.839709 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:34.839690    2576 generic.go:356] "Generic (PLEG): container finished" podID="7400550c-210d-4e1b-ba64-51235944a675" containerID="dda46d379a41312e410aacd0e1f5c46bef6694feb51f3b44c1efba142fb5a4bf" exitCode=0
Jul 21 04:04:34.839790 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:34.839762    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbcl2" event={"ID":"7400550c-210d-4e1b-ba64-51235944a675","Type":"ContainerDied","Data":"dda46d379a41312e410aacd0e1f5c46bef6694feb51f3b44c1efba142fb5a4bf"}
Jul 21 04:04:34.841143 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:34.841125    2576 generic.go:356] "Generic (PLEG): container finished" podID="35d034690d2db0b8212daaa6bd5c8a40" containerID="f0e7afdaef85452be1ff69674e45fc31730360d5ab06950dc94153d61a567310" exitCode=0
Jul 21 04:04:34.841205 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:34.841190    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal" event={"ID":"35d034690d2db0b8212daaa6bd5c8a40","Type":"ContainerDied","Data":"f0e7afdaef85452be1ff69674e45fc31730360d5ab06950dc94153d61a567310"}
Jul 21 04:04:34.848132 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:34.848118    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:04:34.848726 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:34.848468    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq" event={"ID":"62b33fd8-dca9-4044-af2f-c5b95fa52da7","Type":"ContainerStarted","Data":"8d90b7fbb2bf9e8403c5d8b9864229c68d8f3d195c66ef5597fe131cd92144ea"}
Jul 21 04:04:34.869106 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:34.869050    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6k24s" podStartSLOduration=2.701400159 podStartE2EDuration="23.869032885s" totalImagesPullingTime="21.167632726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:34.868971403 +0000 UTC m=+24.686538197" watchObservedRunningTime="2026-07-21 04:04:34.869032885 +0000 UTC m=+24.686599670"
Jul 21 04:04:35.528511 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:35.528490    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 04:04:35.601983 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:35.601882    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T04:04:35.528508474Z","UUID":"9df2b3d6-2ad4-4bae-82e2-85c8a7ef997c","Handler":null,"Name":"","Endpoint":""}
Jul 21 04:04:35.603448 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:35.603428    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 04:04:35.603544 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:35.603466    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 04:04:35.658817 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:35.658793    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:35.658957 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:35.658903    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:35.659023 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:35.658999    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:35.659121 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:35.659101    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:35.852216 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:35.852182    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h" event={"ID":"53310a05-992d-43d3-8e03-590c7ca9c140","Type":"ContainerStarted","Data":"fb9ba60d48b231c315ae51b6fde7040e95f1492bd2c27ebd402eadc213b0616e"}
Jul 21 04:04:35.854044 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:35.854017    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal" event={"ID":"35d034690d2db0b8212daaa6bd5c8a40","Type":"ContainerStarted","Data":"beb9d9806d1478ca54ddccef0830af19fe03d11ac28a844e6bf35ab70289584c"}
Jul 21 04:04:35.877995 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:35.877931    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-0.ec2.internal" podStartSLOduration=23.877917783 podStartE2EDuration="23.877917783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:35.872337433 +0000 UTC m=+25.689904217" watchObservedRunningTime="2026-07-21 04:04:35.877917783 +0000 UTC m=+25.695484567"
Jul 21 04:04:36.658905 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:36.658878    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:36.659084 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:36.658968    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:36.859769 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:36.859742    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:04:36.860197 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:36.860173    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq" event={"ID":"62b33fd8-dca9-4044-af2f-c5b95fa52da7","Type":"ContainerStarted","Data":"e80cb8a23e1215eeb548d2b409f13eb83481b54004150c4968175fa07ccd18d6"}
Jul 21 04:04:37.658562 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:37.658340    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:37.658694 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:37.658342    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:37.658694 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:37.658684    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:37.658805 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:37.658764    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:37.863884 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:37.863849    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h" event={"ID":"53310a05-992d-43d3-8e03-590c7ca9c140","Type":"ContainerStarted","Data":"5a4c876a2ad4f0afc6bae16e4c937de04258a2dbc15fb5d82289405f6a3715b1"}
Jul 21 04:04:38.658734 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:38.658706    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:38.658865 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:38.658803    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:38.807515 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:38.807486    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t5crf"
Jul 21 04:04:38.808269 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:38.808241    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t5crf"
Jul 21 04:04:38.826994 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:38.826940    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljg9h" podStartSLOduration=3.08553671 podStartE2EDuration="27.826925659s" totalImagesPullingTime="24.741388949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:37.889687058 +0000 UTC m=+27.707253842" watchObservedRunningTime="2026-07-21 04:04:38.826925659 +0000 UTC m=+28.644492468"
Jul 21 04:04:38.869410 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:38.869392    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:04:38.870166 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:38.869888    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq" event={"ID":"62b33fd8-dca9-4044-af2f-c5b95fa52da7","Type":"ContainerStarted","Data":"6ee7afb494f9df89ae7d63854015d3115c1e44aa141770de3f7157dfd0d33bdb"}
Jul 21 04:04:38.870293 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:38.870275    2576 scope.go:117] "RemoveContainer" containerID="16e7f11ccc135095dc25d82901a8fd75dc9e8f41eaac03245161eb474d329608"
Jul 21 04:04:38.870410 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:38.870395    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t5crf"
Jul 21 04:04:38.870562 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:38.870546    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t5crf"
Jul 21 04:04:39.658676 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:39.658430    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:39.658801 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:39.658492    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:39.658801 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:39.658741    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:39.658887 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:39.658796    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:40.617824 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:40.617762    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l5vv7"]
Jul 21 04:04:40.618139 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:40.617884    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:40.618139 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:40.618085    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:40.619520 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:40.619498    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ksnr2"]
Jul 21 04:04:40.619616 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:40.619572    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:40.619694 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:40.619675    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:40.628725 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:40.628701    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dj45n"]
Jul 21 04:04:40.628809 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:40.628788    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:40.628863 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:40.628852    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:40.876794 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:40.876723    2576 generic.go:356] "Generic (PLEG): container finished" podID="7400550c-210d-4e1b-ba64-51235944a675" containerID="f63645fdbcacd8ad9b9dd66ecdcefba11ea5a254060d53b2e6f460822bdfa49f" exitCode=0
Jul 21 04:04:40.876927 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:40.876812    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbcl2" event={"ID":"7400550c-210d-4e1b-ba64-51235944a675","Type":"ContainerDied","Data":"f63645fdbcacd8ad9b9dd66ecdcefba11ea5a254060d53b2e6f460822bdfa49f"}
Jul 21 04:04:40.881068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:40.881047    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:04:40.881507 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:40.881481    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq" event={"ID":"62b33fd8-dca9-4044-af2f-c5b95fa52da7","Type":"ContainerStarted","Data":"2ee8ba9fcb92010c42400a83d2dcd829fee24f0df0afe20421b450a000320aa1"}
Jul 21 04:04:40.881704 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:40.881678    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:40.881822 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:40.881758    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:40.881822 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:40.881806    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:40.897585 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:40.897566    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:40.898020 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:40.898004    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:04:40.944235 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:40.944190    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq" podStartSLOduration=8.643732393 podStartE2EDuration="29.9441783s" totalImagesPullingTime="21.300445907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:40.944085726 +0000 UTC m=+30.761652511" watchObservedRunningTime="2026-07-21 04:04:40.9441783 +0000 UTC m=+30.761745062"
Jul 21 04:04:41.659195 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:41.659157    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:41.659563 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:41.659279    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:42.662812 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:42.662402    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:42.663278 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:42.662938    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:42.663278 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:42.662449    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:42.663396 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:42.663379    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:42.887041 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:42.887013    2576 generic.go:356] "Generic (PLEG): container finished" podID="7400550c-210d-4e1b-ba64-51235944a675" containerID="9456052a1c9bf9c2d16c94082aa948ba12f2dff5a5220d973159112fb6c1ca04" exitCode=0
Jul 21 04:04:42.887168 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:42.887101    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbcl2" event={"ID":"7400550c-210d-4e1b-ba64-51235944a675","Type":"ContainerDied","Data":"9456052a1c9bf9c2d16c94082aa948ba12f2dff5a5220d973159112fb6c1ca04"}
Jul 21 04:04:43.296970 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:43.296944    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret\") pod \"global-pull-secret-syncer-ksnr2\" (UID: \"f6567b22-8a1e-4d92-a2ee-6eedb17d3679\") " pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:43.297109 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:43.296996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs\") pod \"network-metrics-daemon-l5vv7\" (UID: \"3ed75b9c-b7ed-4efd-94c5-c58c202e510b\") " pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:43.297109 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:43.297062    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:43.297109 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:43.297090    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:43.297109 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:43.297110    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret podName:f6567b22-8a1e-4d92-a2ee-6eedb17d3679 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:15.297095774 +0000 UTC m=+65.114662535 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret") pod "global-pull-secret-syncer-ksnr2" (UID: "f6567b22-8a1e-4d92-a2ee-6eedb17d3679") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:43.297234 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:43.297126    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs podName:3ed75b9c-b7ed-4efd-94c5-c58c202e510b nodeName:}" failed. No retries permitted until 2026-07-21 04:05:15.297115794 +0000 UTC m=+65.114682555 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs") pod "network-metrics-daemon-l5vv7" (UID: "3ed75b9c-b7ed-4efd-94c5-c58c202e510b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:43.397216 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:43.397193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx8m2\" (UniqueName: \"kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2\") pod \"network-check-target-dj45n\" (UID: \"d511a328-a4d5-4253-bb43-1fb8a6b22d84\") " pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:43.397363 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:43.397291    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:43.397363 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:43.397315    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:43.397363 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:43.397329    2576 projected.go:196] Error preparing data for projected volume kube-api-access-cx8m2 for pod openshift-network-diagnostics/network-check-target-dj45n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:43.397479 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:43.397382    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2 podName:d511a328-a4d5-4253-bb43-1fb8a6b22d84 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:15.397366732 +0000 UTC m=+65.214933494 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cx8m2" (UniqueName: "kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2") pod "network-check-target-dj45n" (UID: "d511a328-a4d5-4253-bb43-1fb8a6b22d84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:43.659025 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:43.659004    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:43.659150 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:43.659098    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:44.661853 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:44.661831    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:44.662206 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:44.661923    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:04:44.662206 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:44.661985    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:44.662206 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:44.662060    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksnr2" podUID="f6567b22-8a1e-4d92-a2ee-6eedb17d3679"
Jul 21 04:04:44.892792 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:44.892763    2576 generic.go:356] "Generic (PLEG): container finished" podID="7400550c-210d-4e1b-ba64-51235944a675" containerID="2f9857534631c6f450993f6efd94f16243b4b653a17e5897b170a10006d29c93" exitCode=0
Jul 21 04:04:44.892898 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:44.892829    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbcl2" event={"ID":"7400550c-210d-4e1b-ba64-51235944a675","Type":"ContainerDied","Data":"2f9857534631c6f450993f6efd94f16243b4b653a17e5897b170a10006d29c93"}
Jul 21 04:04:45.659214 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:45.659187    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:45.659371 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:45.659272    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dj45n" podUID="d511a328-a4d5-4253-bb43-1fb8a6b22d84"
Jul 21 04:04:46.030138 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.030107    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-0.ec2.internal" event="NodeReady"
Jul 21 04:04:46.030631 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.030254    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 04:04:46.112107 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.112073    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"]
Jul 21 04:04:46.114710 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.114689    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.120627 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.120602    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 04:04:46.121149 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.121129    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 04:04:46.121303 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.121230    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 04:04:46.121628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.121609    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mkcct\""
Jul 21 04:04:46.122933 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.122913    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"]
Jul 21 04:04:46.126147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.126112    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:04:46.129344 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.129319    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 04:04:46.131138 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.131116    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 21 04:04:46.131224 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.131202    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9q4j6\""
Jul 21 04:04:46.131283 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.131267    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 21 04:04:46.140408 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.140389    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pjlxp"]
Jul 21 04:04:46.143280 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.143263    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"]
Jul 21 04:04:46.143365 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.143297    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g4cns"]
Jul 21 04:04:46.143427 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.143387    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:04:46.146058 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.146039    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g4cns"
Jul 21 04:04:46.146494 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.146476    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 04:04:46.147261 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.146291    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 04:04:46.150689 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.150668    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m9r9d\""
Jul 21 04:04:46.159616 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.159597    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 04:04:46.159740 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.159597    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 04:04:46.160780 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.160733    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"]
Jul 21 04:04:46.164338 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.164320    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p2vsr\""
Jul 21 04:04:46.164703 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.164687    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 04:04:46.173957 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.173931    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g4cns"]
Jul 21 04:04:46.178719 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.178688    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pjlxp"]
Jul 21 04:04:46.221610 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.221579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-ca-trust-extracted\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.221808 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.221659    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-trusted-ca\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.221808 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.221698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-installation-pull-secrets\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.221808 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.221751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-bound-sa-token\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.221808 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.221791    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4jb8p\" (UID: \"f9e49fac-2682-4dc3-af73-b1f03c04d4f7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:04:46.221999 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.221851    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-certificates\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.221999 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.221879    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4929\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-kube-api-access-j4929\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.221999 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.221924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-4jb8p\" (UID: \"f9e49fac-2682-4dc3-af73-b1f03c04d4f7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:04:46.222083 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.221989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-image-registry-private-configuration\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.222083 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.222045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.322885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.322855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.322885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.322886    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-ca-trust-extracted\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.323103 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.322908    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:04:46.323103 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.322928    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdwp5\" (UniqueName: \"kubernetes.io/projected/3fd3f5fb-f69c-4621-b16d-223d27a121bd-kube-api-access-bdwp5\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:04:46.323103 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.322958    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-trusted-ca\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.323103 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.322975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3fd3f5fb-f69c-4621-b16d-223d27a121bd-config-volume\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:04:46.323103 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.322997    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fd3f5fb-f69c-4621-b16d-223d27a121bd-tmp-dir\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:04:46.323103 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:46.323014    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:04:46.323103 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:46.323041    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b7ddb95f7-l6j7p: secret "image-registry-tls" not found
Jul 21 04:04:46.323103 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.323020    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-installation-pull-secrets\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.323103 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.323076    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-bound-sa-token\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.323533 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:46.323113    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls podName:1e97d66b-e06f-44fe-b6e7-fe5dac50aa68 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:46.823093128 +0000 UTC m=+36.640659907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls") pod "image-registry-5b7ddb95f7-l6j7p" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68") : secret "image-registry-tls" not found
Jul 21 04:04:46.323533 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.323135    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4jb8p\" (UID: \"f9e49fac-2682-4dc3-af73-b1f03c04d4f7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:04:46.323533 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.323204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-certificates\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.323533 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.323231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4929\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-kube-api-access-j4929\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.323533 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.323296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-4jb8p\" (UID: \"f9e49fac-2682-4dc3-af73-b1f03c04d4f7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:04:46.323533 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.323316    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-ca-trust-extracted\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.323533 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.323342    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0bea2dd-fbfb-4d2e-9457-9fa6f6b5608d-cert\") pod \"ingress-canary-g4cns\" (UID: \"d0bea2dd-fbfb-4d2e-9457-9fa6f6b5608d\") " pod="openshift-ingress-canary/ingress-canary-g4cns"
Jul 21 04:04:46.323533 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.323368    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mkfb\" (UniqueName: \"kubernetes.io/projected/d0bea2dd-fbfb-4d2e-9457-9fa6f6b5608d-kube-api-access-2mkfb\") pod \"ingress-canary-g4cns\" (UID: \"d0bea2dd-fbfb-4d2e-9457-9fa6f6b5608d\") " pod="openshift-ingress-canary/ingress-canary-g4cns"
Jul 21 04:04:46.323533 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.323398    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-image-registry-private-configuration\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.323533 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:46.323460    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 04:04:46.323533 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:46.323524    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert podName:f9e49fac-2682-4dc3-af73-b1f03c04d4f7 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:46.823505763 +0000 UTC m=+36.641072543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4jb8p" (UID: "f9e49fac-2682-4dc3-af73-b1f03c04d4f7") : secret "networking-console-plugin-cert" not found
Jul 21 04:04:46.324111 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.323803    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-certificates\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.324111 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.324044    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-trusted-ca\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.324111 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.324065    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-4jb8p\" (UID: \"f9e49fac-2682-4dc3-af73-b1f03c04d4f7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:04:46.327167 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.327148    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-image-registry-private-configuration\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.327167 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.327161    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-installation-pull-secrets\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.337766 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.337741    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-bound-sa-token\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.338976 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.338957    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4929\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-kube-api-access-j4929\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.424284 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.424197    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0bea2dd-fbfb-4d2e-9457-9fa6f6b5608d-cert\") pod \"ingress-canary-g4cns\" (UID: \"d0bea2dd-fbfb-4d2e-9457-9fa6f6b5608d\") " pod="openshift-ingress-canary/ingress-canary-g4cns"
Jul 21 04:04:46.424284 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.424237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mkfb\" (UniqueName: \"kubernetes.io/projected/d0bea2dd-fbfb-4d2e-9457-9fa6f6b5608d-kube-api-access-2mkfb\") pod \"ingress-canary-g4cns\" (UID: \"d0bea2dd-fbfb-4d2e-9457-9fa6f6b5608d\") " pod="openshift-ingress-canary/ingress-canary-g4cns"
Jul 21 04:04:46.424284 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.424272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:04:46.424554 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.424296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdwp5\" (UniqueName: \"kubernetes.io/projected/3fd3f5fb-f69c-4621-b16d-223d27a121bd-kube-api-access-bdwp5\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:04:46.424554 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.424339    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3fd3f5fb-f69c-4621-b16d-223d27a121bd-config-volume\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:04:46.424554 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.424361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fd3f5fb-f69c-4621-b16d-223d27a121bd-tmp-dir\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:04:46.424554 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:46.424406    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:04:46.424554 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:46.424466    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls podName:3fd3f5fb-f69c-4621-b16d-223d27a121bd nodeName:}" failed. No retries permitted until 2026-07-21 04:04:46.924445877 +0000 UTC m=+36.742012768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls") pod "dns-default-pjlxp" (UID: "3fd3f5fb-f69c-4621-b16d-223d27a121bd") : secret "dns-default-metrics-tls" not found
Jul 21 04:04:46.424831 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.424733    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fd3f5fb-f69c-4621-b16d-223d27a121bd-tmp-dir\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:04:46.425107 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.425078    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3fd3f5fb-f69c-4621-b16d-223d27a121bd-config-volume\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:04:46.427198 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.427178    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0bea2dd-fbfb-4d2e-9457-9fa6f6b5608d-cert\") pod \"ingress-canary-g4cns\" (UID: \"d0bea2dd-fbfb-4d2e-9457-9fa6f6b5608d\") " pod="openshift-ingress-canary/ingress-canary-g4cns"
Jul 21 04:04:46.434930 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.434911    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdwp5\" (UniqueName: \"kubernetes.io/projected/3fd3f5fb-f69c-4621-b16d-223d27a121bd-kube-api-access-bdwp5\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:04:46.435515 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.435497    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mkfb\" (UniqueName: \"kubernetes.io/projected/d0bea2dd-fbfb-4d2e-9457-9fa6f6b5608d-kube-api-access-2mkfb\") pod \"ingress-canary-g4cns\" (UID: \"d0bea2dd-fbfb-4d2e-9457-9fa6f6b5608d\") " pod="openshift-ingress-canary/ingress-canary-g4cns"
Jul 21 04:04:46.459288 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.459261    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g4cns"
Jul 21 04:04:46.634160 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.633846    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g4cns"]
Jul 21 04:04:46.639574 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:04:46.639544    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0bea2dd_fbfb_4d2e_9457_9fa6f6b5608d.slice/crio-b87f3c8fbe5fd5d973deb9fc9877c6aa46f94ab56b2716fcf826591b0431b1a5 WatchSource:0}: Error finding container b87f3c8fbe5fd5d973deb9fc9877c6aa46f94ab56b2716fcf826591b0431b1a5: Status 404 returned error can't find the container with id b87f3c8fbe5fd5d973deb9fc9877c6aa46f94ab56b2716fcf826591b0431b1a5
Jul 21 04:04:46.658352 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.658328    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:04:46.658527 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.658505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:04:46.661373 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.661052    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 04:04:46.661373 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.661159    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 04:04:46.661373 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.661270    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q5j6n\""
Jul 21 04:04:46.827886 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.827863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4jb8p\" (UID: \"f9e49fac-2682-4dc3-af73-b1f03c04d4f7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:04:46.828039 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.827922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:46.828039 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:46.828029    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:04:46.828039 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:46.828040    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b7ddb95f7-l6j7p: secret "image-registry-tls" not found
Jul 21 04:04:46.828200 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:46.828093    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls podName:1e97d66b-e06f-44fe-b6e7-fe5dac50aa68 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:47.828080448 +0000 UTC m=+37.645647209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls") pod "image-registry-5b7ddb95f7-l6j7p" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68") : secret "image-registry-tls" not found
Jul 21 04:04:46.828200 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:46.828031    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 04:04:46.828200 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:46.828181    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert podName:f9e49fac-2682-4dc3-af73-b1f03c04d4f7 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:47.828164642 +0000 UTC m=+37.645731408 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4jb8p" (UID: "f9e49fac-2682-4dc3-af73-b1f03c04d4f7") : secret "networking-console-plugin-cert" not found
Jul 21 04:04:46.898965 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.898934    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g4cns" event={"ID":"d0bea2dd-fbfb-4d2e-9457-9fa6f6b5608d","Type":"ContainerStarted","Data":"b87f3c8fbe5fd5d973deb9fc9877c6aa46f94ab56b2716fcf826591b0431b1a5"}
Jul 21 04:04:46.928239 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:46.928210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:04:46.928431 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:46.928412    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:04:46.928491 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:46.928480    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls podName:3fd3f5fb-f69c-4621-b16d-223d27a121bd nodeName:}" failed. No retries permitted until 2026-07-21 04:04:47.928460977 +0000 UTC m=+37.746027766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls") pod "dns-default-pjlxp" (UID: "3fd3f5fb-f69c-4621-b16d-223d27a121bd") : secret "dns-default-metrics-tls" not found
Jul 21 04:04:47.659053 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:47.658527    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:04:47.662659 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:47.662619    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vvkm7\""
Jul 21 04:04:47.662967 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:47.662781    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 04:04:47.663158 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:47.663130    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 04:04:47.834433 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:47.834400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:47.834591 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:47.834497    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4jb8p\" (UID: \"f9e49fac-2682-4dc3-af73-b1f03c04d4f7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:04:47.834591 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:47.834575    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:04:47.834745 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:47.834596    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b7ddb95f7-l6j7p: secret "image-registry-tls" not found
Jul 21 04:04:47.834745 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:47.834631    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 04:04:47.834745 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:47.834672    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls podName:1e97d66b-e06f-44fe-b6e7-fe5dac50aa68 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:49.834657707 +0000 UTC m=+39.652224488 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls") pod "image-registry-5b7ddb95f7-l6j7p" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68") : secret "image-registry-tls" not found
Jul 21 04:04:47.834745 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:47.834691    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert podName:f9e49fac-2682-4dc3-af73-b1f03c04d4f7 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:49.834679415 +0000 UTC m=+39.652246176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4jb8p" (UID: "f9e49fac-2682-4dc3-af73-b1f03c04d4f7") : secret "networking-console-plugin-cert" not found
Jul 21 04:04:47.935328 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:47.935245    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:04:47.935484 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:47.935359    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:04:47.935484 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:47.935433    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls podName:3fd3f5fb-f69c-4621-b16d-223d27a121bd nodeName:}" failed. No retries permitted until 2026-07-21 04:04:49.935412668 +0000 UTC m=+39.752979447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls") pod "dns-default-pjlxp" (UID: "3fd3f5fb-f69c-4621-b16d-223d27a121bd") : secret "dns-default-metrics-tls" not found
Jul 21 04:04:49.849361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:49.849325    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:49.849843 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:49.849420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4jb8p\" (UID: \"f9e49fac-2682-4dc3-af73-b1f03c04d4f7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:04:49.849843 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:49.849507    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:04:49.849843 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:49.849520    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 04:04:49.849843 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:49.849532    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b7ddb95f7-l6j7p: secret "image-registry-tls" not found
Jul 21 04:04:49.849843 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:49.849600    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls podName:1e97d66b-e06f-44fe-b6e7-fe5dac50aa68 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:53.849576741 +0000 UTC m=+43.667143506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls") pod "image-registry-5b7ddb95f7-l6j7p" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68") : secret "image-registry-tls" not found
Jul 21 04:04:49.849843 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:49.849619    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert podName:f9e49fac-2682-4dc3-af73-b1f03c04d4f7 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:53.849610474 +0000 UTC m=+43.667177237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4jb8p" (UID: "f9e49fac-2682-4dc3-af73-b1f03c04d4f7") : secret "networking-console-plugin-cert" not found
Jul 21 04:04:49.950488 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:49.950460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:04:49.950691 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:49.950574    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:04:49.950691 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:49.950664    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls podName:3fd3f5fb-f69c-4621-b16d-223d27a121bd nodeName:}" failed. No retries permitted until 2026-07-21 04:04:53.950626406 +0000 UTC m=+43.768193185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls") pod "dns-default-pjlxp" (UID: "3fd3f5fb-f69c-4621-b16d-223d27a121bd") : secret "dns-default-metrics-tls" not found
Jul 21 04:04:51.913343 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:51.913308    2576 generic.go:356] "Generic (PLEG): container finished" podID="7400550c-210d-4e1b-ba64-51235944a675" containerID="c7e6ebed5b71fb03f5b3d1e7f3aa8753fbe914a00e4a823c7c51476c504b4365" exitCode=0
Jul 21 04:04:51.913749 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:51.913383    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbcl2" event={"ID":"7400550c-210d-4e1b-ba64-51235944a675","Type":"ContainerDied","Data":"c7e6ebed5b71fb03f5b3d1e7f3aa8753fbe914a00e4a823c7c51476c504b4365"}
Jul 21 04:04:51.914906 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:51.914879    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g4cns" event={"ID":"d0bea2dd-fbfb-4d2e-9457-9fa6f6b5608d","Type":"ContainerStarted","Data":"e50ac86d7fb1e2a6ab1271b9f209876e3147d30d26dfa8543e231bd1fbf035e5"}
Jul 21 04:04:52.086952 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:52.086910    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g4cns" podStartSLOduration=1.711784717 podStartE2EDuration="6.086894382s" totalImagesPullingTime="4.375109665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:04:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:52.0864586 +0000 UTC m=+41.904025384" watchObservedRunningTime="2026-07-21 04:04:52.086894382 +0000 UTC m=+41.904461166"
Jul 21 04:04:52.919184 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:52.919152    2576 generic.go:356] "Generic (PLEG): container finished" podID="7400550c-210d-4e1b-ba64-51235944a675" containerID="1744ecc76b0e253f61d82e647869ebfe4f25760c0628aa5933358e7b7242209d" exitCode=0
Jul 21 04:04:52.919683 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:52.919237    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbcl2" event={"ID":"7400550c-210d-4e1b-ba64-51235944a675","Type":"ContainerDied","Data":"1744ecc76b0e253f61d82e647869ebfe4f25760c0628aa5933358e7b7242209d"}
Jul 21 04:04:53.878093 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:53.878048    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:04:53.878278 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:53.878129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4jb8p\" (UID: \"f9e49fac-2682-4dc3-af73-b1f03c04d4f7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:04:53.878278 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:53.878203    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:04:53.878278 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:53.878222    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b7ddb95f7-l6j7p: secret "image-registry-tls" not found
Jul 21 04:04:53.878278 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:53.878239    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 04:04:53.878278 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:53.878276    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls podName:1e97d66b-e06f-44fe-b6e7-fe5dac50aa68 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:01.878261502 +0000 UTC m=+51.695828264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls") pod "image-registry-5b7ddb95f7-l6j7p" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68") : secret "image-registry-tls" not found
Jul 21 04:04:53.878465 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:53.878299    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert podName:f9e49fac-2682-4dc3-af73-b1f03c04d4f7 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:01.878282933 +0000 UTC m=+51.695849702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4jb8p" (UID: "f9e49fac-2682-4dc3-af73-b1f03c04d4f7") : secret "networking-console-plugin-cert" not found
Jul 21 04:04:53.924974 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:53.924941    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbcl2" event={"ID":"7400550c-210d-4e1b-ba64-51235944a675","Type":"ContainerStarted","Data":"64f2f2bc2db1c1d88f4eff7cadda3bd5606dffcdff54fd986f5133643595b250"}
Jul 21 04:04:53.952994 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:53.952946    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hbcl2" podStartSLOduration=7.368758799 podStartE2EDuration="42.952927208s" totalImagesPullingTime="35.584168409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:53.951323034 +0000 UTC m=+43.768889817" watchObservedRunningTime="2026-07-21 04:04:53.952927208 +0000 UTC m=+43.770493991"
Jul 21 04:04:53.978943 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:04:53.978901    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:04:53.979071 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:53.979043    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:04:53.979136 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:04:53.979109    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls podName:3fd3f5fb-f69c-4621-b16d-223d27a121bd nodeName:}" failed. No retries permitted until 2026-07-21 04:05:01.979090767 +0000 UTC m=+51.796657531 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls") pod "dns-default-pjlxp" (UID: "3fd3f5fb-f69c-4621-b16d-223d27a121bd") : secret "dns-default-metrics-tls" not found
Jul 21 04:05:01.935000 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:01.934964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4jb8p\" (UID: \"f9e49fac-2682-4dc3-af73-b1f03c04d4f7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:05:01.935358 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:01.935028    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:05:01.935358 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:01.935108    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 04:05:01.935358 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:01.935130    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:05:01.935358 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:01.935140    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b7ddb95f7-l6j7p: secret "image-registry-tls" not found
Jul 21 04:05:01.935358 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:01.935179    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert podName:f9e49fac-2682-4dc3-af73-b1f03c04d4f7 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:17.935162904 +0000 UTC m=+67.752729668 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4jb8p" (UID: "f9e49fac-2682-4dc3-af73-b1f03c04d4f7") : secret "networking-console-plugin-cert" not found
Jul 21 04:05:01.935358 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:01.935195    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls podName:1e97d66b-e06f-44fe-b6e7-fe5dac50aa68 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:17.935188394 +0000 UTC m=+67.752755155 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls") pod "image-registry-5b7ddb95f7-l6j7p" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68") : secret "image-registry-tls" not found
Jul 21 04:05:02.036254 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:02.036221    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:05:02.036406 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:02.036353    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:05:02.036447 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:02.036414    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls podName:3fd3f5fb-f69c-4621-b16d-223d27a121bd nodeName:}" failed. No retries permitted until 2026-07-21 04:05:18.036400221 +0000 UTC m=+67.853966983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls") pod "dns-default-pjlxp" (UID: "3fd3f5fb-f69c-4621-b16d-223d27a121bd") : secret "dns-default-metrics-tls" not found
Jul 21 04:05:12.902736 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:12.902707    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whzmq"
Jul 21 04:05:15.327461 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:15.327412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret\") pod \"global-pull-secret-syncer-ksnr2\" (UID: \"f6567b22-8a1e-4d92-a2ee-6eedb17d3679\") " pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:05:15.327948 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:15.327492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs\") pod \"network-metrics-daemon-l5vv7\" (UID: \"3ed75b9c-b7ed-4efd-94c5-c58c202e510b\") " pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:05:15.330274 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:15.330255    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 04:05:15.330520 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:15.330502    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 04:05:15.337947 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:15.337922    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 04:05:15.338046 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:15.338004    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs podName:3ed75b9c-b7ed-4efd-94c5-c58c202e510b nodeName:}" failed. No retries permitted until 2026-07-21 04:06:19.33798212 +0000 UTC m=+129.155548888 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs") pod "network-metrics-daemon-l5vv7" (UID: "3ed75b9c-b7ed-4efd-94c5-c58c202e510b") : secret "metrics-daemon-secret" not found
Jul 21 04:05:15.341234 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:15.341217    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6567b22-8a1e-4d92-a2ee-6eedb17d3679-original-pull-secret\") pod \"global-pull-secret-syncer-ksnr2\" (UID: \"f6567b22-8a1e-4d92-a2ee-6eedb17d3679\") " pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:05:15.428096 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:15.428070    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx8m2\" (UniqueName: \"kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2\") pod \"network-check-target-dj45n\" (UID: \"d511a328-a4d5-4253-bb43-1fb8a6b22d84\") " pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:05:15.431329 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:15.431312    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 04:05:15.441179 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:15.441159    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 04:05:15.451133 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:15.451108    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx8m2\" (UniqueName: \"kubernetes.io/projected/d511a328-a4d5-4253-bb43-1fb8a6b22d84-kube-api-access-cx8m2\") pod \"network-check-target-dj45n\" (UID: \"d511a328-a4d5-4253-bb43-1fb8a6b22d84\") " pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:05:15.471077 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:15.471049    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksnr2"
Jul 21 04:05:15.581702 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:15.578041    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vvkm7\""
Jul 21 04:05:15.584166 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:15.584141    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:05:15.620111 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:15.620041    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ksnr2"]
Jul 21 04:05:15.623717 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:05:15.623695    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6567b22_8a1e_4d92_a2ee_6eedb17d3679.slice/crio-cf3a31a9168825b47a3b90c60619b0be080a2faa26a8706cd82ce80d474f78d2 WatchSource:0}: Error finding container cf3a31a9168825b47a3b90c60619b0be080a2faa26a8706cd82ce80d474f78d2: Status 404 returned error can't find the container with id cf3a31a9168825b47a3b90c60619b0be080a2faa26a8706cd82ce80d474f78d2
Jul 21 04:05:15.714620 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:15.714589    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dj45n"]
Jul 21 04:05:15.718107 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:05:15.718078    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd511a328_a4d5_4253_bb43_1fb8a6b22d84.slice/crio-3268d79b4c9a57c848450d3a237edc840a8d1df9b13b4af4d0b6e4bed4aff9c3 WatchSource:0}: Error finding container 3268d79b4c9a57c848450d3a237edc840a8d1df9b13b4af4d0b6e4bed4aff9c3: Status 404 returned error can't find the container with id 3268d79b4c9a57c848450d3a237edc840a8d1df9b13b4af4d0b6e4bed4aff9c3
Jul 21 04:05:15.973188 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:15.973114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dj45n" event={"ID":"d511a328-a4d5-4253-bb43-1fb8a6b22d84","Type":"ContainerStarted","Data":"3268d79b4c9a57c848450d3a237edc840a8d1df9b13b4af4d0b6e4bed4aff9c3"}
Jul 21 04:05:15.974127 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:15.974103    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ksnr2" event={"ID":"f6567b22-8a1e-4d92-a2ee-6eedb17d3679","Type":"ContainerStarted","Data":"cf3a31a9168825b47a3b90c60619b0be080a2faa26a8706cd82ce80d474f78d2"}
Jul 21 04:05:17.947148 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:17.947114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4jb8p\" (UID: \"f9e49fac-2682-4dc3-af73-b1f03c04d4f7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:05:17.947731 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:17.947180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:05:17.947731 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:17.947277    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 04:05:17.947731 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:17.947283    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:05:17.947731 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:17.947399    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b7ddb95f7-l6j7p: secret "image-registry-tls" not found
Jul 21 04:05:17.947731 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:17.947402    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert podName:f9e49fac-2682-4dc3-af73-b1f03c04d4f7 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:49.947380433 +0000 UTC m=+99.764947213 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4jb8p" (UID: "f9e49fac-2682-4dc3-af73-b1f03c04d4f7") : secret "networking-console-plugin-cert" not found
Jul 21 04:05:17.947731 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:17.947443    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls podName:1e97d66b-e06f-44fe-b6e7-fe5dac50aa68 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:49.947427719 +0000 UTC m=+99.764994498 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls") pod "image-registry-5b7ddb95f7-l6j7p" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68") : secret "image-registry-tls" not found
Jul 21 04:05:18.048067 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:18.047959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:05:18.048240 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:18.048131    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:05:18.048240 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:18.048200    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls podName:3fd3f5fb-f69c-4621-b16d-223d27a121bd nodeName:}" failed. No retries permitted until 2026-07-21 04:05:50.048178548 +0000 UTC m=+99.865745314 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls") pod "dns-default-pjlxp" (UID: "3fd3f5fb-f69c-4621-b16d-223d27a121bd") : secret "dns-default-metrics-tls" not found
Jul 21 04:05:21.990421 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:21.990384    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dj45n" event={"ID":"d511a328-a4d5-4253-bb43-1fb8a6b22d84","Type":"ContainerStarted","Data":"3109601159c51c836abf57a88533a0c93f1b8dfc7af19c851eea8a1315ca68f2"}
Jul 21 04:05:21.990878 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:21.990514    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:05:21.992052 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:21.992028    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ksnr2" event={"ID":"f6567b22-8a1e-4d92-a2ee-6eedb17d3679","Type":"ContainerStarted","Data":"b18ae3770bf4cb12b7c417ae33e27a90714b884bf9f9b273b913ffd38d402c29"}
Jul 21 04:05:22.018653 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:22.018602    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dj45n" podStartSLOduration=65.586672565 podStartE2EDuration="1m11.018590397s" totalImagesPullingTime="5.431917832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:05:22.018471172 +0000 UTC m=+71.836037956" watchObservedRunningTime="2026-07-21 04:05:22.018590397 +0000 UTC m=+71.836157191"
Jul 21 04:05:22.065715 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:22.065675    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ksnr2" podStartSLOduration=65.528309027 podStartE2EDuration="1m11.065663272s" totalImagesPullingTime="5.537354245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:05:22.065528942 +0000 UTC m=+71.883095725" watchObservedRunningTime="2026-07-21 04:05:22.065663272 +0000 UTC m=+71.883230033"
Jul 21 04:05:49.977275 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:49.977150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:05:49.977275 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:49.977214    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4jb8p\" (UID: \"f9e49fac-2682-4dc3-af73-b1f03c04d4f7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:05:49.977874 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:49.977310    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 04:05:49.977874 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:49.977308    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:05:49.977874 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:49.977333    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b7ddb95f7-l6j7p: secret "image-registry-tls" not found
Jul 21 04:05:49.977874 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:49.977398    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert podName:f9e49fac-2682-4dc3-af73-b1f03c04d4f7 nodeName:}" failed. No retries permitted until 2026-07-21 04:06:53.977383907 +0000 UTC m=+163.794950669 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4jb8p" (UID: "f9e49fac-2682-4dc3-af73-b1f03c04d4f7") : secret "networking-console-plugin-cert" not found
Jul 21 04:05:49.977874 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:49.977485    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls podName:1e97d66b-e06f-44fe-b6e7-fe5dac50aa68 nodeName:}" failed. No retries permitted until 2026-07-21 04:06:53.977471626 +0000 UTC m=+163.795038387 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls") pod "image-registry-5b7ddb95f7-l6j7p" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68") : secret "image-registry-tls" not found
Jul 21 04:05:50.077958 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:50.077931    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:05:50.078081 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:50.078048    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:05:50.078123 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:05:50.078106    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls podName:3fd3f5fb-f69c-4621-b16d-223d27a121bd nodeName:}" failed. No retries permitted until 2026-07-21 04:06:54.07809145 +0000 UTC m=+163.895658214 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls") pod "dns-default-pjlxp" (UID: "3fd3f5fb-f69c-4621-b16d-223d27a121bd") : secret "dns-default-metrics-tls" not found
Jul 21 04:05:52.996728 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:05:52.996693    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dj45n"
Jul 21 04:06:19.385884 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:06:19.385840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs\") pod \"network-metrics-daemon-l5vv7\" (UID: \"3ed75b9c-b7ed-4efd-94c5-c58c202e510b\") " pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:06:19.386288 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:06:19.385994    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 04:06:19.386288 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:06:19.386063    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs podName:3ed75b9c-b7ed-4efd-94c5-c58c202e510b nodeName:}" failed. No retries permitted until 2026-07-21 04:08:21.386048333 +0000 UTC m=+251.203615095 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs") pod "network-metrics-daemon-l5vv7" (UID: "3ed75b9c-b7ed-4efd-94c5-c58c202e510b") : secret "metrics-daemon-secret" not found
Jul 21 04:06:49.126055 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:06:49.126011    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p" podUID="1e97d66b-e06f-44fe-b6e7-fe5dac50aa68"
Jul 21 04:06:49.137126 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:06:49.137099    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p" podUID="f9e49fac-2682-4dc3-af73-b1f03c04d4f7"
Jul 21 04:06:49.154272 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:06:49.154247    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pjlxp" podUID="3fd3f5fb-f69c-4621-b16d-223d27a121bd"
Jul 21 04:06:49.197472 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:06:49.197448    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:06:49.197472 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:06:49.197460    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:06:49.197627 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:06:49.197460    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:06:49.676385 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:06:49.676343    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:06:54.020774 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:06:54.020729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:06:54.021218 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:06:54.020794    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4jb8p\" (UID: \"f9e49fac-2682-4dc3-af73-b1f03c04d4f7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:06:54.021218 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:06:54.020882    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 04:06:54.021218 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:06:54.020897    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:06:54.021218 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:06:54.020919    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b7ddb95f7-l6j7p: secret "image-registry-tls" not found
Jul 21 04:06:54.021218 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:06:54.020956    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert podName:f9e49fac-2682-4dc3-af73-b1f03c04d4f7 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:56.020940624 +0000 UTC m=+285.838507386 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4jb8p" (UID: "f9e49fac-2682-4dc3-af73-b1f03c04d4f7") : secret "networking-console-plugin-cert" not found
Jul 21 04:06:54.021218 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:06:54.020987    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls podName:1e97d66b-e06f-44fe-b6e7-fe5dac50aa68 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:56.020966522 +0000 UTC m=+285.838533308 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls") pod "image-registry-5b7ddb95f7-l6j7p" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68") : secret "image-registry-tls" not found
Jul 21 04:06:54.121829 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:06:54.121792    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:06:54.121969 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:06:54.121935    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:06:54.122018 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:06:54.122008    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls podName:3fd3f5fb-f69c-4621-b16d-223d27a121bd nodeName:}" failed. No retries permitted until 2026-07-21 04:08:56.121992285 +0000 UTC m=+285.939559047 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls") pod "dns-default-pjlxp" (UID: "3fd3f5fb-f69c-4621-b16d-223d27a121bd") : secret "dns-default-metrics-tls" not found
Jul 21 04:07:04.659240 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:07:04.659151    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:08:21.406188 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:21.406149    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs\") pod \"network-metrics-daemon-l5vv7\" (UID: \"3ed75b9c-b7ed-4efd-94c5-c58c202e510b\") " pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:08:21.406678 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:21.406293    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 04:08:21.406678 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:21.406354    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs podName:3ed75b9c-b7ed-4efd-94c5-c58c202e510b nodeName:}" failed. No retries permitted until 2026-07-21 04:10:23.406339285 +0000 UTC m=+373.223906046 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs") pod "network-metrics-daemon-l5vv7" (UID: "3ed75b9c-b7ed-4efd-94c5-c58c202e510b") : secret "metrics-daemon-secret" not found
Jul 21 04:08:25.329251 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.329217    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl"]
Jul 21 04:08:25.330853 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.330838    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl"
Jul 21 04:08:25.333106 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.333085    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:08:25.333850 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.333825    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 21 04:08:25.333938 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.333860    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 21 04:08:25.333938 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.333830    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 21 04:08:25.334058 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.333830    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zxnlf\""
Jul 21 04:08:25.335084 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.335058    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-cfp86"]
Jul 21 04:08:25.336842 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.336824    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"]
Jul 21 04:08:25.336979 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.336929    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-cfp86"
Jul 21 04:08:25.338678 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.338662    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g"]
Jul 21 04:08:25.338795 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.338701    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:25.339787 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.339770    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hst9v\""
Jul 21 04:08:25.340002 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.339984    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 21 04:08:25.340114 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.340096    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:08:25.340222 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.340165    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g"
Jul 21 04:08:25.340613 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.340596    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 04:08:25.340905 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.340889    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 21 04:08:25.342384 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.342361    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 21 04:08:25.342384 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.342380    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wp4m6\""
Jul 21 04:08:25.343442 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.343424    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:08:25.343716 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.343697    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-krnqs\""
Jul 21 04:08:25.343716 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.343723    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 21 04:08:25.344015 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.343997    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 21 04:08:25.344083 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.344016    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 21 04:08:25.344456 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.344311    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 04:08:25.344456 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.344389    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl"]
Jul 21 04:08:25.362842 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.362823    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-cfp86"]
Jul 21 04:08:25.364605 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.364586    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g"]
Jul 21 04:08:25.371508 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.371488    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"]
Jul 21 04:08:25.420978 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.420952    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-9wdf7"]
Jul 21 04:08:25.422713 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.422700    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9wdf7"
Jul 21 04:08:25.424918 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.424902    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vswlc\""
Jul 21 04:08:25.427502 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.427482    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-mv7hd"]
Jul 21 04:08:25.429542 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.429525    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-67ff98b5c4-fp7md"]
Jul 21 04:08:25.429667 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.429633    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.431624 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.431607    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:25.432038 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.432017    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 21 04:08:25.432038 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.432031    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-p44l7\""
Jul 21 04:08:25.432346 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.432312    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 04:08:25.432491 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.432477    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 21 04:08:25.432491 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.432485    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 04:08:25.434926 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.434904    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbxz6\" (UniqueName: \"kubernetes.io/projected/8fe26493-927f-4aa5-b956-80abeab6c3c0-kube-api-access-hbxz6\") pod \"cluster-monitoring-operator-76cf8966f8-xxpf8\" (UID: \"8fe26493-927f-4aa5-b956-80abeab6c3c0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:25.435027 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.434938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/564f2869-382f-4f38-adf1-cdb9dc89c49f-serving-cert\") pod \"service-ca-operator-5bcbc94c78-26lfl\" (UID: \"564f2869-382f-4f38-adf1-cdb9dc89c49f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl"
Jul 21 04:08:25.435027 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.435019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9ncc\" (UniqueName: \"kubernetes.io/projected/027f6098-1f1e-419c-b295-70e9707e53fc-kube-api-access-l9ncc\") pod \"volume-data-source-validator-78cf4c6f6-cfp86\" (UID: \"027f6098-1f1e-419c-b295-70e9707e53fc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-cfp86"
Jul 21 04:08:25.435135 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.435052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xxpf8\" (UID: \"8fe26493-927f-4aa5-b956-80abeab6c3c0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:25.435135 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.435080    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/564f2869-382f-4f38-adf1-cdb9dc89c49f-config\") pod \"service-ca-operator-5bcbc94c78-26lfl\" (UID: \"564f2869-382f-4f38-adf1-cdb9dc89c49f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl"
Jul 21 04:08:25.435234 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.435141    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8fe26493-927f-4aa5-b956-80abeab6c3c0-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-xxpf8\" (UID: \"8fe26493-927f-4aa5-b956-80abeab6c3c0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:25.435234 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.435198    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5wq7\" (UniqueName: \"kubernetes.io/projected/564f2869-382f-4f38-adf1-cdb9dc89c49f-kube-api-access-v5wq7\") pod \"service-ca-operator-5bcbc94c78-26lfl\" (UID: \"564f2869-382f-4f38-adf1-cdb9dc89c49f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl"
Jul 21 04:08:25.435234 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.435219    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d93cf6b-302c-4d96-804a-407807242d91-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-7527g\" (UID: \"3d93cf6b-302c-4d96-804a-407807242d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g"
Jul 21 04:08:25.435380 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.435297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d93cf6b-302c-4d96-804a-407807242d91-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-7527g\" (UID: \"3d93cf6b-302c-4d96-804a-407807242d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g"
Jul 21 04:08:25.435380 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.435322    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5rtc\" (UniqueName: \"kubernetes.io/projected/3d93cf6b-302c-4d96-804a-407807242d91-kube-api-access-w5rtc\") pod \"kube-storage-version-migrator-operator-7658d9b749-7527g\" (UID: \"3d93cf6b-302c-4d96-804a-407807242d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g"
Jul 21 04:08:25.436387 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.436365    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 04:08:25.436536 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.436475    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-9wdf7"]
Jul 21 04:08:25.436598 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.436584    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 21 04:08:25.436768 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.436597    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 21 04:08:25.436768 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.436612    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 04:08:25.436884 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.436856    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 21 04:08:25.436962 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.436945    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 21 04:08:25.437140 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.437123    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kxmw9\""
Jul 21 04:08:25.441806 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.441780    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 21 04:08:25.452569 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.452546    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-mv7hd"]
Jul 21 04:08:25.453340 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.453324    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67ff98b5c4-fp7md"]
Jul 21 04:08:25.536279 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536257    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67b08428-7730-43a8-8d66-28faefc2897d-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.536380 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d93cf6b-302c-4d96-804a-407807242d91-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-7527g\" (UID: \"3d93cf6b-302c-4d96-804a-407807242d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g"
Jul 21 04:08:25.536380 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9ncc\" (UniqueName: \"kubernetes.io/projected/027f6098-1f1e-419c-b295-70e9707e53fc-kube-api-access-l9ncc\") pod \"volume-data-source-validator-78cf4c6f6-cfp86\" (UID: \"027f6098-1f1e-419c-b295-70e9707e53fc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-cfp86"
Jul 21 04:08:25.536380 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536327    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/564f2869-382f-4f38-adf1-cdb9dc89c49f-config\") pod \"service-ca-operator-5bcbc94c78-26lfl\" (UID: \"564f2869-382f-4f38-adf1-cdb9dc89c49f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl"
Jul 21 04:08:25.536545 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536448    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5wq7\" (UniqueName: \"kubernetes.io/projected/564f2869-382f-4f38-adf1-cdb9dc89c49f-kube-api-access-v5wq7\") pod \"service-ca-operator-5bcbc94c78-26lfl\" (UID: \"564f2869-382f-4f38-adf1-cdb9dc89c49f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl"
Jul 21 04:08:25.536545 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67b08428-7730-43a8-8d66-28faefc2897d-serving-cert\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.536545 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8fe26493-927f-4aa5-b956-80abeab6c3c0-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-xxpf8\" (UID: \"8fe26493-927f-4aa5-b956-80abeab6c3c0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:25.536718 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbxz6\" (UniqueName: \"kubernetes.io/projected/8fe26493-927f-4aa5-b956-80abeab6c3c0-kube-api-access-hbxz6\") pod \"cluster-monitoring-operator-76cf8966f8-xxpf8\" (UID: \"8fe26493-927f-4aa5-b956-80abeab6c3c0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:25.536718 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:25.536828 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22zc2\" (UniqueName: \"kubernetes.io/projected/2f52a14b-47ab-48da-9568-1f640c041329-kube-api-access-22zc2\") pod \"network-check-source-7bc5b6bf85-9wdf7\" (UID: \"2f52a14b-47ab-48da-9568-1f640c041329\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9wdf7"
Jul 21 04:08:25.536828 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536754    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5rtc\" (UniqueName: \"kubernetes.io/projected/3d93cf6b-302c-4d96-804a-407807242d91-kube-api-access-w5rtc\") pod \"kube-storage-version-migrator-operator-7658d9b749-7527g\" (UID: \"3d93cf6b-302c-4d96-804a-407807242d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g"
Jul 21 04:08:25.536828 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bp4j\" (UniqueName: \"kubernetes.io/projected/436cc13a-cd45-44db-9a69-54a1e68cfbce-kube-api-access-5bp4j\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:25.536828 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536815    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xxpf8\" (UID: \"8fe26493-927f-4aa5-b956-80abeab6c3c0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:25.537019 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-stats-auth\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:25.537019 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-default-certificate\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:25.537019 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:25.536911    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 04:08:25.537019 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536933    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d93cf6b-302c-4d96-804a-407807242d91-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-7527g\" (UID: \"3d93cf6b-302c-4d96-804a-407807242d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g"
Jul 21 04:08:25.537019 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:25.536972    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls podName:8fe26493-927f-4aa5-b956-80abeab6c3c0 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:26.036955951 +0000 UTC m=+255.854522715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xxpf8" (UID: "8fe26493-927f-4aa5-b956-80abeab6c3c0") : secret "cluster-monitoring-operator-tls" not found
Jul 21 04:08:25.537019 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536971    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/564f2869-382f-4f38-adf1-cdb9dc89c49f-config\") pod \"service-ca-operator-5bcbc94c78-26lfl\" (UID: \"564f2869-382f-4f38-adf1-cdb9dc89c49f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl"
Jul 21 04:08:25.537019 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.536999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67b08428-7730-43a8-8d66-28faefc2897d-service-ca-bundle\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.537299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.537055    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/67b08428-7730-43a8-8d66-28faefc2897d-snapshots\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.537299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.537076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pwjk\" (UniqueName: \"kubernetes.io/projected/67b08428-7730-43a8-8d66-28faefc2897d-kube-api-access-8pwjk\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.537299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.537092    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:25.537299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.537107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67b08428-7730-43a8-8d66-28faefc2897d-tmp\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.537299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.537127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/564f2869-382f-4f38-adf1-cdb9dc89c49f-serving-cert\") pod \"service-ca-operator-5bcbc94c78-26lfl\" (UID: \"564f2869-382f-4f38-adf1-cdb9dc89c49f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl"
Jul 21 04:08:25.537440 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.537301    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8fe26493-927f-4aa5-b956-80abeab6c3c0-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-xxpf8\" (UID: \"8fe26493-927f-4aa5-b956-80abeab6c3c0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:25.537475 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.537449    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d93cf6b-302c-4d96-804a-407807242d91-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-7527g\" (UID: \"3d93cf6b-302c-4d96-804a-407807242d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g"
Jul 21 04:08:25.538617 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.538598    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d93cf6b-302c-4d96-804a-407807242d91-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-7527g\" (UID: \"3d93cf6b-302c-4d96-804a-407807242d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g"
Jul 21 04:08:25.539153 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.539139    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/564f2869-382f-4f38-adf1-cdb9dc89c49f-serving-cert\") pod \"service-ca-operator-5bcbc94c78-26lfl\" (UID: \"564f2869-382f-4f38-adf1-cdb9dc89c49f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl"
Jul 21 04:08:25.546624 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.546598    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5wq7\" (UniqueName: \"kubernetes.io/projected/564f2869-382f-4f38-adf1-cdb9dc89c49f-kube-api-access-v5wq7\") pod \"service-ca-operator-5bcbc94c78-26lfl\" (UID: \"564f2869-382f-4f38-adf1-cdb9dc89c49f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl"
Jul 21 04:08:25.546823 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.546804    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5rtc\" (UniqueName: \"kubernetes.io/projected/3d93cf6b-302c-4d96-804a-407807242d91-kube-api-access-w5rtc\") pod \"kube-storage-version-migrator-operator-7658d9b749-7527g\" (UID: \"3d93cf6b-302c-4d96-804a-407807242d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g"
Jul 21 04:08:25.547075 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.547056    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9ncc\" (UniqueName: \"kubernetes.io/projected/027f6098-1f1e-419c-b295-70e9707e53fc-kube-api-access-l9ncc\") pod \"volume-data-source-validator-78cf4c6f6-cfp86\" (UID: \"027f6098-1f1e-419c-b295-70e9707e53fc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-cfp86"
Jul 21 04:08:25.549380 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.549361    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbxz6\" (UniqueName: \"kubernetes.io/projected/8fe26493-927f-4aa5-b956-80abeab6c3c0-kube-api-access-hbxz6\") pod \"cluster-monitoring-operator-76cf8966f8-xxpf8\" (UID: \"8fe26493-927f-4aa5-b956-80abeab6c3c0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:25.638004 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.637956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22zc2\" (UniqueName: \"kubernetes.io/projected/2f52a14b-47ab-48da-9568-1f640c041329-kube-api-access-22zc2\") pod \"network-check-source-7bc5b6bf85-9wdf7\" (UID: \"2f52a14b-47ab-48da-9568-1f640c041329\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9wdf7"
Jul 21 04:08:25.638004 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.637985    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bp4j\" (UniqueName: \"kubernetes.io/projected/436cc13a-cd45-44db-9a69-54a1e68cfbce-kube-api-access-5bp4j\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:25.638148 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.638006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-stats-auth\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:25.638148 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.638029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-default-certificate\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:25.638148 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.638048    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67b08428-7730-43a8-8d66-28faefc2897d-service-ca-bundle\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.638148 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.638079    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/67b08428-7730-43a8-8d66-28faefc2897d-snapshots\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.638148 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.638105    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pwjk\" (UniqueName: \"kubernetes.io/projected/67b08428-7730-43a8-8d66-28faefc2897d-kube-api-access-8pwjk\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.638405 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.638188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:25.638405 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.638247    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67b08428-7730-43a8-8d66-28faefc2897d-tmp\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.638405 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.638309    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67b08428-7730-43a8-8d66-28faefc2897d-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.638405 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:25.638340    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 04:08:25.638405 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.638370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67b08428-7730-43a8-8d66-28faefc2897d-serving-cert\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.638405 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:25.638401    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs podName:436cc13a-cd45-44db-9a69-54a1e68cfbce nodeName:}" failed. No retries permitted until 2026-07-21 04:08:26.138385015 +0000 UTC m=+255.955951776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs") pod "router-default-67ff98b5c4-fp7md" (UID: "436cc13a-cd45-44db-9a69-54a1e68cfbce") : secret "router-metrics-certs-default" not found
Jul 21 04:08:25.638905 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.638452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:25.638905 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:25.638553    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle podName:436cc13a-cd45-44db-9a69-54a1e68cfbce nodeName:}" failed. No retries permitted until 2026-07-21 04:08:26.138539472 +0000 UTC m=+255.956106253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle") pod "router-default-67ff98b5c4-fp7md" (UID: "436cc13a-cd45-44db-9a69-54a1e68cfbce") : configmap references non-existent config key: service-ca.crt
Jul 21 04:08:25.638905 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.638620    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67b08428-7730-43a8-8d66-28faefc2897d-service-ca-bundle\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.638905 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.638834    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67b08428-7730-43a8-8d66-28faefc2897d-tmp\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.638905 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.638842    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/67b08428-7730-43a8-8d66-28faefc2897d-snapshots\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.639718 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.639694    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67b08428-7730-43a8-8d66-28faefc2897d-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.639718 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.639715    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl"
Jul 21 04:08:25.640332 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.640313    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-stats-auth\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:25.640587 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.640573    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67b08428-7730-43a8-8d66-28faefc2897d-serving-cert\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.640935 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.640920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-default-certificate\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:25.647399 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.647362    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pwjk\" (UniqueName: \"kubernetes.io/projected/67b08428-7730-43a8-8d66-28faefc2897d-kube-api-access-8pwjk\") pod \"insights-operator-555d9d7885-mv7hd\" (UID: \"67b08428-7730-43a8-8d66-28faefc2897d\") " pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.647559 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.647534    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bp4j\" (UniqueName: \"kubernetes.io/projected/436cc13a-cd45-44db-9a69-54a1e68cfbce-kube-api-access-5bp4j\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:25.647716 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.647611    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-cfp86"
Jul 21 04:08:25.647716 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.647695    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22zc2\" (UniqueName: \"kubernetes.io/projected/2f52a14b-47ab-48da-9568-1f640c041329-kube-api-access-22zc2\") pod \"network-check-source-7bc5b6bf85-9wdf7\" (UID: \"2f52a14b-47ab-48da-9568-1f640c041329\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9wdf7"
Jul 21 04:08:25.660170 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.660152    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g"
Jul 21 04:08:25.732444 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.731918    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9wdf7"
Jul 21 04:08:25.741295 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.741239    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-mv7hd"
Jul 21 04:08:25.785580 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.785493    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl"]
Jul 21 04:08:25.790350 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:08:25.790291    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564f2869_382f_4f38_adf1_cdb9dc89c49f.slice/crio-b49da773b130b41e6fbb2d96238213826a077189192fd75800278dc45ed1a076 WatchSource:0}: Error finding container b49da773b130b41e6fbb2d96238213826a077189192fd75800278dc45ed1a076: Status 404 returned error can't find the container with id b49da773b130b41e6fbb2d96238213826a077189192fd75800278dc45ed1a076
Jul 21 04:08:25.887036 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.886994    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-9wdf7"]
Jul 21 04:08:25.889355 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:08:25.889307    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f52a14b_47ab_48da_9568_1f640c041329.slice/crio-c1aad679c48482ec9b744ff0a44ea7b43ada306881a8c80d28c73b63b65306b5 WatchSource:0}: Error finding container c1aad679c48482ec9b744ff0a44ea7b43ada306881a8c80d28c73b63b65306b5: Status 404 returned error can't find the container with id c1aad679c48482ec9b744ff0a44ea7b43ada306881a8c80d28c73b63b65306b5
Jul 21 04:08:25.893118 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:25.893093    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-mv7hd"]
Jul 21 04:08:25.895907 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:08:25.895869    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b08428_7730_43a8_8d66_28faefc2897d.slice/crio-544a4c5159d266a484aeca0dae614ba44ad0fc4ebc0de77db8d09f33a01ecbbf WatchSource:0}: Error finding container 544a4c5159d266a484aeca0dae614ba44ad0fc4ebc0de77db8d09f33a01ecbbf: Status 404 returned error can't find the container with id 544a4c5159d266a484aeca0dae614ba44ad0fc4ebc0de77db8d09f33a01ecbbf
Jul 21 04:08:26.011839 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:26.011810    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g"]
Jul 21 04:08:26.014035 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:26.014011    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-cfp86"]
Jul 21 04:08:26.014447 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:08:26.014424    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d93cf6b_302c_4d96_804a_407807242d91.slice/crio-9c5b2f69a9669781fa374a5e944ffca219e0e9e5ccca050b3ad879f082b54ad8 WatchSource:0}: Error finding container 9c5b2f69a9669781fa374a5e944ffca219e0e9e5ccca050b3ad879f082b54ad8: Status 404 returned error can't find the container with id 9c5b2f69a9669781fa374a5e944ffca219e0e9e5ccca050b3ad879f082b54ad8
Jul 21 04:08:26.017183 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:08:26.017154    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027f6098_1f1e_419c_b295_70e9707e53fc.slice/crio-95dc65aed5fa1433cf72010fb447d2f49db62513810aa9d02f9433254107a7cf WatchSource:0}: Error finding container 95dc65aed5fa1433cf72010fb447d2f49db62513810aa9d02f9433254107a7cf: Status 404 returned error can't find the container with id 95dc65aed5fa1433cf72010fb447d2f49db62513810aa9d02f9433254107a7cf
Jul 21 04:08:26.040338 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:26.040316    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xxpf8\" (UID: \"8fe26493-927f-4aa5-b956-80abeab6c3c0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:26.040486 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:26.040472    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 04:08:26.040536 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:26.040528    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls podName:8fe26493-927f-4aa5-b956-80abeab6c3c0 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:27.040511529 +0000 UTC m=+256.858078292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xxpf8" (UID: "8fe26493-927f-4aa5-b956-80abeab6c3c0") : secret "cluster-monitoring-operator-tls" not found
Jul 21 04:08:26.141028 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:26.140979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:26.141117 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:26.141043    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:26.141156 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:26.141141    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle podName:436cc13a-cd45-44db-9a69-54a1e68cfbce nodeName:}" failed. No retries permitted until 2026-07-21 04:08:27.141125728 +0000 UTC m=+256.958692490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle") pod "router-default-67ff98b5c4-fp7md" (UID: "436cc13a-cd45-44db-9a69-54a1e68cfbce") : configmap references non-existent config key: service-ca.crt
Jul 21 04:08:26.141156 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:26.141145    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 04:08:26.141225 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:26.141188    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs podName:436cc13a-cd45-44db-9a69-54a1e68cfbce nodeName:}" failed. No retries permitted until 2026-07-21 04:08:27.141174175 +0000 UTC m=+256.958740938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs") pod "router-default-67ff98b5c4-fp7md" (UID: "436cc13a-cd45-44db-9a69-54a1e68cfbce") : secret "router-metrics-certs-default" not found
Jul 21 04:08:26.417153 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:26.417079    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl" event={"ID":"564f2869-382f-4f38-adf1-cdb9dc89c49f","Type":"ContainerStarted","Data":"b49da773b130b41e6fbb2d96238213826a077189192fd75800278dc45ed1a076"}
Jul 21 04:08:26.418211 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:26.418183    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g" event={"ID":"3d93cf6b-302c-4d96-804a-407807242d91","Type":"ContainerStarted","Data":"9c5b2f69a9669781fa374a5e944ffca219e0e9e5ccca050b3ad879f082b54ad8"}
Jul 21 04:08:26.419271 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:26.419248    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-mv7hd" event={"ID":"67b08428-7730-43a8-8d66-28faefc2897d","Type":"ContainerStarted","Data":"544a4c5159d266a484aeca0dae614ba44ad0fc4ebc0de77db8d09f33a01ecbbf"}
Jul 21 04:08:26.420514 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:26.420493    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9wdf7" event={"ID":"2f52a14b-47ab-48da-9568-1f640c041329","Type":"ContainerStarted","Data":"eb49956b94469f82bc476b239f38c68b75712739b6d0567d39258016c321573c"}
Jul 21 04:08:26.420606 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:26.420526    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9wdf7" event={"ID":"2f52a14b-47ab-48da-9568-1f640c041329","Type":"ContainerStarted","Data":"c1aad679c48482ec9b744ff0a44ea7b43ada306881a8c80d28c73b63b65306b5"}
Jul 21 04:08:26.421654 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:26.421615    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-cfp86" event={"ID":"027f6098-1f1e-419c-b295-70e9707e53fc","Type":"ContainerStarted","Data":"95dc65aed5fa1433cf72010fb447d2f49db62513810aa9d02f9433254107a7cf"}
Jul 21 04:08:26.436944 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:26.436866    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9wdf7" podStartSLOduration=1.436847395 podStartE2EDuration="1.436847395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:08:26.435992326 +0000 UTC m=+256.253559112" watchObservedRunningTime="2026-07-21 04:08:26.436847395 +0000 UTC m=+256.254414179"
Jul 21 04:08:27.048612 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:27.048572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xxpf8\" (UID: \"8fe26493-927f-4aa5-b956-80abeab6c3c0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:27.048822 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:27.048800    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 04:08:27.048896 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:27.048873    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls podName:8fe26493-927f-4aa5-b956-80abeab6c3c0 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:29.048854796 +0000 UTC m=+258.866421574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xxpf8" (UID: "8fe26493-927f-4aa5-b956-80abeab6c3c0") : secret "cluster-monitoring-operator-tls" not found
Jul 21 04:08:27.149846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:27.149591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:27.149846 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:27.149726    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:27.150065 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:27.149847    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 04:08:27.150065 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:27.149923    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs podName:436cc13a-cd45-44db-9a69-54a1e68cfbce nodeName:}" failed. No retries permitted until 2026-07-21 04:08:29.149902605 +0000 UTC m=+258.967469382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs") pod "router-default-67ff98b5c4-fp7md" (UID: "436cc13a-cd45-44db-9a69-54a1e68cfbce") : secret "router-metrics-certs-default" not found
Jul 21 04:08:27.150065 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:27.149942    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle podName:436cc13a-cd45-44db-9a69-54a1e68cfbce nodeName:}" failed. No retries permitted until 2026-07-21 04:08:29.149933008 +0000 UTC m=+258.967499781 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle") pod "router-default-67ff98b5c4-fp7md" (UID: "436cc13a-cd45-44db-9a69-54a1e68cfbce") : configmap references non-existent config key: service-ca.crt
Jul 21 04:08:28.432456 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:28.432418    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-cfp86" event={"ID":"027f6098-1f1e-419c-b295-70e9707e53fc","Type":"ContainerStarted","Data":"7a9cebb7d2f0e3b783d9bec41533f5c0bf5ab6af02ecf3d209026f38b299b305"}
Jul 21 04:08:28.448779 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:28.448730    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-cfp86" podStartSLOduration=2.018623916 podStartE2EDuration="3.448708047s" totalImagesPullingTime="1.430084131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:08:28.448036585 +0000 UTC m=+258.265603370" watchObservedRunningTime="2026-07-21 04:08:28.448708047 +0000 UTC m=+258.266274832"
Jul 21 04:08:29.066439 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:29.066392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xxpf8\" (UID: \"8fe26493-927f-4aa5-b956-80abeab6c3c0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:29.066617 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:29.066543    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 04:08:29.066617 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:29.066609    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls podName:8fe26493-927f-4aa5-b956-80abeab6c3c0 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:33.066593114 +0000 UTC m=+262.884159876 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xxpf8" (UID: "8fe26493-927f-4aa5-b956-80abeab6c3c0") : secret "cluster-monitoring-operator-tls" not found
Jul 21 04:08:29.167557 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:29.167519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:29.167751 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:29.167666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:29.167751 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:29.167733    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle podName:436cc13a-cd45-44db-9a69-54a1e68cfbce nodeName:}" failed. No retries permitted until 2026-07-21 04:08:33.167708585 +0000 UTC m=+262.985275346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle") pod "router-default-67ff98b5c4-fp7md" (UID: "436cc13a-cd45-44db-9a69-54a1e68cfbce") : configmap references non-existent config key: service-ca.crt
Jul 21 04:08:29.167878 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:29.167794    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 04:08:29.167878 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:29.167849    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs podName:436cc13a-cd45-44db-9a69-54a1e68cfbce nodeName:}" failed. No retries permitted until 2026-07-21 04:08:33.16783134 +0000 UTC m=+262.985398109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs") pod "router-default-67ff98b5c4-fp7md" (UID: "436cc13a-cd45-44db-9a69-54a1e68cfbce") : secret "router-metrics-certs-default" not found
Jul 21 04:08:29.437807 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:29.437773    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g" event={"ID":"3d93cf6b-302c-4d96-804a-407807242d91","Type":"ContainerStarted","Data":"e8c1dfb4c73c9c8e08fbdece0c7970f537dd2214656aa091f96cd70514afab1a"}
Jul 21 04:08:29.439499 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:29.439474    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-mv7hd" event={"ID":"67b08428-7730-43a8-8d66-28faefc2897d","Type":"ContainerStarted","Data":"3a916d713b6de2b753c53f578e05fc1eb95401575a9f71b20424634d3cafa1a9"}
Jul 21 04:08:29.441073 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:29.441044    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl" event={"ID":"564f2869-382f-4f38-adf1-cdb9dc89c49f","Type":"ContainerStarted","Data":"89b0433879bdb01adb82fe23df8cfba80b63802dae2eb48c649ed3f0a665209b"}
Jul 21 04:08:29.453574 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:29.453527    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g" podStartSLOduration=1.203374339 podStartE2EDuration="4.453511355s" totalImagesPullingTime="3.250137016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:08:29.452873809 +0000 UTC m=+259.270440595" watchObservedRunningTime="2026-07-21 04:08:29.453511355 +0000 UTC m=+259.271078138"
Jul 21 04:08:29.468110 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:29.468065    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-mv7hd" podStartSLOduration=1.101103378 podStartE2EDuration="4.468045849s" totalImagesPullingTime="3.366942471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:08:29.46696184 +0000 UTC m=+259.284528624" watchObservedRunningTime="2026-07-21 04:08:29.468045849 +0000 UTC m=+259.285612634"
Jul 21 04:08:29.482135 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:29.482092    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl" podStartSLOduration=1.014950728 podStartE2EDuration="4.482077476s" totalImagesPullingTime="3.467126748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:08:29.481175278 +0000 UTC m=+259.298742067" watchObservedRunningTime="2026-07-21 04:08:29.482077476 +0000 UTC m=+259.299644261"
Jul 21 04:08:31.501884 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.501853    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vbmsp"]
Jul 21 04:08:31.504330 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.504309    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:31.507550 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.507528    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 04:08:31.507831 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.507804    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nz9gm\""
Jul 21 04:08:31.508467 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.508403    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 04:08:31.520497 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.520433    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vbmsp"]
Jul 21 04:08:31.589814 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.589785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:31.589931 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.589827    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-crio-socket\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:31.590022 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.589995    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbfhl\" (UniqueName: \"kubernetes.io/projected/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-api-access-rbfhl\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:31.590089 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.590056    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-data-volume\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:31.590143 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.590109    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:31.691195 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.691167    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbfhl\" (UniqueName: \"kubernetes.io/projected/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-api-access-rbfhl\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:31.691323 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.691204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-data-volume\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:31.691323 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.691236    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:31.691323 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:31.691319    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:31.691474 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.691373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:31.691474 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:31.691383    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls podName:2d645950-68ef-4f41-a8f7-a06ff94bc3cb nodeName:}" failed. No retries permitted until 2026-07-21 04:08:32.191367184 +0000 UTC m=+262.008933951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vbmsp" (UID: "2d645950-68ef-4f41-a8f7-a06ff94bc3cb") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:31.691474 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.691416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-crio-socket\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:31.691626 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:31.691518    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:08:31.691626 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.691564    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-data-volume\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:31.691626 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:31.691575    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm podName:2d645950-68ef-4f41-a8f7-a06ff94bc3cb nodeName:}" failed. No retries permitted until 2026-07-21 04:08:32.191558411 +0000 UTC m=+262.009125173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vbmsp" (UID: "2d645950-68ef-4f41-a8f7-a06ff94bc3cb") : configmap "kube-rbac-proxy" not found
Jul 21 04:08:31.691626 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.691597    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-crio-socket\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:31.699663 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:31.699614    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbfhl\" (UniqueName: \"kubernetes.io/projected/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-api-access-rbfhl\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:32.194666 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:32.194563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:32.194666 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:32.194619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:32.194872 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:32.194755    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:32.194872 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:32.194767    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:08:32.194872 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:32.194826    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls podName:2d645950-68ef-4f41-a8f7-a06ff94bc3cb nodeName:}" failed. No retries permitted until 2026-07-21 04:08:33.194810668 +0000 UTC m=+263.012377431 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vbmsp" (UID: "2d645950-68ef-4f41-a8f7-a06ff94bc3cb") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:32.194872 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:32.194843    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm podName:2d645950-68ef-4f41-a8f7-a06ff94bc3cb nodeName:}" failed. No retries permitted until 2026-07-21 04:08:33.194835727 +0000 UTC m=+263.012402489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vbmsp" (UID: "2d645950-68ef-4f41-a8f7-a06ff94bc3cb") : configmap "kube-rbac-proxy" not found
Jul 21 04:08:33.100861 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:33.100824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xxpf8\" (UID: \"8fe26493-927f-4aa5-b956-80abeab6c3c0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:33.101328 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:33.100955    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 04:08:33.101328 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:33.101029    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls podName:8fe26493-927f-4aa5-b956-80abeab6c3c0 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:41.101011321 +0000 UTC m=+270.918578084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xxpf8" (UID: "8fe26493-927f-4aa5-b956-80abeab6c3c0") : secret "cluster-monitoring-operator-tls" not found
Jul 21 04:08:33.201275 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:33.201248    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:33.201409 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:33.201282    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:33.201409 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:33.201329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:33.201409 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:33.201392    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle podName:436cc13a-cd45-44db-9a69-54a1e68cfbce nodeName:}" failed. No retries permitted until 2026-07-21 04:08:41.201376656 +0000 UTC m=+271.018943419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle") pod "router-default-67ff98b5c4-fp7md" (UID: "436cc13a-cd45-44db-9a69-54a1e68cfbce") : configmap references non-existent config key: service-ca.crt
Jul 21 04:08:33.201562 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:33.201426    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:08:33.201562 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:33.201429    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:33.201562 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:33.201464    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:33.201562 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:33.201474    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm podName:2d645950-68ef-4f41-a8f7-a06ff94bc3cb nodeName:}" failed. No retries permitted until 2026-07-21 04:08:35.201459657 +0000 UTC m=+265.019026432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vbmsp" (UID: "2d645950-68ef-4f41-a8f7-a06ff94bc3cb") : configmap "kube-rbac-proxy" not found
Jul 21 04:08:33.201562 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:33.201519    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 04:08:33.201562 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:33.201528    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls podName:2d645950-68ef-4f41-a8f7-a06ff94bc3cb nodeName:}" failed. No retries permitted until 2026-07-21 04:08:35.201512465 +0000 UTC m=+265.019079231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vbmsp" (UID: "2d645950-68ef-4f41-a8f7-a06ff94bc3cb") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:33.201562 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:33.201549    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs podName:436cc13a-cd45-44db-9a69-54a1e68cfbce nodeName:}" failed. No retries permitted until 2026-07-21 04:08:41.201538631 +0000 UTC m=+271.019105393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs") pod "router-default-67ff98b5c4-fp7md" (UID: "436cc13a-cd45-44db-9a69-54a1e68cfbce") : secret "router-metrics-certs-default" not found
Jul 21 04:08:34.492852 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:34.492818    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7dwjx_44ddbc6a-4723-445d-a5b9-6882cb587ba1/dns-node-resolver/0.log"
Jul 21 04:08:35.217894 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:35.217861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:35.218051 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:35.217908    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:35.218051 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:35.217996    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:08:35.218051 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:35.218015    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:35.218147 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:35.218062    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm podName:2d645950-68ef-4f41-a8f7-a06ff94bc3cb nodeName:}" failed. No retries permitted until 2026-07-21 04:08:39.218047751 +0000 UTC m=+269.035614517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vbmsp" (UID: "2d645950-68ef-4f41-a8f7-a06ff94bc3cb") : configmap "kube-rbac-proxy" not found
Jul 21 04:08:35.218147 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:35.218077    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls podName:2d645950-68ef-4f41-a8f7-a06ff94bc3cb nodeName:}" failed. No retries permitted until 2026-07-21 04:08:39.21807082 +0000 UTC m=+269.035637582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vbmsp" (UID: "2d645950-68ef-4f41-a8f7-a06ff94bc3cb") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:35.495462 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:35.495398    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b8j9r_de4cd546-b39a-405f-a0d0-91a5d42434ba/node-ca/0.log"
Jul 21 04:08:36.093481 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:36.093459    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g4cns_d0bea2dd-fbfb-4d2e-9457-9fa6f6b5608d/serve-healthcheck-canary/0.log"
Jul 21 04:08:36.894629 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:36.894586    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-7527g_3d93cf6b-302c-4d96-804a-407807242d91/kube-storage-version-migrator-operator/0.log"
Jul 21 04:08:39.250425 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:39.250395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:39.250819 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:39.250465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:39.250819 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:39.250571    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:39.250819 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:39.250603    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:08:39.250819 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:39.250632    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls podName:2d645950-68ef-4f41-a8f7-a06ff94bc3cb nodeName:}" failed. No retries permitted until 2026-07-21 04:08:47.250616372 +0000 UTC m=+277.068183136 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vbmsp" (UID: "2d645950-68ef-4f41-a8f7-a06ff94bc3cb") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:39.250819 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:39.250671    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm podName:2d645950-68ef-4f41-a8f7-a06ff94bc3cb nodeName:}" failed. No retries permitted until 2026-07-21 04:08:47.250654766 +0000 UTC m=+277.068221553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vbmsp" (UID: "2d645950-68ef-4f41-a8f7-a06ff94bc3cb") : configmap "kube-rbac-proxy" not found
Jul 21 04:08:41.163931 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:41.163898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xxpf8\" (UID: \"8fe26493-927f-4aa5-b956-80abeab6c3c0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:41.164293 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:41.164013    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 04:08:41.164293 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:41.164062    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls podName:8fe26493-927f-4aa5-b956-80abeab6c3c0 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:57.164049598 +0000 UTC m=+286.981616360 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xxpf8" (UID: "8fe26493-927f-4aa5-b956-80abeab6c3c0") : secret "cluster-monitoring-operator-tls" not found
Jul 21 04:08:41.265096 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:41.265063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:41.265235 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:41.265178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:41.265235 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:41.265213    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle podName:436cc13a-cd45-44db-9a69-54a1e68cfbce nodeName:}" failed. No retries permitted until 2026-07-21 04:08:57.265196761 +0000 UTC m=+287.082763522 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle") pod "router-default-67ff98b5c4-fp7md" (UID: "436cc13a-cd45-44db-9a69-54a1e68cfbce") : configmap references non-existent config key: service-ca.crt
Jul 21 04:08:41.265375 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:41.265284    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 04:08:41.265375 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:41.265339    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs podName:436cc13a-cd45-44db-9a69-54a1e68cfbce nodeName:}" failed. No retries permitted until 2026-07-21 04:08:57.265323056 +0000 UTC m=+287.082889820 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs") pod "router-default-67ff98b5c4-fp7md" (UID: "436cc13a-cd45-44db-9a69-54a1e68cfbce") : secret "router-metrics-certs-default" not found
Jul 21 04:08:47.312226 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:47.312188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:47.312718 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:47.312239    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:47.312718 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:47.312363    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:47.312718 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:47.312470    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls podName:2d645950-68ef-4f41-a8f7-a06ff94bc3cb nodeName:}" failed. No retries permitted until 2026-07-21 04:09:03.312448486 +0000 UTC m=+293.130015252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vbmsp" (UID: "2d645950-68ef-4f41-a8f7-a06ff94bc3cb") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:47.312917 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:47.312756    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:08:52.198273 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:52.198219    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p" podUID="f9e49fac-2682-4dc3-af73-b1f03c04d4f7"
Jul 21 04:08:52.198689 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:52.198272    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p" podUID="1e97d66b-e06f-44fe-b6e7-fe5dac50aa68"
Jul 21 04:08:52.198689 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:08:52.198273    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pjlxp" podUID="3fd3f5fb-f69c-4621-b16d-223d27a121bd"
Jul 21 04:08:52.510271 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:52.510202    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:08:52.510492 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:52.510205    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:08:52.510492 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:52.510211    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:08:56.083578 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.083535    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:08:56.083983 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.083602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4jb8p\" (UID: \"f9e49fac-2682-4dc3-af73-b1f03c04d4f7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:08:56.086044 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.086019    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls\") pod \"image-registry-5b7ddb95f7-l6j7p\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") " pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:08:56.086156 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.086056    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9e49fac-2682-4dc3-af73-b1f03c04d4f7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4jb8p\" (UID: \"f9e49fac-2682-4dc3-af73-b1f03c04d4f7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:08:56.113948 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.113925    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mkcct\""
Jul 21 04:08:56.113948 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.113925    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9q4j6\""
Jul 21 04:08:56.121905 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.121888    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"
Jul 21 04:08:56.121967 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.121912    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:08:56.185169 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.185009    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:08:56.188113 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.188058    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fd3f5fb-f69c-4621-b16d-223d27a121bd-metrics-tls\") pod \"dns-default-pjlxp\" (UID: \"3fd3f5fb-f69c-4621-b16d-223d27a121bd\") " pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:08:56.258009 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.257980    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"]
Jul 21 04:08:56.260699 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:08:56.260672    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e97d66b_e06f_44fe_b6e7_fe5dac50aa68.slice/crio-01aa337dade2590ac0578c81c6ae6026c4e447fd9aa37ea0e32cd2d4b1403c34 WatchSource:0}: Error finding container 01aa337dade2590ac0578c81c6ae6026c4e447fd9aa37ea0e32cd2d4b1403c34: Status 404 returned error can't find the container with id 01aa337dade2590ac0578c81c6ae6026c4e447fd9aa37ea0e32cd2d4b1403c34
Jul 21 04:08:56.270018 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.269982    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p"]
Jul 21 04:08:56.271765 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:08:56.271745    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e49fac_2682_4dc3_af73_b1f03c04d4f7.slice/crio-bea95ab6c1fbcb22bd553a51b06cc2344e9b518e4947ffd3835cfb262df4a4c3 WatchSource:0}: Error finding container bea95ab6c1fbcb22bd553a51b06cc2344e9b518e4947ffd3835cfb262df4a4c3: Status 404 returned error can't find the container with id bea95ab6c1fbcb22bd553a51b06cc2344e9b518e4947ffd3835cfb262df4a4c3
Jul 21 04:08:56.414065 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.413995    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m9r9d\""
Jul 21 04:08:56.421333 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.421314    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:08:56.525117 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.525031    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p" event={"ID":"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68","Type":"ContainerStarted","Data":"386fd5e0041ece385c7a29bc3ce0269c72c2500367d6d2779965e13245591ad7"}
Jul 21 04:08:56.525284 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.525125    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p" event={"ID":"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68","Type":"ContainerStarted","Data":"01aa337dade2590ac0578c81c6ae6026c4e447fd9aa37ea0e32cd2d4b1403c34"}
Jul 21 04:08:56.525284 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.525178    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:08:56.526380 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.526357    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p" event={"ID":"f9e49fac-2682-4dc3-af73-b1f03c04d4f7","Type":"ContainerStarted","Data":"bea95ab6c1fbcb22bd553a51b06cc2344e9b518e4947ffd3835cfb262df4a4c3"}
Jul 21 04:08:56.543659 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.543573    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pjlxp"]
Jul 21 04:08:56.545424 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:56.545384    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p" podStartSLOduration=284.545371952 podStartE2EDuration="4m44.545371952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:04:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:08:56.544998512 +0000 UTC m=+286.362565296" watchObservedRunningTime="2026-07-21 04:08:56.545371952 +0000 UTC m=+286.362938737"
Jul 21 04:08:56.548252 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:08:56.548228    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd3f5fb_f69c_4621_b16d_223d27a121bd.slice/crio-f88fa8d715b63ff14c04b496413e7940d4ce3ab50a8faaa6454b6cc6bc13b4f0 WatchSource:0}: Error finding container f88fa8d715b63ff14c04b496413e7940d4ce3ab50a8faaa6454b6cc6bc13b4f0: Status 404 returned error can't find the container with id f88fa8d715b63ff14c04b496413e7940d4ce3ab50a8faaa6454b6cc6bc13b4f0
Jul 21 04:08:57.194427 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:57.194390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xxpf8\" (UID: \"8fe26493-927f-4aa5-b956-80abeab6c3c0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:57.197153 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:57.197122    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe26493-927f-4aa5-b956-80abeab6c3c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xxpf8\" (UID: \"8fe26493-927f-4aa5-b956-80abeab6c3c0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:57.294990 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:57.294955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:57.295176 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:57.295044    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:57.295801 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:57.295775    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/436cc13a-cd45-44db-9a69-54a1e68cfbce-service-ca-bundle\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:57.297773 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:57.297749    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/436cc13a-cd45-44db-9a69-54a1e68cfbce-metrics-certs\") pod \"router-default-67ff98b5c4-fp7md\" (UID: \"436cc13a-cd45-44db-9a69-54a1e68cfbce\") " pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:57.454561 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:57.454474    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"
Jul 21 04:08:57.532111 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:57.532074    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pjlxp" event={"ID":"3fd3f5fb-f69c-4621-b16d-223d27a121bd","Type":"ContainerStarted","Data":"f88fa8d715b63ff14c04b496413e7940d4ce3ab50a8faaa6454b6cc6bc13b4f0"}
Jul 21 04:08:57.545672 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:57.545617    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:57.734855 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:57.734831    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8"]
Jul 21 04:08:57.745712 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:08:57.745683    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe26493_927f_4aa5_b956_80abeab6c3c0.slice/crio-d9b7c231330e77005ee761409eb90e4b76339acff931c4f0b364f8db5bee389b WatchSource:0}: Error finding container d9b7c231330e77005ee761409eb90e4b76339acff931c4f0b364f8db5bee389b: Status 404 returned error can't find the container with id d9b7c231330e77005ee761409eb90e4b76339acff931c4f0b364f8db5bee389b
Jul 21 04:08:57.760893 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:57.760830    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67ff98b5c4-fp7md"]
Jul 21 04:08:57.763627 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:08:57.763600    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436cc13a_cd45_44db_9a69_54a1e68cfbce.slice/crio-d03266a23ec590a3abc9322a920d2df02f9f039e483b118b906729c903d43253 WatchSource:0}: Error finding container d03266a23ec590a3abc9322a920d2df02f9f039e483b118b906729c903d43253: Status 404 returned error can't find the container with id d03266a23ec590a3abc9322a920d2df02f9f039e483b118b906729c903d43253
Jul 21 04:08:58.537700 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:58.537617    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p" event={"ID":"f9e49fac-2682-4dc3-af73-b1f03c04d4f7","Type":"ContainerStarted","Data":"18cf10761ff82c338291d139f84d4c02c9be1630c02c19c25d03907a73ffca32"}
Jul 21 04:08:58.539372 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:58.539335    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67ff98b5c4-fp7md" event={"ID":"436cc13a-cd45-44db-9a69-54a1e68cfbce","Type":"ContainerStarted","Data":"6ef9cbbb8396a2981ec8f667f34b75b0341efa9115a8c987f0f498b5229af06a"}
Jul 21 04:08:58.539501 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:58.539379    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67ff98b5c4-fp7md" event={"ID":"436cc13a-cd45-44db-9a69-54a1e68cfbce","Type":"ContainerStarted","Data":"d03266a23ec590a3abc9322a920d2df02f9f039e483b118b906729c903d43253"}
Jul 21 04:08:58.540529 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:58.540506    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8" event={"ID":"8fe26493-927f-4aa5-b956-80abeab6c3c0","Type":"ContainerStarted","Data":"d9b7c231330e77005ee761409eb90e4b76339acff931c4f0b364f8db5bee389b"}
Jul 21 04:08:58.545796 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:58.545771    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:58.548591 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:58.548569    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:58.554277 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:58.554240    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4jb8p" podStartSLOduration=275.178160979 podStartE2EDuration="4m36.554226899s" totalImagesPullingTime="1.37606592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:08:58.553669337 +0000 UTC m=+288.371236119" watchObservedRunningTime="2026-07-21 04:08:58.554226899 +0000 UTC m=+288.371793682"
Jul 21 04:08:58.572288 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:58.572230    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-67ff98b5c4-fp7md" podStartSLOduration=33.572214869 podStartE2EDuration="33.572214869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:08:58.571631445 +0000 UTC m=+288.389198230" watchObservedRunningTime="2026-07-21 04:08:58.572214869 +0000 UTC m=+288.389781653"
Jul 21 04:08:59.546125 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:59.546088    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pjlxp" event={"ID":"3fd3f5fb-f69c-4621-b16d-223d27a121bd","Type":"ContainerStarted","Data":"f067d77afd20a73bf18b38bd21a490b01b5e516af7eebc349e98217ddc6e6de3"}
Jul 21 04:08:59.546537 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:59.546142    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pjlxp" event={"ID":"3fd3f5fb-f69c-4621-b16d-223d27a121bd","Type":"ContainerStarted","Data":"87fd19b133dab60ffc6bb6f99512d3d63cfa5049e2cf49cbc6f8bf7e078fc6fe"}
Jul 21 04:08:59.546537 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:59.546389    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:59.547608 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:59.547586    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-67ff98b5c4-fp7md"
Jul 21 04:08:59.564279 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:08:59.564228    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pjlxp" podStartSLOduration=251.132754074 podStartE2EDuration="4m13.564208599s" totalImagesPullingTime="2.431454525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:04:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:08:59.563005889 +0000 UTC m=+289.380572686" watchObservedRunningTime="2026-07-21 04:08:59.564208599 +0000 UTC m=+289.381775385"
Jul 21 04:09:00.555308 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:00.555272    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8" event={"ID":"8fe26493-927f-4aa5-b956-80abeab6c3c0","Type":"ContainerStarted","Data":"b504a0d46d12b4ed03934e05e933a4eae1aa83880b7f4293952e67318babfaf4"}
Jul 21 04:09:00.555696 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:00.555541    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:09:00.574408 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:00.574360    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xxpf8" podStartSLOduration=32.836268826 podStartE2EDuration="35.574345813s" totalImagesPullingTime="2.738076987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:00.574239148 +0000 UTC m=+290.391805933" watchObservedRunningTime="2026-07-21 04:09:00.574345813 +0000 UTC m=+290.391912598"
Jul 21 04:09:03.342708 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:03.342671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:09:03.345164 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:03.345143    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d645950-68ef-4f41-a8f7-a06ff94bc3cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbmsp\" (UID: \"2d645950-68ef-4f41-a8f7-a06ff94bc3cb\") " pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:09:03.614573 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:03.614505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vbmsp"
Jul 21 04:09:03.773147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:03.773123    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vbmsp"]
Jul 21 04:09:03.775387 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:09:03.775357    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d645950_68ef_4f41_a8f7_a06ff94bc3cb.slice/crio-a768e7289c9b0a7dd7955f42c15b70feb63db8b515bdd5834a64b1e8484f08ab WatchSource:0}: Error finding container a768e7289c9b0a7dd7955f42c15b70feb63db8b515bdd5834a64b1e8484f08ab: Status 404 returned error can't find the container with id a768e7289c9b0a7dd7955f42c15b70feb63db8b515bdd5834a64b1e8484f08ab
Jul 21 04:09:04.569485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:04.569425    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbmsp" event={"ID":"2d645950-68ef-4f41-a8f7-a06ff94bc3cb","Type":"ContainerStarted","Data":"a768e7289c9b0a7dd7955f42c15b70feb63db8b515bdd5834a64b1e8484f08ab"}
Jul 21 04:09:05.098398 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.098369    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"]
Jul 21 04:09:05.100419 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.100400    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"
Jul 21 04:09:05.102950 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.102926    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 21 04:09:05.103762 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.103742    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 04:09:05.103872 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.103765    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hg885\""
Jul 21 04:09:05.103872 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.103769    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 21 04:09:05.110068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.110046    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"]
Jul 21 04:09:05.256900 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.256860    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b7356d6-a4e6-4448-bbaa-ec3941a108e7-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-x8kkr\" (UID: \"1b7356d6-a4e6-4448-bbaa-ec3941a108e7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"
Jul 21 04:09:05.257063 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.256913    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsh25\" (UniqueName: \"kubernetes.io/projected/1b7356d6-a4e6-4448-bbaa-ec3941a108e7-kube-api-access-hsh25\") pod \"prometheus-operator-5945b5cfd-x8kkr\" (UID: \"1b7356d6-a4e6-4448-bbaa-ec3941a108e7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"
Jul 21 04:09:05.257063 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.256941    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b7356d6-a4e6-4448-bbaa-ec3941a108e7-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-x8kkr\" (UID: \"1b7356d6-a4e6-4448-bbaa-ec3941a108e7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"
Jul 21 04:09:05.257063 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.257039    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b7356d6-a4e6-4448-bbaa-ec3941a108e7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-x8kkr\" (UID: \"1b7356d6-a4e6-4448-bbaa-ec3941a108e7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"
Jul 21 04:09:05.357947 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.357859    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b7356d6-a4e6-4448-bbaa-ec3941a108e7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-x8kkr\" (UID: \"1b7356d6-a4e6-4448-bbaa-ec3941a108e7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"
Jul 21 04:09:05.357947 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.357929    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b7356d6-a4e6-4448-bbaa-ec3941a108e7-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-x8kkr\" (UID: \"1b7356d6-a4e6-4448-bbaa-ec3941a108e7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"
Jul 21 04:09:05.358141 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.357965    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsh25\" (UniqueName: \"kubernetes.io/projected/1b7356d6-a4e6-4448-bbaa-ec3941a108e7-kube-api-access-hsh25\") pod \"prometheus-operator-5945b5cfd-x8kkr\" (UID: \"1b7356d6-a4e6-4448-bbaa-ec3941a108e7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"
Jul 21 04:09:05.358141 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.357992    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b7356d6-a4e6-4448-bbaa-ec3941a108e7-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-x8kkr\" (UID: \"1b7356d6-a4e6-4448-bbaa-ec3941a108e7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"
Jul 21 04:09:05.358141 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:09:05.358117    2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 21 04:09:05.358361 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:09:05.358187    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b7356d6-a4e6-4448-bbaa-ec3941a108e7-prometheus-operator-tls podName:1b7356d6-a4e6-4448-bbaa-ec3941a108e7 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:05.858168112 +0000 UTC m=+295.675734891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1b7356d6-a4e6-4448-bbaa-ec3941a108e7-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-x8kkr" (UID: "1b7356d6-a4e6-4448-bbaa-ec3941a108e7") : secret "prometheus-operator-tls" not found
Jul 21 04:09:05.358804 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.358778    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b7356d6-a4e6-4448-bbaa-ec3941a108e7-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-x8kkr\" (UID: \"1b7356d6-a4e6-4448-bbaa-ec3941a108e7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"
Jul 21 04:09:05.360698 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.360666    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b7356d6-a4e6-4448-bbaa-ec3941a108e7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-x8kkr\" (UID: \"1b7356d6-a4e6-4448-bbaa-ec3941a108e7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"
Jul 21 04:09:05.366887 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.366864    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsh25\" (UniqueName: \"kubernetes.io/projected/1b7356d6-a4e6-4448-bbaa-ec3941a108e7-kube-api-access-hsh25\") pod \"prometheus-operator-5945b5cfd-x8kkr\" (UID: \"1b7356d6-a4e6-4448-bbaa-ec3941a108e7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"
Jul 21 04:09:05.861940 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.861911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b7356d6-a4e6-4448-bbaa-ec3941a108e7-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-x8kkr\" (UID: \"1b7356d6-a4e6-4448-bbaa-ec3941a108e7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"
Jul 21 04:09:05.864813 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:05.864781    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b7356d6-a4e6-4448-bbaa-ec3941a108e7-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-x8kkr\" (UID: \"1b7356d6-a4e6-4448-bbaa-ec3941a108e7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"
Jul 21 04:09:06.011660 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:06.011613    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"
Jul 21 04:09:07.660039 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:09:07.659993    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l5vv7" podUID="3ed75b9c-b7ed-4efd-94c5-c58c202e510b"
Jul 21 04:09:08.695427 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:08.695403    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr"]
Jul 21 04:09:08.699716 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:09:08.699686    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b7356d6_a4e6_4448_bbaa_ec3941a108e7.slice/crio-30c7df30ef8a520885df55d988f4bc0c88c4979d0817aad3a50215885df0ae18 WatchSource:0}: Error finding container 30c7df30ef8a520885df55d988f4bc0c88c4979d0817aad3a50215885df0ae18: Status 404 returned error can't find the container with id 30c7df30ef8a520885df55d988f4bc0c88c4979d0817aad3a50215885df0ae18
Jul 21 04:09:09.590689 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:09.590583    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbmsp" event={"ID":"2d645950-68ef-4f41-a8f7-a06ff94bc3cb","Type":"ContainerStarted","Data":"bf016d9e88b0b63eb15f01be525480f9b8fecd1daa44bf83ced8c0b497595745"}
Jul 21 04:09:09.592698 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:09.592665    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr" event={"ID":"1b7356d6-a4e6-4448-bbaa-ec3941a108e7","Type":"ContainerStarted","Data":"30c7df30ef8a520885df55d988f4bc0c88c4979d0817aad3a50215885df0ae18"}
Jul 21 04:09:10.560342 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:10.560280    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pjlxp"
Jul 21 04:09:10.598357 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:10.598222    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr" event={"ID":"1b7356d6-a4e6-4448-bbaa-ec3941a108e7","Type":"ContainerStarted","Data":"3eab0df9fae3b9c494f80d664385d0684982708eba46e4e82a638734bdc49b6e"}
Jul 21 04:09:12.170356 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:12.170331    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:09:12.171137 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:12.171116    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:09:12.175817 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:12.175801    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 04:09:12.264304 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:12.264284    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:09:12.607002 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:12.606968    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbmsp" event={"ID":"2d645950-68ef-4f41-a8f7-a06ff94bc3cb","Type":"ContainerStarted","Data":"88ecf3c79580fd3764d731b26bbefb3965a5124e11b25a47541ae43a2f75078d"}
Jul 21 04:09:12.608725 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:12.608700    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr" event={"ID":"1b7356d6-a4e6-4448-bbaa-ec3941a108e7","Type":"ContainerStarted","Data":"830dc072d72bc41db12094999503925e1de830e7d981c5ca714aa1a6ec297ccb"}
Jul 21 04:09:12.627167 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:12.627126    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-x8kkr" podStartSLOduration=6.184716332 podStartE2EDuration="7.627106737s" totalImagesPullingTime="1.442390405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:12.626555016 +0000 UTC m=+302.444121791" watchObservedRunningTime="2026-07-21 04:09:12.627106737 +0000 UTC m=+302.444673559"
Jul 21 04:09:14.466180 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.466149    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"]
Jul 21 04:09:14.471244 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.471189    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"
Jul 21 04:09:14.471775 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.471749    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"]
Jul 21 04:09:14.474844 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.474722    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-d5nvf\""
Jul 21 04:09:14.475339 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.475106    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 21 04:09:14.476486 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.476217    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.478516 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.478492    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 21 04:09:14.478944 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.478917    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 21 04:09:14.478944 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.478929    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 21 04:09:14.481087 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.481038    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lxxcq\""
Jul 21 04:09:14.481352 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.481329    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v67p5"]
Jul 21 04:09:14.483939 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.483025    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 21 04:09:14.488227 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.488210    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"]
Jul 21 04:09:14.488337 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.488320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.489348 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.489248    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"]
Jul 21 04:09:14.491143 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.491125    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 04:09:14.491247 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.491194    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rxcv9\""
Jul 21 04:09:14.491311 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.491261    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 04:09:14.491396 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.491362    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 04:09:14.633409 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e2140b6-737b-4cd0-b976-702af090dcd7-sys\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.633571 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/21edf1ff-3354-4aaa-923a-cf865fc7ce89-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.633571 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633450    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/21edf1ff-3354-4aaa-923a-cf865fc7ce89-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.633571 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21edf1ff-3354-4aaa-923a-cf865fc7ce89-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.633571 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e2140b6-737b-4cd0-b976-702af090dcd7-metrics-client-ca\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.633786 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633582    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m5rm\" (UniqueName: \"kubernetes.io/projected/3690b647-36d6-4ab1-820b-11cbe736a1bf-kube-api-access-4m5rm\") pod \"openshift-state-metrics-79f6958cdf-nfz8l\" (UID: \"3690b647-36d6-4ab1-820b-11cbe736a1bf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"
Jul 21 04:09:14.633786 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633602    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e2140b6-737b-4cd0-b976-702af090dcd7-root\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.633786 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633629    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-tls\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.633786 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633675    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-accelerators-collector-config\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.633786 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633699    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3690b647-36d6-4ab1-820b-11cbe736a1bf-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-nfz8l\" (UID: \"3690b647-36d6-4ab1-820b-11cbe736a1bf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"
Jul 21 04:09:14.633786 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633720    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spgqw\" (UniqueName: \"kubernetes.io/projected/21edf1ff-3354-4aaa-923a-cf865fc7ce89-kube-api-access-spgqw\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.633786 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633742    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3690b647-36d6-4ab1-820b-11cbe736a1bf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-nfz8l\" (UID: \"3690b647-36d6-4ab1-820b-11cbe736a1bf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"
Jul 21 04:09:14.633786 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633767    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-textfile\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.634112 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.634112 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633856    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3690b647-36d6-4ab1-820b-11cbe736a1bf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-nfz8l\" (UID: \"3690b647-36d6-4ab1-820b-11cbe736a1bf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"
Jul 21 04:09:14.634112 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633885    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-wtmp\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.634112 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hkjp\" (UniqueName: \"kubernetes.io/projected/0e2140b6-737b-4cd0-b976-702af090dcd7-kube-api-access-5hkjp\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.634112 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.633923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21edf1ff-3354-4aaa-923a-cf865fc7ce89-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.634112 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.634000    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21edf1ff-3354-4aaa-923a-cf865fc7ce89-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.735071 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.734994    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-tls\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.735071 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735042    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-accelerators-collector-config\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.735071 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735069    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3690b647-36d6-4ab1-820b-11cbe736a1bf-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-nfz8l\" (UID: \"3690b647-36d6-4ab1-820b-11cbe736a1bf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"
Jul 21 04:09:14.735332 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spgqw\" (UniqueName: \"kubernetes.io/projected/21edf1ff-3354-4aaa-923a-cf865fc7ce89-kube-api-access-spgqw\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.735332 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:09:14.735117    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 04:09:14.735332 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735135    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3690b647-36d6-4ab1-820b-11cbe736a1bf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-nfz8l\" (UID: \"3690b647-36d6-4ab1-820b-11cbe736a1bf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"
Jul 21 04:09:14.735332 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-textfile\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.735332 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:09:14.735199    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-tls podName:0e2140b6-737b-4cd0-b976-702af090dcd7 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:15.235179105 +0000 UTC m=+305.052745881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-tls") pod "node-exporter-v67p5" (UID: "0e2140b6-737b-4cd0-b976-702af090dcd7") : secret "node-exporter-tls" not found
Jul 21 04:09:14.735332 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:09:14.735310    2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 21 04:09:14.735612 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735351    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.735612 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:09:14.735373    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3690b647-36d6-4ab1-820b-11cbe736a1bf-openshift-state-metrics-tls podName:3690b647-36d6-4ab1-820b-11cbe736a1bf nodeName:}" failed. No retries permitted until 2026-07-21 04:09:15.235355438 +0000 UTC m=+305.052922199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3690b647-36d6-4ab1-820b-11cbe736a1bf-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-nfz8l" (UID: "3690b647-36d6-4ab1-820b-11cbe736a1bf") : secret "openshift-state-metrics-tls" not found
Jul 21 04:09:14.735612 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735407    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3690b647-36d6-4ab1-820b-11cbe736a1bf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-nfz8l\" (UID: \"3690b647-36d6-4ab1-820b-11cbe736a1bf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"
Jul 21 04:09:14.735612 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-wtmp\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.735612 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735493    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hkjp\" (UniqueName: \"kubernetes.io/projected/0e2140b6-737b-4cd0-b976-702af090dcd7-kube-api-access-5hkjp\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.735612 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735523    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21edf1ff-3354-4aaa-923a-cf865fc7ce89-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.735612 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735576    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21edf1ff-3354-4aaa-923a-cf865fc7ce89-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.735979 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e2140b6-737b-4cd0-b976-702af090dcd7-sys\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.735979 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735620    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-wtmp\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.735979 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/21edf1ff-3354-4aaa-923a-cf865fc7ce89-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.735979 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735695    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-accelerators-collector-config\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.735979 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735702    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/21edf1ff-3354-4aaa-923a-cf865fc7ce89-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.735979 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735726    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21edf1ff-3354-4aaa-923a-cf865fc7ce89-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.735979 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735751    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e2140b6-737b-4cd0-b976-702af090dcd7-sys\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.735979 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e2140b6-737b-4cd0-b976-702af090dcd7-metrics-client-ca\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.735979 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735791    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m5rm\" (UniqueName: \"kubernetes.io/projected/3690b647-36d6-4ab1-820b-11cbe736a1bf-kube-api-access-4m5rm\") pod \"openshift-state-metrics-79f6958cdf-nfz8l\" (UID: \"3690b647-36d6-4ab1-820b-11cbe736a1bf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"
Jul 21 04:09:14.735979 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.735906    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3690b647-36d6-4ab1-820b-11cbe736a1bf-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-nfz8l\" (UID: \"3690b647-36d6-4ab1-820b-11cbe736a1bf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"
Jul 21 04:09:14.736443 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.736290    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-textfile\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.736443 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.736409    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e2140b6-737b-4cd0-b976-702af090dcd7-root\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.736443 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.736420    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e2140b6-737b-4cd0-b976-702af090dcd7-metrics-client-ca\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.736593 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.736462    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21edf1ff-3354-4aaa-923a-cf865fc7ce89-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.736593 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.736513    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e2140b6-737b-4cd0-b976-702af090dcd7-root\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.736721 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.736627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/21edf1ff-3354-4aaa-923a-cf865fc7ce89-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.736910 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.736888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/21edf1ff-3354-4aaa-923a-cf865fc7ce89-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.739091 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.739042    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21edf1ff-3354-4aaa-923a-cf865fc7ce89-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.739211 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.739111    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3690b647-36d6-4ab1-820b-11cbe736a1bf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-nfz8l\" (UID: \"3690b647-36d6-4ab1-820b-11cbe736a1bf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"
Jul 21 04:09:14.739211 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.739144    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21edf1ff-3354-4aaa-923a-cf865fc7ce89-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.739745 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.739725    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.745517 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.745491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hkjp\" (UniqueName: \"kubernetes.io/projected/0e2140b6-737b-4cd0-b976-702af090dcd7-kube-api-access-5hkjp\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:14.745840 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.745818    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spgqw\" (UniqueName: \"kubernetes.io/projected/21edf1ff-3354-4aaa-923a-cf865fc7ce89-kube-api-access-spgqw\") pod \"kube-state-metrics-56c5594674-rzh6f\" (UID: \"21edf1ff-3354-4aaa-923a-cf865fc7ce89\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:14.745931 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.745880    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m5rm\" (UniqueName: \"kubernetes.io/projected/3690b647-36d6-4ab1-820b-11cbe736a1bf-kube-api-access-4m5rm\") pod \"openshift-state-metrics-79f6958cdf-nfz8l\" (UID: \"3690b647-36d6-4ab1-820b-11cbe736a1bf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"
Jul 21 04:09:14.800012 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:14.799972    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"
Jul 21 04:09:15.241260 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:15.241224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-tls\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:15.241447 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:15.241284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3690b647-36d6-4ab1-820b-11cbe736a1bf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-nfz8l\" (UID: \"3690b647-36d6-4ab1-820b-11cbe736a1bf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"
Jul 21 04:09:15.241447 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:09:15.241415    2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 21 04:09:15.241571 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:09:15.241493    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3690b647-36d6-4ab1-820b-11cbe736a1bf-openshift-state-metrics-tls podName:3690b647-36d6-4ab1-820b-11cbe736a1bf nodeName:}" failed. No retries permitted until 2026-07-21 04:09:16.241473455 +0000 UTC m=+306.059040219 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3690b647-36d6-4ab1-820b-11cbe736a1bf-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-nfz8l" (UID: "3690b647-36d6-4ab1-820b-11cbe736a1bf") : secret "openshift-state-metrics-tls" not found
Jul 21 04:09:15.243847 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:15.243821    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e2140b6-737b-4cd0-b976-702af090dcd7-node-exporter-tls\") pod \"node-exporter-v67p5\" (UID: \"0e2140b6-737b-4cd0-b976-702af090dcd7\") " pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:15.405708 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:15.405678    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v67p5"
Jul 21 04:09:16.016390 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:09:16.016259    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e2140b6_737b_4cd0_b976_702af090dcd7.slice/crio-ae836543a110540aeb3a69bccbd80b1271e16da53b7fe73e8f4d9373a5c2ba77 WatchSource:0}: Error finding container ae836543a110540aeb3a69bccbd80b1271e16da53b7fe73e8f4d9373a5c2ba77: Status 404 returned error can't find the container with id ae836543a110540aeb3a69bccbd80b1271e16da53b7fe73e8f4d9373a5c2ba77
Jul 21 04:09:16.126735 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.126689    2576 patch_prober.go:28] interesting pod/image-registry-5b7ddb95f7-l6j7p container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 04:09:16.126844 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.126744    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p" podUID="1e97d66b-e06f-44fe-b6e7-fe5dac50aa68" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 04:09:16.152453 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.152432    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-rzh6f"]
Jul 21 04:09:16.154212 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:09:16.154189    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21edf1ff_3354_4aaa_923a_cf865fc7ce89.slice/crio-225e1aae48044d534dc9e2353839aa7f58664e36bfa4c78aff4a0a0d2b04fd6a WatchSource:0}: Error finding container 225e1aae48044d534dc9e2353839aa7f58664e36bfa4c78aff4a0a0d2b04fd6a: Status 404 returned error can't find the container with id 225e1aae48044d534dc9e2353839aa7f58664e36bfa4c78aff4a0a0d2b04fd6a
Jul 21 04:09:16.250650 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.250602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3690b647-36d6-4ab1-820b-11cbe736a1bf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-nfz8l\" (UID: \"3690b647-36d6-4ab1-820b-11cbe736a1bf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"
Jul 21 04:09:16.252958 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.252932    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3690b647-36d6-4ab1-820b-11cbe736a1bf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-nfz8l\" (UID: \"3690b647-36d6-4ab1-820b-11cbe736a1bf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"
Jul 21 04:09:16.290013 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.289956    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"
Jul 21 04:09:16.422386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.422363    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l"]
Jul 21 04:09:16.425150 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:09:16.425126    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3690b647_36d6_4ab1_820b_11cbe736a1bf.slice/crio-6ee407fc399d5f65a5930729c15a9ac7371a223d6c7ee56593b42a5a701ae008 WatchSource:0}: Error finding container 6ee407fc399d5f65a5930729c15a9ac7371a223d6c7ee56593b42a5a701ae008: Status 404 returned error can't find the container with id 6ee407fc399d5f65a5930729c15a9ac7371a223d6c7ee56593b42a5a701ae008
Jul 21 04:09:16.627673 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.627569    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l" event={"ID":"3690b647-36d6-4ab1-820b-11cbe736a1bf","Type":"ContainerStarted","Data":"a278e76aa0836fdffbc96cff4915f34b2c7f844c4afd59055b2cd43ada3687b9"}
Jul 21 04:09:16.627673 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.627633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l" event={"ID":"3690b647-36d6-4ab1-820b-11cbe736a1bf","Type":"ContainerStarted","Data":"2d3b004ca69fe08929c2f0c4420de73871d983019420198a86eced99601990bc"}
Jul 21 04:09:16.627923 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.627690    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l" event={"ID":"3690b647-36d6-4ab1-820b-11cbe736a1bf","Type":"ContainerStarted","Data":"6ee407fc399d5f65a5930729c15a9ac7371a223d6c7ee56593b42a5a701ae008"}
Jul 21 04:09:16.629019 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.628991    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f" event={"ID":"21edf1ff-3354-4aaa-923a-cf865fc7ce89","Type":"ContainerStarted","Data":"225e1aae48044d534dc9e2353839aa7f58664e36bfa4c78aff4a0a0d2b04fd6a"}
Jul 21 04:09:16.630381 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.630357    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v67p5" event={"ID":"0e2140b6-737b-4cd0-b976-702af090dcd7","Type":"ContainerStarted","Data":"ae836543a110540aeb3a69bccbd80b1271e16da53b7fe73e8f4d9373a5c2ba77"}
Jul 21 04:09:16.632856 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.632822    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbmsp" event={"ID":"2d645950-68ef-4f41-a8f7-a06ff94bc3cb","Type":"ContainerStarted","Data":"d6ac688f8d9d5fb0e49ea67530718f510b8305a5cbe9df0fc5cedb197c4a2ba6"}
Jul 21 04:09:16.652403 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.652353    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vbmsp" podStartSLOduration=33.497918307 podStartE2EDuration="45.652333358s" totalImagesPullingTime="12.154415051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:08:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:16.650517548 +0000 UTC m=+306.468084332" watchObservedRunningTime="2026-07-21 04:09:16.652333358 +0000 UTC m=+306.469900144"
Jul 21 04:09:16.712312 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.712285    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"]
Jul 21 04:09:16.716944 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.716919    2576 patch_prober.go:28] interesting pod/image-registry-5b7ddb95f7-l6j7p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 04:09:16.717053 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:16.716961    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p" podUID="1e97d66b-e06f-44fe-b6e7-fe5dac50aa68" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 04:09:17.470514 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.470484    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-69bb564d6b-frwst"]
Jul 21 04:09:17.479664 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.479575    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.482799 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.482526    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 21 04:09:17.482799 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.482539    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 21 04:09:17.482799 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.482673    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zxb2x\""
Jul 21 04:09:17.483000 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.482875    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 21 04:09:17.483469 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.483307    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-mcg4c4bhgrc1\""
Jul 21 04:09:17.483469 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.483331    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 21 04:09:17.483469 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.483363    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 21 04:09:17.489543 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.489094    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69bb564d6b-frwst"]
Jul 21 04:09:17.639515 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.639475    2576 generic.go:356] "Generic (PLEG): container finished" podID="0e2140b6-737b-4cd0-b976-702af090dcd7" containerID="19c9fa43345a86a9295a579f377e57092dc3fb4b8cd91d60214629706dff9b97" exitCode=0
Jul 21 04:09:17.639686 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.639555    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v67p5" event={"ID":"0e2140b6-737b-4cd0-b976-702af090dcd7","Type":"ContainerDied","Data":"19c9fa43345a86a9295a579f377e57092dc3fb4b8cd91d60214629706dff9b97"}
Jul 21 04:09:17.663495 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.663468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.663607 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.663532    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.663703 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.663617    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-thanos-querier-tls\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.663703 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.663678    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-metrics-client-ca\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.663798 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.663708    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdjqc\" (UniqueName: \"kubernetes.io/projected/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-kube-api-access-bdjqc\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.663798 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.663749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-grpc-tls\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.663798 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.663788    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.663912 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.663805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.764945 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.764877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.765581 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.765095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.765581 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.765269    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-thanos-querier-tls\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.765581 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.765293    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-metrics-client-ca\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.765581 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.765329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdjqc\" (UniqueName: \"kubernetes.io/projected/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-kube-api-access-bdjqc\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.765581 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.765415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-grpc-tls\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.765581 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.765453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.765581 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.765479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.766378 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.766040    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-metrics-client-ca\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.768135 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.768107    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.768524 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.768498    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.768807 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.768764    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-grpc-tls\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.769157 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.769131    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.769236 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.769213    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-thanos-querier-tls\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.769236 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.769229    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.776959 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.776939    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdjqc\" (UniqueName: \"kubernetes.io/projected/bddb741b-8e3d-4c85-b8bb-8ca4b05f5030-kube-api-access-bdjqc\") pod \"thanos-querier-69bb564d6b-frwst\" (UID: \"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030\") " pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:17.792530 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:17.792510    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:18.161330 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:18.161307    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69bb564d6b-frwst"]
Jul 21 04:09:18.164657 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:09:18.164613    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbddb741b_8e3d_4c85_b8bb_8ca4b05f5030.slice/crio-e9455a18909715422074356d95859134873672ca70cb5060f98712c1a03fe1ae WatchSource:0}: Error finding container e9455a18909715422074356d95859134873672ca70cb5060f98712c1a03fe1ae: Status 404 returned error can't find the container with id e9455a18909715422074356d95859134873672ca70cb5060f98712c1a03fe1ae
Jul 21 04:09:18.644213 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:18.644175    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst" event={"ID":"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030","Type":"ContainerStarted","Data":"e9455a18909715422074356d95859134873672ca70cb5060f98712c1a03fe1ae"}
Jul 21 04:09:18.646213 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:18.646186    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l" event={"ID":"3690b647-36d6-4ab1-820b-11cbe736a1bf","Type":"ContainerStarted","Data":"25be0485f4dd87024ab4d9ecec26bdb4b62d37222713020e3b64517b2486d1ec"}
Jul 21 04:09:18.648239 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:18.648216    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f" event={"ID":"21edf1ff-3354-4aaa-923a-cf865fc7ce89","Type":"ContainerStarted","Data":"bec276fe71b1f74b268033b87afc0587c77c210eb3fc5c8d3fa1c167a8d6389e"}
Jul 21 04:09:18.648351 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:18.648261    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f" event={"ID":"21edf1ff-3354-4aaa-923a-cf865fc7ce89","Type":"ContainerStarted","Data":"2313b666a6835dcdb20fedd9072e60a43cb7f47bca33ede841d4c0224640758c"}
Jul 21 04:09:18.648351 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:18.648280    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f" event={"ID":"21edf1ff-3354-4aaa-923a-cf865fc7ce89","Type":"ContainerStarted","Data":"6eaa213ee235f655a7e5487dcdd27c3ea86847119c3520e1dc75ccfa026a13d7"}
Jul 21 04:09:18.650198 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:18.650179    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v67p5" event={"ID":"0e2140b6-737b-4cd0-b976-702af090dcd7","Type":"ContainerStarted","Data":"f6bc985d55fd5a17cb1d6780f391ea6b560257b64725f505fcc556875419fe85"}
Jul 21 04:09:18.650268 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:18.650212    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v67p5" event={"ID":"0e2140b6-737b-4cd0-b976-702af090dcd7","Type":"ContainerStarted","Data":"1a482a12cfae0c291d762a99966048bc828b096b0bfa5189c5935fa3dee68fa5"}
Jul 21 04:09:18.694034 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:18.693993    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-nfz8l" podStartSLOduration=3.228527963 podStartE2EDuration="4.693981531s" totalImagesPullingTime="1.465453568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:18.693013266 +0000 UTC m=+308.510580052" watchObservedRunningTime="2026-07-21 04:09:18.693981531 +0000 UTC m=+308.511548293"
Jul 21 04:09:18.712010 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:18.711971    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-rzh6f" podStartSLOduration=2.858540949 podStartE2EDuration="4.711958001s" totalImagesPullingTime="1.853417052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:18.711036373 +0000 UTC m=+308.528603158" watchObservedRunningTime="2026-07-21 04:09:18.711958001 +0000 UTC m=+308.529524784"
Jul 21 04:09:18.733277 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:18.733240    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v67p5" podStartSLOduration=3.687059571 podStartE2EDuration="4.733226955s" totalImagesPullingTime="975.37227ms" totalInitContainerRuntime="70.795114ms" isStatefulPod=true podCreationTimestamp="2026-07-21 04:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:18.731988152 +0000 UTC m=+308.549554933" watchObservedRunningTime="2026-07-21 04:09:18.733226955 +0000 UTC m=+308.550793738"
Jul 21 04:09:21.667604 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:21.667563    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst" event={"ID":"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030","Type":"ContainerStarted","Data":"ee97bda656e366169054b3c5827775f37412983af03e1c14cae2ce7c5d2314df"}
Jul 21 04:09:21.668065 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:21.667682    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst" event={"ID":"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030","Type":"ContainerStarted","Data":"db25326d73dc7b7e14c3c3ae4c30e932cf3152e109484ba323e7836b0f7155a3"}
Jul 21 04:09:21.668065 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:21.667725    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst" event={"ID":"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030","Type":"ContainerStarted","Data":"ad24bc952fcbbaf8b5f04194193263dc564d7843032e8eda8a40bfc440b4fea5"}
Jul 21 04:09:22.658940 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:22.658909    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:09:22.677495 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:22.677461    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst" event={"ID":"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030","Type":"ContainerStarted","Data":"5421ba150beb2940ca1bdc050c8f1e2bb6d499b01e864285396ad65bb09fd356"}
Jul 21 04:09:22.677962 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:22.677522    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst" event={"ID":"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030","Type":"ContainerStarted","Data":"368bf9ee9a110c6ebe3514a46a1cd1208fc06b39e1ae44039ced3069fe308a6e"}
Jul 21 04:09:22.677962 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:22.677566    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst" event={"ID":"bddb741b-8e3d-4c85-b8bb-8ca4b05f5030","Type":"ContainerStarted","Data":"7909ae2ddbadb9d76abaee776163f5da1639104a39721b1c5d54cd08084826c6"}
Jul 21 04:09:22.677962 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:22.677609    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:22.700743 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:22.700578    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst" podStartSLOduration=2.336043915 podStartE2EDuration="5.700545121s" totalImagesPullingTime="3.364501206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:22.700364449 +0000 UTC m=+312.517931245" watchObservedRunningTime="2026-07-21 04:09:22.700545121 +0000 UTC m=+312.518111901"
Jul 21 04:09:26.717048 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:26.717014    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:09:28.687660 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:28.687618    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-69bb564d6b-frwst"
Jul 21 04:09:33.856269 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.856240    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65dcc966b9-tmg72"]
Jul 21 04:09:33.858885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.858869    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:33.862097 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.862069    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bfg85\""
Jul 21 04:09:33.862097 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.862091    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 21 04:09:33.862290 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.862075    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 21 04:09:33.862290 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.862070    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 04:09:33.862401 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.862382    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 21 04:09:33.862401 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.862395    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 04:09:33.862505 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.862438    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 21 04:09:33.862505 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.862477    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 21 04:09:33.872709 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.872689    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65dcc966b9-tmg72"]
Jul 21 04:09:33.895912 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.895884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-oauth-serving-cert\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:33.896032 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.895940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqx2s\" (UniqueName: \"kubernetes.io/projected/e039e050-8123-4e90-97af-38e4577a1415-kube-api-access-wqx2s\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:33.896032 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.895970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-console-config\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:33.896032 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.896005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-service-ca\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:33.896032 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.896031    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e039e050-8123-4e90-97af-38e4577a1415-console-oauth-config\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:33.896182 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.896076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e039e050-8123-4e90-97af-38e4577a1415-console-serving-cert\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:33.997092 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.997069    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqx2s\" (UniqueName: \"kubernetes.io/projected/e039e050-8123-4e90-97af-38e4577a1415-kube-api-access-wqx2s\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:33.997215 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.997111    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-console-config\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:33.997215 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.997154    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-service-ca\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:33.997215 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.997181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e039e050-8123-4e90-97af-38e4577a1415-console-oauth-config\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:33.997215 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.997200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e039e050-8123-4e90-97af-38e4577a1415-console-serving-cert\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:33.997392 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.997220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-oauth-serving-cert\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:33.997895 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.997870    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-console-config\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:33.998023 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.997987    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-service-ca\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:33.998023 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:33.997990    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-oauth-serving-cert\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:34.000389 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:34.000370    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e039e050-8123-4e90-97af-38e4577a1415-console-oauth-config\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:34.000560 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:34.000541    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e039e050-8123-4e90-97af-38e4577a1415-console-serving-cert\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:34.005698 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:34.005674    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqx2s\" (UniqueName: \"kubernetes.io/projected/e039e050-8123-4e90-97af-38e4577a1415-kube-api-access-wqx2s\") pod \"console-65dcc966b9-tmg72\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") " pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:34.168601 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:34.168542    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:34.295780 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:34.295758    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65dcc966b9-tmg72"]
Jul 21 04:09:34.297912 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:09:34.297883    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode039e050_8123_4e90_97af_38e4577a1415.slice/crio-b1dd21479f873069a6aefd1c86eb86c34ee0ea5a6f6b2c4791a051ed292f8dc3 WatchSource:0}: Error finding container b1dd21479f873069a6aefd1c86eb86c34ee0ea5a6f6b2c4791a051ed292f8dc3: Status 404 returned error can't find the container with id b1dd21479f873069a6aefd1c86eb86c34ee0ea5a6f6b2c4791a051ed292f8dc3
Jul 21 04:09:34.724971 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:34.724934    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65dcc966b9-tmg72" event={"ID":"e039e050-8123-4e90-97af-38e4577a1415","Type":"ContainerStarted","Data":"b1dd21479f873069a6aefd1c86eb86c34ee0ea5a6f6b2c4791a051ed292f8dc3"}
Jul 21 04:09:37.739112 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:37.739081    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65dcc966b9-tmg72" event={"ID":"e039e050-8123-4e90-97af-38e4577a1415","Type":"ContainerStarted","Data":"7724459188a0d93b89fcdc6d07a234dc1ad6a7758d41bcd56bae0d52693ff7a9"}
Jul 21 04:09:37.756852 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:37.756804    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65dcc966b9-tmg72" podStartSLOduration=1.767175127 podStartE2EDuration="4.756784436s" totalImagesPullingTime="2.989609309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:37.755274861 +0000 UTC m=+327.572841645" watchObservedRunningTime="2026-07-21 04:09:37.756784436 +0000 UTC m=+327.574351219"
Jul 21 04:09:41.734458 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:41.734396    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p" podUID="1e97d66b-e06f-44fe-b6e7-fe5dac50aa68" containerName="registry" containerID="cri-o://386fd5e0041ece385c7a29bc3ce0269c72c2500367d6d2779965e13245591ad7" gracePeriod=30
Jul 21 04:09:42.043939 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.043916    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:09:42.167346 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.167321    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-certificates\") pod \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") "
Jul 21 04:09:42.167505 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.167380    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-trusted-ca\") pod \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") "
Jul 21 04:09:42.167505 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.167422    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-image-registry-private-configuration\") pod \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") "
Jul 21 04:09:42.167505 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.167450    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls\") pod \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") "
Jul 21 04:09:42.167505 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.167479    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-ca-trust-extracted\") pod \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") "
Jul 21 04:09:42.167505 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.167505    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-bound-sa-token\") pod \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") "
Jul 21 04:09:42.167786 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.167539    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4929\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-kube-api-access-j4929\") pod \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") "
Jul 21 04:09:42.167786 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.167599    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-installation-pull-secrets\") pod \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\" (UID: \"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68\") "
Jul 21 04:09:42.167786 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.167710    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:09:42.167939 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.167835    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-certificates\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:09:42.167939 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.167921    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:09:42.170437 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.170412    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:09:42.170437 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.170428    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:09:42.170591 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.170455    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:09:42.170591 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.170521    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:09:42.170688 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.170665    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-kube-api-access-j4929" (OuterVolumeSpecName: "kube-api-access-j4929") pod "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68"). InnerVolumeSpecName "kube-api-access-j4929". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:09:42.176297 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.176276    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68" (UID: "1e97d66b-e06f-44fe-b6e7-fe5dac50aa68"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:09:42.269103 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.269054    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-image-registry-private-configuration\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:09:42.269103 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.269076    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-registry-tls\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:09:42.269103 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.269086    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-ca-trust-extracted\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:09:42.269103 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.269096    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-bound-sa-token\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:09:42.269103 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.269104    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4929\" (UniqueName: \"kubernetes.io/projected/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-kube-api-access-j4929\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:09:42.269292 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.269112    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-installation-pull-secrets\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:09:42.269292 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.269120    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68-trusted-ca\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:09:42.423435 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.423412    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b4dcdf6f4-nvqxm"]
Jul 21 04:09:42.423724 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.423713    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e97d66b-e06f-44fe-b6e7-fe5dac50aa68" containerName="registry"
Jul 21 04:09:42.423770 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.423726    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e97d66b-e06f-44fe-b6e7-fe5dac50aa68" containerName="registry"
Jul 21 04:09:42.423803 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.423794    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e97d66b-e06f-44fe-b6e7-fe5dac50aa68" containerName="registry"
Jul 21 04:09:42.467022 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.467000    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b4dcdf6f4-nvqxm"]
Jul 21 04:09:42.467116 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.467081    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.475167 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.475148    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 21 04:09:42.571268 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.571246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-console-config\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.571351 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.571275    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-service-ca\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.571351 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.571309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80c1434e-0ccd-464a-9a85-182145f1dddb-console-oauth-config\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.571423 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.571395    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-oauth-serving-cert\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.571454 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.571423    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rgf7\" (UniqueName: \"kubernetes.io/projected/80c1434e-0ccd-464a-9a85-182145f1dddb-kube-api-access-9rgf7\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.571486 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.571451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-trusted-ca-bundle\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.571517 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.571484    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80c1434e-0ccd-464a-9a85-182145f1dddb-console-serving-cert\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.672038 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.672019    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-console-config\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.672125 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.672044    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-service-ca\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.672125 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.672089    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80c1434e-0ccd-464a-9a85-182145f1dddb-console-oauth-config\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.672201 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.672140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-oauth-serving-cert\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.672201 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.672169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rgf7\" (UniqueName: \"kubernetes.io/projected/80c1434e-0ccd-464a-9a85-182145f1dddb-kube-api-access-9rgf7\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.672201 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.672196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-trusted-ca-bundle\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.672341 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.672219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80c1434e-0ccd-464a-9a85-182145f1dddb-console-serving-cert\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.673077 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.672859    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-service-ca\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.673077 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.673017    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-oauth-serving-cert\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.673239 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.673141    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-console-config\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.673239 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.673223    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-trusted-ca-bundle\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.674673 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.674627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80c1434e-0ccd-464a-9a85-182145f1dddb-console-serving-cert\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.674724 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.674694    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80c1434e-0ccd-464a-9a85-182145f1dddb-console-oauth-config\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.680106 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.680088    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rgf7\" (UniqueName: \"kubernetes.io/projected/80c1434e-0ccd-464a-9a85-182145f1dddb-kube-api-access-9rgf7\") pod \"console-b4dcdf6f4-nvqxm\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") " pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.760031 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.760004    2576 generic.go:356] "Generic (PLEG): container finished" podID="1e97d66b-e06f-44fe-b6e7-fe5dac50aa68" containerID="386fd5e0041ece385c7a29bc3ce0269c72c2500367d6d2779965e13245591ad7" exitCode=0
Jul 21 04:09:42.760395 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.760063    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p" event={"ID":"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68","Type":"ContainerDied","Data":"386fd5e0041ece385c7a29bc3ce0269c72c2500367d6d2779965e13245591ad7"}
Jul 21 04:09:42.760395 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.760112    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p" event={"ID":"1e97d66b-e06f-44fe-b6e7-fe5dac50aa68","Type":"ContainerDied","Data":"01aa337dade2590ac0578c81c6ae6026c4e447fd9aa37ea0e32cd2d4b1403c34"}
Jul 21 04:09:42.760395 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.760121    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"
Jul 21 04:09:42.760395 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.760156    2576 scope.go:117] "RemoveContainer" containerID="386fd5e0041ece385c7a29bc3ce0269c72c2500367d6d2779965e13245591ad7"
Jul 21 04:09:42.769471 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.769452    2576 scope.go:117] "RemoveContainer" containerID="386fd5e0041ece385c7a29bc3ce0269c72c2500367d6d2779965e13245591ad7"
Jul 21 04:09:42.769954 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:09:42.769931    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"386fd5e0041ece385c7a29bc3ce0269c72c2500367d6d2779965e13245591ad7\": container with ID starting with 386fd5e0041ece385c7a29bc3ce0269c72c2500367d6d2779965e13245591ad7 not found: ID does not exist" containerID="386fd5e0041ece385c7a29bc3ce0269c72c2500367d6d2779965e13245591ad7"
Jul 21 04:09:42.770060 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.769959    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"386fd5e0041ece385c7a29bc3ce0269c72c2500367d6d2779965e13245591ad7"} err="failed to get container status \"386fd5e0041ece385c7a29bc3ce0269c72c2500367d6d2779965e13245591ad7\": rpc error: code = NotFound desc = could not find container \"386fd5e0041ece385c7a29bc3ce0269c72c2500367d6d2779965e13245591ad7\": container with ID starting with 386fd5e0041ece385c7a29bc3ce0269c72c2500367d6d2779965e13245591ad7 not found: ID does not exist"
Jul 21 04:09:42.777307 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.777288    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:42.780620 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.780596    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"]
Jul 21 04:09:42.783505 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.783486    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b7ddb95f7-l6j7p"]
Jul 21 04:09:42.933679 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:42.933630    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b4dcdf6f4-nvqxm"]
Jul 21 04:09:42.936783 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:09:42.936739    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c1434e_0ccd_464a_9a85_182145f1dddb.slice/crio-12994b6f72596755a3587b2e9d0c31397eed6a258f9e64ab31777177114dc1d3 WatchSource:0}: Error finding container 12994b6f72596755a3587b2e9d0c31397eed6a258f9e64ab31777177114dc1d3: Status 404 returned error can't find the container with id 12994b6f72596755a3587b2e9d0c31397eed6a258f9e64ab31777177114dc1d3
Jul 21 04:09:43.765497 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:43.765466    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4dcdf6f4-nvqxm" event={"ID":"80c1434e-0ccd-464a-9a85-182145f1dddb","Type":"ContainerStarted","Data":"3b87f7331f40e10df28992f554fdc8d3065fd3f3ee84165f09f5edd86db79c6f"}
Jul 21 04:09:43.765964 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:43.765518    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4dcdf6f4-nvqxm" event={"ID":"80c1434e-0ccd-464a-9a85-182145f1dddb","Type":"ContainerStarted","Data":"12994b6f72596755a3587b2e9d0c31397eed6a258f9e64ab31777177114dc1d3"}
Jul 21 04:09:43.793286 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:43.793231    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b4dcdf6f4-nvqxm" podStartSLOduration=1.7932118 podStartE2EDuration="1.7932118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:43.792536974 +0000 UTC m=+333.610103758" watchObservedRunningTime="2026-07-21 04:09:43.7932118 +0000 UTC m=+333.610778586"
Jul 21 04:09:44.168737 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:44.168705    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:44.168880 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:44.168789    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:44.173578 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:44.173555    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:44.663501 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:44.663471    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e97d66b-e06f-44fe-b6e7-fe5dac50aa68" path="/var/lib/kubelet/pods/1e97d66b-e06f-44fe-b6e7-fe5dac50aa68/volumes"
Jul 21 04:09:44.774330 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:44.774306    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:09:49.790190 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:49.790159    2576 generic.go:356] "Generic (PLEG): container finished" podID="3d93cf6b-302c-4d96-804a-407807242d91" containerID="e8c1dfb4c73c9c8e08fbdece0c7970f537dd2214656aa091f96cd70514afab1a" exitCode=0
Jul 21 04:09:49.790528 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:49.790198    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g" event={"ID":"3d93cf6b-302c-4d96-804a-407807242d91","Type":"ContainerDied","Data":"e8c1dfb4c73c9c8e08fbdece0c7970f537dd2214656aa091f96cd70514afab1a"}
Jul 21 04:09:49.790528 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:49.790523    2576 scope.go:117] "RemoveContainer" containerID="e8c1dfb4c73c9c8e08fbdece0c7970f537dd2214656aa091f96cd70514afab1a"
Jul 21 04:09:50.795198 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:50.795165    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7527g" event={"ID":"3d93cf6b-302c-4d96-804a-407807242d91","Type":"ContainerStarted","Data":"5398c8512abe9074ae1db3fa79b560a26218f831b0bef699603c065d8fd2566f"}
Jul 21 04:09:52.778194 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:52.778160    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:52.778572 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:52.778235    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:52.783193 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:52.783167    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:52.811818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:52.811789    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:09:52.862104 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:52.862076    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65dcc966b9-tmg72"]
Jul 21 04:09:55.819179 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:55.819143    2576 generic.go:356] "Generic (PLEG): container finished" podID="564f2869-382f-4f38-adf1-cdb9dc89c49f" containerID="89b0433879bdb01adb82fe23df8cfba80b63802dae2eb48c649ed3f0a665209b" exitCode=0
Jul 21 04:09:55.819568 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:55.819218    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl" event={"ID":"564f2869-382f-4f38-adf1-cdb9dc89c49f","Type":"ContainerDied","Data":"89b0433879bdb01adb82fe23df8cfba80b63802dae2eb48c649ed3f0a665209b"}
Jul 21 04:09:55.819568 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:55.819521    2576 scope.go:117] "RemoveContainer" containerID="89b0433879bdb01adb82fe23df8cfba80b63802dae2eb48c649ed3f0a665209b"
Jul 21 04:09:56.824750 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:09:56.824718    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-26lfl" event={"ID":"564f2869-382f-4f38-adf1-cdb9dc89c49f","Type":"ContainerStarted","Data":"a3dfde4bc1658276c6258bd15016e10ac5eaa3f366a3f091d2d4fd69656e1199"}
Jul 21 04:10:01.843982 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:01.843949    2576 generic.go:356] "Generic (PLEG): container finished" podID="67b08428-7730-43a8-8d66-28faefc2897d" containerID="3a916d713b6de2b753c53f578e05fc1eb95401575a9f71b20424634d3cafa1a9" exitCode=0
Jul 21 04:10:01.844382 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:01.844022    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-mv7hd" event={"ID":"67b08428-7730-43a8-8d66-28faefc2897d","Type":"ContainerDied","Data":"3a916d713b6de2b753c53f578e05fc1eb95401575a9f71b20424634d3cafa1a9"}
Jul 21 04:10:01.844382 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:01.844356    2576 scope.go:117] "RemoveContainer" containerID="3a916d713b6de2b753c53f578e05fc1eb95401575a9f71b20424634d3cafa1a9"
Jul 21 04:10:02.849702 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:02.849664    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-mv7hd" event={"ID":"67b08428-7730-43a8-8d66-28faefc2897d","Type":"ContainerStarted","Data":"9b3f7a764a9e17a5e320660bb48b818833e67cf55f64ef10d17fffab4297c044"}
Jul 21 04:10:17.884487 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:17.884444    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65dcc966b9-tmg72" podUID="e039e050-8123-4e90-97af-38e4577a1415" containerName="console" containerID="cri-o://7724459188a0d93b89fcdc6d07a234dc1ad6a7758d41bcd56bae0d52693ff7a9" gracePeriod=15
Jul 21 04:10:18.135371 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.135320    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:10:18.158076 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.158050    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e039e050-8123-4e90-97af-38e4577a1415-console-serving-cert\") pod \"e039e050-8123-4e90-97af-38e4577a1415\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") "
Jul 21 04:10:18.158187 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.158102    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqx2s\" (UniqueName: \"kubernetes.io/projected/e039e050-8123-4e90-97af-38e4577a1415-kube-api-access-wqx2s\") pod \"e039e050-8123-4e90-97af-38e4577a1415\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") "
Jul 21 04:10:18.158187 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.158167    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e039e050-8123-4e90-97af-38e4577a1415-console-oauth-config\") pod \"e039e050-8123-4e90-97af-38e4577a1415\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") "
Jul 21 04:10:18.158281 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.158194    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-console-config\") pod \"e039e050-8123-4e90-97af-38e4577a1415\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") "
Jul 21 04:10:18.158331 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.158303    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-oauth-serving-cert\") pod \"e039e050-8123-4e90-97af-38e4577a1415\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") "
Jul 21 04:10:18.158562 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.158369    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-service-ca\") pod \"e039e050-8123-4e90-97af-38e4577a1415\" (UID: \"e039e050-8123-4e90-97af-38e4577a1415\") "
Jul 21 04:10:18.158668 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.158595    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-console-config" (OuterVolumeSpecName: "console-config") pod "e039e050-8123-4e90-97af-38e4577a1415" (UID: "e039e050-8123-4e90-97af-38e4577a1415"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:10:18.158938 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.158901    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e039e050-8123-4e90-97af-38e4577a1415" (UID: "e039e050-8123-4e90-97af-38e4577a1415"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:10:18.159187 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.159142    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-service-ca" (OuterVolumeSpecName: "service-ca") pod "e039e050-8123-4e90-97af-38e4577a1415" (UID: "e039e050-8123-4e90-97af-38e4577a1415"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:10:18.160818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.160795    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e039e050-8123-4e90-97af-38e4577a1415-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e039e050-8123-4e90-97af-38e4577a1415" (UID: "e039e050-8123-4e90-97af-38e4577a1415"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:18.160933 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.160907    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e039e050-8123-4e90-97af-38e4577a1415-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e039e050-8123-4e90-97af-38e4577a1415" (UID: "e039e050-8123-4e90-97af-38e4577a1415"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:18.161016 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.160910    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e039e050-8123-4e90-97af-38e4577a1415-kube-api-access-wqx2s" (OuterVolumeSpecName: "kube-api-access-wqx2s") pod "e039e050-8123-4e90-97af-38e4577a1415" (UID: "e039e050-8123-4e90-97af-38e4577a1415"). InnerVolumeSpecName "kube-api-access-wqx2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:10:18.259828 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.259798    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-oauth-serving-cert\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:10:18.259931 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.259819    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-service-ca\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:10:18.259931 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.259850    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e039e050-8123-4e90-97af-38e4577a1415-console-serving-cert\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:10:18.259931 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.259859    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqx2s\" (UniqueName: \"kubernetes.io/projected/e039e050-8123-4e90-97af-38e4577a1415-kube-api-access-wqx2s\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:10:18.259931 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.259868    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e039e050-8123-4e90-97af-38e4577a1415-console-oauth-config\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:10:18.259931 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.259878    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e039e050-8123-4e90-97af-38e4577a1415-console-config\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:10:18.913528 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.913487    2576 generic.go:356] "Generic (PLEG): container finished" podID="e039e050-8123-4e90-97af-38e4577a1415" containerID="7724459188a0d93b89fcdc6d07a234dc1ad6a7758d41bcd56bae0d52693ff7a9" exitCode=0
Jul 21 04:10:18.913984 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.913536    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65dcc966b9-tmg72"
Jul 21 04:10:18.913984 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.913571    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65dcc966b9-tmg72" event={"ID":"e039e050-8123-4e90-97af-38e4577a1415","Type":"ContainerDied","Data":"7724459188a0d93b89fcdc6d07a234dc1ad6a7758d41bcd56bae0d52693ff7a9"}
Jul 21 04:10:18.913984 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.913624    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65dcc966b9-tmg72" event={"ID":"e039e050-8123-4e90-97af-38e4577a1415","Type":"ContainerDied","Data":"b1dd21479f873069a6aefd1c86eb86c34ee0ea5a6f6b2c4791a051ed292f8dc3"}
Jul 21 04:10:18.913984 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.913665    2576 scope.go:117] "RemoveContainer" containerID="7724459188a0d93b89fcdc6d07a234dc1ad6a7758d41bcd56bae0d52693ff7a9"
Jul 21 04:10:18.923004 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.922982    2576 scope.go:117] "RemoveContainer" containerID="7724459188a0d93b89fcdc6d07a234dc1ad6a7758d41bcd56bae0d52693ff7a9"
Jul 21 04:10:18.923306 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:10:18.923287    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7724459188a0d93b89fcdc6d07a234dc1ad6a7758d41bcd56bae0d52693ff7a9\": container with ID starting with 7724459188a0d93b89fcdc6d07a234dc1ad6a7758d41bcd56bae0d52693ff7a9 not found: ID does not exist" containerID="7724459188a0d93b89fcdc6d07a234dc1ad6a7758d41bcd56bae0d52693ff7a9"
Jul 21 04:10:18.923361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.923316    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7724459188a0d93b89fcdc6d07a234dc1ad6a7758d41bcd56bae0d52693ff7a9"} err="failed to get container status \"7724459188a0d93b89fcdc6d07a234dc1ad6a7758d41bcd56bae0d52693ff7a9\": rpc error: code = NotFound desc = could not find container \"7724459188a0d93b89fcdc6d07a234dc1ad6a7758d41bcd56bae0d52693ff7a9\": container with ID starting with 7724459188a0d93b89fcdc6d07a234dc1ad6a7758d41bcd56bae0d52693ff7a9 not found: ID does not exist"
Jul 21 04:10:18.929336 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.929311    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65dcc966b9-tmg72"]
Jul 21 04:10:18.933927 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:18.933904    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65dcc966b9-tmg72"]
Jul 21 04:10:20.663769 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:20.663737    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e039e050-8123-4e90-97af-38e4577a1415" path="/var/lib/kubelet/pods/e039e050-8123-4e90-97af-38e4577a1415/volumes"
Jul 21 04:10:23.498052 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:23.498013    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs\") pod \"network-metrics-daemon-l5vv7\" (UID: \"3ed75b9c-b7ed-4efd-94c5-c58c202e510b\") " pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:10:23.500666 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:23.500622    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ed75b9c-b7ed-4efd-94c5-c58c202e510b-metrics-certs\") pod \"network-metrics-daemon-l5vv7\" (UID: \"3ed75b9c-b7ed-4efd-94c5-c58c202e510b\") " pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:10:23.561857 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:23.561807    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q5j6n\""
Jul 21 04:10:23.569909 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:23.569890    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5vv7"
Jul 21 04:10:23.699119 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:23.699090    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l5vv7"]
Jul 21 04:10:23.701827 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:10:23.701799    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed75b9c_b7ed_4efd_94c5_c58c202e510b.slice/crio-beec108c41289553d4afacb47ffa602ac80b58f015adf9f9917a7f3a3246b245 WatchSource:0}: Error finding container beec108c41289553d4afacb47ffa602ac80b58f015adf9f9917a7f3a3246b245: Status 404 returned error can't find the container with id beec108c41289553d4afacb47ffa602ac80b58f015adf9f9917a7f3a3246b245
Jul 21 04:10:23.934270 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:23.934239    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l5vv7" event={"ID":"3ed75b9c-b7ed-4efd-94c5-c58c202e510b","Type":"ContainerStarted","Data":"beec108c41289553d4afacb47ffa602ac80b58f015adf9f9917a7f3a3246b245"}
Jul 21 04:10:24.940260 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:24.940223    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l5vv7" event={"ID":"3ed75b9c-b7ed-4efd-94c5-c58c202e510b","Type":"ContainerStarted","Data":"a7327464d01a1be0f568a8685b9542d1c504a4b315487021c64e4dae96ea5300"}
Jul 21 04:10:24.940561 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:24.940290    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l5vv7" event={"ID":"3ed75b9c-b7ed-4efd-94c5-c58c202e510b","Type":"ContainerStarted","Data":"3d5c9654c2aa46cbb17f8226bd9d438995b588d3206f3fde9b84b5856fe08203"}
Jul 21 04:10:24.957107 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:24.957062    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l5vv7" podStartSLOduration=372.944814388 podStartE2EDuration="6m13.957048652s" totalImagesPullingTime="1.012234264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:24.95597723 +0000 UTC m=+374.773544013" watchObservedRunningTime="2026-07-21 04:10:24.957048652 +0000 UTC m=+374.774615434"
Jul 21 04:10:42.733798 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.733770    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f49c79ccb-jqxph"]
Jul 21 04:10:42.734252 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.734183    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e039e050-8123-4e90-97af-38e4577a1415" containerName="console"
Jul 21 04:10:42.734252 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.734201    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e039e050-8123-4e90-97af-38e4577a1415" containerName="console"
Jul 21 04:10:42.734354 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.734287    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e039e050-8123-4e90-97af-38e4577a1415" containerName="console"
Jul 21 04:10:42.737328 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.737308    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.750413 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.750388    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f49c79ccb-jqxph"]
Jul 21 04:10:42.840449 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.840415    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-service-ca\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.840449 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.840448    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9zgb\" (UniqueName: \"kubernetes.io/projected/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-kube-api-access-h9zgb\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.840613 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.840474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-config\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.840613 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.840494    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-oauth-config\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.840613 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.840529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-serving-cert\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.840613 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.840567    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-trusted-ca-bundle\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.840773 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.840626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-oauth-serving-cert\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.942086 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.942052    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-serving-cert\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.942280 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.942107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-trusted-ca-bundle\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.942280 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.942220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-oauth-serving-cert\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.942280 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.942270    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-service-ca\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.942438 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.942359    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9zgb\" (UniqueName: \"kubernetes.io/projected/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-kube-api-access-h9zgb\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.942438 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.942401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-config\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.942438 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.942431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-oauth-config\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.942938 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.942914    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-oauth-serving-cert\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.943237 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.943195    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-trusted-ca-bundle\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.943540 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.943498    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-config\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.943798 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.943768    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-service-ca\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.945130 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.945106    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-serving-cert\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.945617 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.945227    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-oauth-config\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:42.949944 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:42.949916    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9zgb\" (UniqueName: \"kubernetes.io/projected/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-kube-api-access-h9zgb\") pod \"console-6f49c79ccb-jqxph\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") " pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:43.046011 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:43.045937    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:43.190158 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:43.190134    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f49c79ccb-jqxph"]
Jul 21 04:10:43.192736 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:10:43.192704    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode45c92b3_faf6_49ad_8a70_7750a8b09e7e.slice/crio-f3e92c2769a3ca7c85306d8b5f27c2555ee75c73491295633a0327add635efdc WatchSource:0}: Error finding container f3e92c2769a3ca7c85306d8b5f27c2555ee75c73491295633a0327add635efdc: Status 404 returned error can't find the container with id f3e92c2769a3ca7c85306d8b5f27c2555ee75c73491295633a0327add635efdc
Jul 21 04:10:44.018706 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:44.018669    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f49c79ccb-jqxph" event={"ID":"e45c92b3-faf6-49ad-8a70-7750a8b09e7e","Type":"ContainerStarted","Data":"6b88cfd25a1eb8c7528495b4a9ebffa8f7b96d2a8385277bddcd086eca6c51ef"}
Jul 21 04:10:44.019112 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:44.018721    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f49c79ccb-jqxph" event={"ID":"e45c92b3-faf6-49ad-8a70-7750a8b09e7e","Type":"ContainerStarted","Data":"f3e92c2769a3ca7c85306d8b5f27c2555ee75c73491295633a0327add635efdc"}
Jul 21 04:10:44.036565 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:44.036509    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f49c79ccb-jqxph" podStartSLOduration=2.036492188 podStartE2EDuration="2.036492188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:10:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:44.035471604 +0000 UTC m=+393.853038387" watchObservedRunningTime="2026-07-21 04:10:44.036492188 +0000 UTC m=+393.854058970"
Jul 21 04:10:53.046947 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:53.046915    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:53.047409 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:53.046959    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:53.051393 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:53.051367    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:53.061475 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:53.061452    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:10:53.117783 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:10:53.117754    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b4dcdf6f4-nvqxm"]
Jul 21 04:11:18.139870 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.139816    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b4dcdf6f4-nvqxm" podUID="80c1434e-0ccd-464a-9a85-182145f1dddb" containerName="console" containerID="cri-o://3b87f7331f40e10df28992f554fdc8d3065fd3f3ee84165f09f5edd86db79c6f" gracePeriod=15
Jul 21 04:11:18.370600 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.370575    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:11:18.504430 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.504369    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-console-config\") pod \"80c1434e-0ccd-464a-9a85-182145f1dddb\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") "
Jul 21 04:11:18.504430 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.504398    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80c1434e-0ccd-464a-9a85-182145f1dddb-console-oauth-config\") pod \"80c1434e-0ccd-464a-9a85-182145f1dddb\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") "
Jul 21 04:11:18.504430 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.504417    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-trusted-ca-bundle\") pod \"80c1434e-0ccd-464a-9a85-182145f1dddb\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") "
Jul 21 04:11:18.504660 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.504475    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80c1434e-0ccd-464a-9a85-182145f1dddb-console-serving-cert\") pod \"80c1434e-0ccd-464a-9a85-182145f1dddb\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") "
Jul 21 04:11:18.504660 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.504495    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-oauth-serving-cert\") pod \"80c1434e-0ccd-464a-9a85-182145f1dddb\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") "
Jul 21 04:11:18.504660 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.504522    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-service-ca\") pod \"80c1434e-0ccd-464a-9a85-182145f1dddb\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") "
Jul 21 04:11:18.504660 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.504544    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rgf7\" (UniqueName: \"kubernetes.io/projected/80c1434e-0ccd-464a-9a85-182145f1dddb-kube-api-access-9rgf7\") pod \"80c1434e-0ccd-464a-9a85-182145f1dddb\" (UID: \"80c1434e-0ccd-464a-9a85-182145f1dddb\") "
Jul 21 04:11:18.504863 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.504797    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-console-config" (OuterVolumeSpecName: "console-config") pod "80c1434e-0ccd-464a-9a85-182145f1dddb" (UID: "80c1434e-0ccd-464a-9a85-182145f1dddb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:11:18.504965 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.504939    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "80c1434e-0ccd-464a-9a85-182145f1dddb" (UID: "80c1434e-0ccd-464a-9a85-182145f1dddb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:11:18.505014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.504878    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "80c1434e-0ccd-464a-9a85-182145f1dddb" (UID: "80c1434e-0ccd-464a-9a85-182145f1dddb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:11:18.505113 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.505089    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-service-ca" (OuterVolumeSpecName: "service-ca") pod "80c1434e-0ccd-464a-9a85-182145f1dddb" (UID: "80c1434e-0ccd-464a-9a85-182145f1dddb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:11:18.506618 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.506587    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80c1434e-0ccd-464a-9a85-182145f1dddb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "80c1434e-0ccd-464a-9a85-182145f1dddb" (UID: "80c1434e-0ccd-464a-9a85-182145f1dddb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:11:18.506717 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.506614    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80c1434e-0ccd-464a-9a85-182145f1dddb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "80c1434e-0ccd-464a-9a85-182145f1dddb" (UID: "80c1434e-0ccd-464a-9a85-182145f1dddb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:11:18.506823 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.506797    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80c1434e-0ccd-464a-9a85-182145f1dddb-kube-api-access-9rgf7" (OuterVolumeSpecName: "kube-api-access-9rgf7") pod "80c1434e-0ccd-464a-9a85-182145f1dddb" (UID: "80c1434e-0ccd-464a-9a85-182145f1dddb"). InnerVolumeSpecName "kube-api-access-9rgf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:11:18.605904 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.605872    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80c1434e-0ccd-464a-9a85-182145f1dddb-console-serving-cert\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:11:18.605904 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.605903    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-oauth-serving-cert\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:11:18.606011 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.605911    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-service-ca\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:11:18.606011 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.605919    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rgf7\" (UniqueName: \"kubernetes.io/projected/80c1434e-0ccd-464a-9a85-182145f1dddb-kube-api-access-9rgf7\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:11:18.606011 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.605927    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-console-config\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:11:18.606011 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.605934    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80c1434e-0ccd-464a-9a85-182145f1dddb-console-oauth-config\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:11:18.606011 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:18.605941    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c1434e-0ccd-464a-9a85-182145f1dddb-trusted-ca-bundle\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:11:19.150890 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:19.150861    2576 generic.go:356] "Generic (PLEG): container finished" podID="80c1434e-0ccd-464a-9a85-182145f1dddb" containerID="3b87f7331f40e10df28992f554fdc8d3065fd3f3ee84165f09f5edd86db79c6f" exitCode=0
Jul 21 04:11:19.151232 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:19.150924    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4dcdf6f4-nvqxm" event={"ID":"80c1434e-0ccd-464a-9a85-182145f1dddb","Type":"ContainerDied","Data":"3b87f7331f40e10df28992f554fdc8d3065fd3f3ee84165f09f5edd86db79c6f"}
Jul 21 04:11:19.151232 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:19.150960    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4dcdf6f4-nvqxm"
Jul 21 04:11:19.151232 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:19.150973    2576 scope.go:117] "RemoveContainer" containerID="3b87f7331f40e10df28992f554fdc8d3065fd3f3ee84165f09f5edd86db79c6f"
Jul 21 04:11:19.151232 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:19.150963    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4dcdf6f4-nvqxm" event={"ID":"80c1434e-0ccd-464a-9a85-182145f1dddb","Type":"ContainerDied","Data":"12994b6f72596755a3587b2e9d0c31397eed6a258f9e64ab31777177114dc1d3"}
Jul 21 04:11:19.158875 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:19.158859    2576 scope.go:117] "RemoveContainer" containerID="3b87f7331f40e10df28992f554fdc8d3065fd3f3ee84165f09f5edd86db79c6f"
Jul 21 04:11:19.159105 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:11:19.159086    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b87f7331f40e10df28992f554fdc8d3065fd3f3ee84165f09f5edd86db79c6f\": container with ID starting with 3b87f7331f40e10df28992f554fdc8d3065fd3f3ee84165f09f5edd86db79c6f not found: ID does not exist" containerID="3b87f7331f40e10df28992f554fdc8d3065fd3f3ee84165f09f5edd86db79c6f"
Jul 21 04:11:19.159153 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:19.159112    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b87f7331f40e10df28992f554fdc8d3065fd3f3ee84165f09f5edd86db79c6f"} err="failed to get container status \"3b87f7331f40e10df28992f554fdc8d3065fd3f3ee84165f09f5edd86db79c6f\": rpc error: code = NotFound desc = could not find container \"3b87f7331f40e10df28992f554fdc8d3065fd3f3ee84165f09f5edd86db79c6f\": container with ID starting with 3b87f7331f40e10df28992f554fdc8d3065fd3f3ee84165f09f5edd86db79c6f not found: ID does not exist"
Jul 21 04:11:19.167599 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:19.167581    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b4dcdf6f4-nvqxm"]
Jul 21 04:11:19.171767 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:19.171748    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b4dcdf6f4-nvqxm"]
Jul 21 04:11:20.664236 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:11:20.664200    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80c1434e-0ccd-464a-9a85-182145f1dddb" path="/var/lib/kubelet/pods/80c1434e-0ccd-464a-9a85-182145f1dddb/volumes"
Jul 21 04:12:13.674839 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.674801    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9554d6fbc-pk6v5"]
Jul 21 04:12:13.675232 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.675139    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c1434e-0ccd-464a-9a85-182145f1dddb" containerName="console"
Jul 21 04:12:13.675232 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.675151    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c1434e-0ccd-464a-9a85-182145f1dddb" containerName="console"
Jul 21 04:12:13.675326 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.675234    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="80c1434e-0ccd-464a-9a85-182145f1dddb" containerName="console"
Jul 21 04:12:13.679494 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.679475    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.692653 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.692618    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9554d6fbc-pk6v5"]
Jul 21 04:12:13.826852 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.826808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-trusted-ca-bundle\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.827036 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.826859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-service-ca\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.827036 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.826939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq4g8\" (UniqueName: \"kubernetes.io/projected/45d2d85a-4eda-4345-bc32-e291f9d9562d-kube-api-access-wq4g8\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.827036 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.826989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-serving-cert\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.827036 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.827013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-config\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.827180 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.827038    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-oauth-config\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.827180 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.827101    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-oauth-serving-cert\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.927673 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.927560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-serving-cert\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.927673 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.927603    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-config\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.927673 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.927623    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-oauth-config\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.927673 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.927673    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-oauth-serving-cert\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.927971 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.927702    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-trusted-ca-bundle\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.927971 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.927726    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-service-ca\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.927971 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.927764    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq4g8\" (UniqueName: \"kubernetes.io/projected/45d2d85a-4eda-4345-bc32-e291f9d9562d-kube-api-access-wq4g8\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.928502 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.928473    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-oauth-serving-cert\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.928629 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.928508    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-config\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.928629 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.928548    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-trusted-ca-bundle\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.928855 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.928831    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-service-ca\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.930162 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.930135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-serving-cert\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.930243 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.930178    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-oauth-config\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.937327 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.937304    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq4g8\" (UniqueName: \"kubernetes.io/projected/45d2d85a-4eda-4345-bc32-e291f9d9562d-kube-api-access-wq4g8\") pod \"console-9554d6fbc-pk6v5\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") " pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:13.989139 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:13.989099    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:14.125984 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:14.125955    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9554d6fbc-pk6v5"]
Jul 21 04:12:14.371776 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:14.371739    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9554d6fbc-pk6v5" event={"ID":"45d2d85a-4eda-4345-bc32-e291f9d9562d","Type":"ContainerStarted","Data":"7fc882f837a21d83e655e0a0dc65c79c794f67f76ba27ae9d5ee5bca305608a4"}
Jul 21 04:12:14.371963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:14.371794    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9554d6fbc-pk6v5" event={"ID":"45d2d85a-4eda-4345-bc32-e291f9d9562d","Type":"ContainerStarted","Data":"6e3f3d4d7cf078896abd395d69739028d49ce86e4238db6ff1c24066f554fd82"}
Jul 21 04:12:14.396253 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:14.396202    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9554d6fbc-pk6v5" podStartSLOduration=1.396186376 podStartE2EDuration="1.396186376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:12:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:12:14.395324706 +0000 UTC m=+484.212891490" watchObservedRunningTime="2026-07-21 04:12:14.396186376 +0000 UTC m=+484.213753159"
Jul 21 04:12:23.989587 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:23.989547    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:23.990178 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:23.989618    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:23.994218 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:23.994196    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:24.414989 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:24.414961    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:12:24.479985 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:24.479941    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f49c79ccb-jqxph"]
Jul 21 04:12:37.454424 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.454387    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz"]
Jul 21 04:12:37.457887 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.457864    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz"
Jul 21 04:12:37.460298 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.460278    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 04:12:37.461274 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.461252    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-755z7\""
Jul 21 04:12:37.461362 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.461256    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 04:12:37.469821 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.469801    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz"]
Jul 21 04:12:37.626999 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.626965    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c25q8\" (UniqueName: \"kubernetes.io/projected/f3632d6b-e1eb-4862-a76f-df6389f42286-kube-api-access-c25q8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz\" (UID: \"f3632d6b-e1eb-4862-a76f-df6389f42286\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz"
Jul 21 04:12:37.626999 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.627008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3632d6b-e1eb-4862-a76f-df6389f42286-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz\" (UID: \"f3632d6b-e1eb-4862-a76f-df6389f42286\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz"
Jul 21 04:12:37.627212 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.627086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3632d6b-e1eb-4862-a76f-df6389f42286-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz\" (UID: \"f3632d6b-e1eb-4862-a76f-df6389f42286\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz"
Jul 21 04:12:37.727631 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.727551    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c25q8\" (UniqueName: \"kubernetes.io/projected/f3632d6b-e1eb-4862-a76f-df6389f42286-kube-api-access-c25q8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz\" (UID: \"f3632d6b-e1eb-4862-a76f-df6389f42286\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz"
Jul 21 04:12:37.727631 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.727595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3632d6b-e1eb-4862-a76f-df6389f42286-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz\" (UID: \"f3632d6b-e1eb-4862-a76f-df6389f42286\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz"
Jul 21 04:12:37.727821 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.727662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3632d6b-e1eb-4862-a76f-df6389f42286-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz\" (UID: \"f3632d6b-e1eb-4862-a76f-df6389f42286\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz"
Jul 21 04:12:37.728105 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.728085    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3632d6b-e1eb-4862-a76f-df6389f42286-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz\" (UID: \"f3632d6b-e1eb-4862-a76f-df6389f42286\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz"
Jul 21 04:12:37.728141 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.728101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3632d6b-e1eb-4862-a76f-df6389f42286-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz\" (UID: \"f3632d6b-e1eb-4862-a76f-df6389f42286\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz"
Jul 21 04:12:37.737203 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.737176    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c25q8\" (UniqueName: \"kubernetes.io/projected/f3632d6b-e1eb-4862-a76f-df6389f42286-kube-api-access-c25q8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz\" (UID: \"f3632d6b-e1eb-4862-a76f-df6389f42286\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz"
Jul 21 04:12:37.767940 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.767906    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz"
Jul 21 04:12:37.901388 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:37.901350    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz"]
Jul 21 04:12:37.904822 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:12:37.904794    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3632d6b_e1eb_4862_a76f_df6389f42286.slice/crio-77374cfaa8a7595261baf559856b18e5b14d2b4fc3bf56dea665205a17fb8f5f WatchSource:0}: Error finding container 77374cfaa8a7595261baf559856b18e5b14d2b4fc3bf56dea665205a17fb8f5f: Status 404 returned error can't find the container with id 77374cfaa8a7595261baf559856b18e5b14d2b4fc3bf56dea665205a17fb8f5f
Jul 21 04:12:38.465826 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:38.465791    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz" event={"ID":"f3632d6b-e1eb-4862-a76f-df6389f42286","Type":"ContainerStarted","Data":"77374cfaa8a7595261baf559856b18e5b14d2b4fc3bf56dea665205a17fb8f5f"}
Jul 21 04:12:46.500582 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:46.500552    2576 generic.go:356] "Generic (PLEG): container finished" podID="f3632d6b-e1eb-4862-a76f-df6389f42286" containerID="4a801cc09bbe4b8c01a54ef3378807084811f50c6b350dfaf5ecfc6db2c59f59" exitCode=0
Jul 21 04:12:46.500957 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:46.500628    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz" event={"ID":"f3632d6b-e1eb-4862-a76f-df6389f42286","Type":"ContainerDied","Data":"4a801cc09bbe4b8c01a54ef3378807084811f50c6b350dfaf5ecfc6db2c59f59"}
Jul 21 04:12:48.511463 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:48.511429    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz" event={"ID":"f3632d6b-e1eb-4862-a76f-df6389f42286","Type":"ContainerStarted","Data":"1af01f237ab2b7b2c8da1685a6ca3f2528258aacc6e3a3924e87d6d98578a952"}
Jul 21 04:12:49.502931 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.502892    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f49c79ccb-jqxph" podUID="e45c92b3-faf6-49ad-8a70-7750a8b09e7e" containerName="console" containerID="cri-o://6b88cfd25a1eb8c7528495b4a9ebffa8f7b96d2a8385277bddcd086eca6c51ef" gracePeriod=15
Jul 21 04:12:49.517072 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.517043    2576 generic.go:356] "Generic (PLEG): container finished" podID="f3632d6b-e1eb-4862-a76f-df6389f42286" containerID="1af01f237ab2b7b2c8da1685a6ca3f2528258aacc6e3a3924e87d6d98578a952" exitCode=0
Jul 21 04:12:49.517381 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.517149    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz" event={"ID":"f3632d6b-e1eb-4862-a76f-df6389f42286","Type":"ContainerDied","Data":"1af01f237ab2b7b2c8da1685a6ca3f2528258aacc6e3a3924e87d6d98578a952"}
Jul 21 04:12:49.752823 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.752795    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:12:49.827109 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.827069    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-serving-cert\") pod \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") "
Jul 21 04:12:49.827109 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.827106    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-config\") pod \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") "
Jul 21 04:12:49.827295 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.827134    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-trusted-ca-bundle\") pod \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") "
Jul 21 04:12:49.827295 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.827269    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-oauth-serving-cert\") pod \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") "
Jul 21 04:12:49.827375 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.827335    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-oauth-config\") pod \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") "
Jul 21 04:12:49.827415 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.827386    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9zgb\" (UniqueName: \"kubernetes.io/projected/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-kube-api-access-h9zgb\") pod \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") "
Jul 21 04:12:49.827464 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.827411    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-service-ca\") pod \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\" (UID: \"e45c92b3-faf6-49ad-8a70-7750a8b09e7e\") "
Jul 21 04:12:49.827539 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.827515    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-config" (OuterVolumeSpecName: "console-config") pod "e45c92b3-faf6-49ad-8a70-7750a8b09e7e" (UID: "e45c92b3-faf6-49ad-8a70-7750a8b09e7e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:12:49.827596 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.827531    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e45c92b3-faf6-49ad-8a70-7750a8b09e7e" (UID: "e45c92b3-faf6-49ad-8a70-7750a8b09e7e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:12:49.827596 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.827551    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e45c92b3-faf6-49ad-8a70-7750a8b09e7e" (UID: "e45c92b3-faf6-49ad-8a70-7750a8b09e7e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:12:49.827858 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.827837    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-config\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:12:49.827936 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.827862    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-trusted-ca-bundle\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:12:49.827936 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.827875    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-oauth-serving-cert\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:12:49.828094 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.828070    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-service-ca" (OuterVolumeSpecName: "service-ca") pod "e45c92b3-faf6-49ad-8a70-7750a8b09e7e" (UID: "e45c92b3-faf6-49ad-8a70-7750a8b09e7e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:12:49.829328 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.829308    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e45c92b3-faf6-49ad-8a70-7750a8b09e7e" (UID: "e45c92b3-faf6-49ad-8a70-7750a8b09e7e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:12:49.829422 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.829406    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e45c92b3-faf6-49ad-8a70-7750a8b09e7e" (UID: "e45c92b3-faf6-49ad-8a70-7750a8b09e7e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:12:49.829653 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.829610    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-kube-api-access-h9zgb" (OuterVolumeSpecName: "kube-api-access-h9zgb") pod "e45c92b3-faf6-49ad-8a70-7750a8b09e7e" (UID: "e45c92b3-faf6-49ad-8a70-7750a8b09e7e"). InnerVolumeSpecName "kube-api-access-h9zgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:12:49.928847 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.928825    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-oauth-config\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:12:49.928847 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.928847    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9zgb\" (UniqueName: \"kubernetes.io/projected/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-kube-api-access-h9zgb\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:12:49.928985 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.928857    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-service-ca\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:12:49.928985 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:49.928865    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e45c92b3-faf6-49ad-8a70-7750a8b09e7e-console-serving-cert\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:12:50.523801 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:50.523767    2576 generic.go:356] "Generic (PLEG): container finished" podID="e45c92b3-faf6-49ad-8a70-7750a8b09e7e" containerID="6b88cfd25a1eb8c7528495b4a9ebffa8f7b96d2a8385277bddcd086eca6c51ef" exitCode=0
Jul 21 04:12:50.524237 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:50.523818    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f49c79ccb-jqxph"
Jul 21 04:12:50.524237 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:50.523857    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f49c79ccb-jqxph" event={"ID":"e45c92b3-faf6-49ad-8a70-7750a8b09e7e","Type":"ContainerDied","Data":"6b88cfd25a1eb8c7528495b4a9ebffa8f7b96d2a8385277bddcd086eca6c51ef"}
Jul 21 04:12:50.524237 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:50.523916    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f49c79ccb-jqxph" event={"ID":"e45c92b3-faf6-49ad-8a70-7750a8b09e7e","Type":"ContainerDied","Data":"f3e92c2769a3ca7c85306d8b5f27c2555ee75c73491295633a0327add635efdc"}
Jul 21 04:12:50.524237 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:50.523948    2576 scope.go:117] "RemoveContainer" containerID="6b88cfd25a1eb8c7528495b4a9ebffa8f7b96d2a8385277bddcd086eca6c51ef"
Jul 21 04:12:50.534279 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:50.534262    2576 scope.go:117] "RemoveContainer" containerID="6b88cfd25a1eb8c7528495b4a9ebffa8f7b96d2a8385277bddcd086eca6c51ef"
Jul 21 04:12:50.534567 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:12:50.534544    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b88cfd25a1eb8c7528495b4a9ebffa8f7b96d2a8385277bddcd086eca6c51ef\": container with ID starting with 6b88cfd25a1eb8c7528495b4a9ebffa8f7b96d2a8385277bddcd086eca6c51ef not found: ID does not exist" containerID="6b88cfd25a1eb8c7528495b4a9ebffa8f7b96d2a8385277bddcd086eca6c51ef"
Jul 21 04:12:50.534629 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:50.534577    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b88cfd25a1eb8c7528495b4a9ebffa8f7b96d2a8385277bddcd086eca6c51ef"} err="failed to get container status \"6b88cfd25a1eb8c7528495b4a9ebffa8f7b96d2a8385277bddcd086eca6c51ef\": rpc error: code = NotFound desc = could not find container \"6b88cfd25a1eb8c7528495b4a9ebffa8f7b96d2a8385277bddcd086eca6c51ef\": container with ID starting with 6b88cfd25a1eb8c7528495b4a9ebffa8f7b96d2a8385277bddcd086eca6c51ef not found: ID does not exist"
Jul 21 04:12:50.547580 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:50.547552    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f49c79ccb-jqxph"]
Jul 21 04:12:50.551315 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:50.551291    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f49c79ccb-jqxph"]
Jul 21 04:12:50.665237 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:50.665200    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e45c92b3-faf6-49ad-8a70-7750a8b09e7e" path="/var/lib/kubelet/pods/e45c92b3-faf6-49ad-8a70-7750a8b09e7e/volumes"
Jul 21 04:12:57.558109 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:57.558077    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz" event={"ID":"f3632d6b-e1eb-4862-a76f-df6389f42286","Type":"ContainerStarted","Data":"7d6fb02ce40ecc83b5c769397115d029302c5c962507a7f08027265c6fbc3811"}
Jul 21 04:12:57.578501 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:57.578454    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz" podStartSLOduration=2.239339895 podStartE2EDuration="20.578434822s" totalImagesPullingTime="18.339094927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:12:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:12:57.576694748 +0000 UTC m=+527.394261537" watchObservedRunningTime="2026-07-21 04:12:57.578434822 +0000 UTC m=+527.396001606"
Jul 21 04:12:58.565515 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:58.565481    2576 generic.go:356] "Generic (PLEG): container finished" podID="f3632d6b-e1eb-4862-a76f-df6389f42286" containerID="7d6fb02ce40ecc83b5c769397115d029302c5c962507a7f08027265c6fbc3811" exitCode=0
Jul 21 04:12:58.565896 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:58.565569    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz" event={"ID":"f3632d6b-e1eb-4862-a76f-df6389f42286","Type":"ContainerDied","Data":"7d6fb02ce40ecc83b5c769397115d029302c5c962507a7f08027265c6fbc3811"}
Jul 21 04:12:59.699042 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:59.699020    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz"
Jul 21 04:12:59.813496 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:59.813465    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c25q8\" (UniqueName: \"kubernetes.io/projected/f3632d6b-e1eb-4862-a76f-df6389f42286-kube-api-access-c25q8\") pod \"f3632d6b-e1eb-4862-a76f-df6389f42286\" (UID: \"f3632d6b-e1eb-4862-a76f-df6389f42286\") "
Jul 21 04:12:59.813655 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:59.813544    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3632d6b-e1eb-4862-a76f-df6389f42286-util\") pod \"f3632d6b-e1eb-4862-a76f-df6389f42286\" (UID: \"f3632d6b-e1eb-4862-a76f-df6389f42286\") "
Jul 21 04:12:59.813732 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:59.813712    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3632d6b-e1eb-4862-a76f-df6389f42286-bundle\") pod \"f3632d6b-e1eb-4862-a76f-df6389f42286\" (UID: \"f3632d6b-e1eb-4862-a76f-df6389f42286\") "
Jul 21 04:12:59.814316 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:59.814293    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3632d6b-e1eb-4862-a76f-df6389f42286-bundle" (OuterVolumeSpecName: "bundle") pod "f3632d6b-e1eb-4862-a76f-df6389f42286" (UID: "f3632d6b-e1eb-4862-a76f-df6389f42286"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:12:59.815830 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:59.815806    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3632d6b-e1eb-4862-a76f-df6389f42286-kube-api-access-c25q8" (OuterVolumeSpecName: "kube-api-access-c25q8") pod "f3632d6b-e1eb-4862-a76f-df6389f42286" (UID: "f3632d6b-e1eb-4862-a76f-df6389f42286"). InnerVolumeSpecName "kube-api-access-c25q8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:12:59.817577 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:59.817559    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3632d6b-e1eb-4862-a76f-df6389f42286-util" (OuterVolumeSpecName: "util") pod "f3632d6b-e1eb-4862-a76f-df6389f42286" (UID: "f3632d6b-e1eb-4862-a76f-df6389f42286"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:12:59.914503 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:59.914482    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c25q8\" (UniqueName: \"kubernetes.io/projected/f3632d6b-e1eb-4862-a76f-df6389f42286-kube-api-access-c25q8\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:12:59.914503 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:59.914503    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3632d6b-e1eb-4862-a76f-df6389f42286-util\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:12:59.914632 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:12:59.914513    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3632d6b-e1eb-4862-a76f-df6389f42286-bundle\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:13:00.575374 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:00.575342    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz"
Jul 21 04:13:00.575374 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:00.575356    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405wgnz" event={"ID":"f3632d6b-e1eb-4862-a76f-df6389f42286","Type":"ContainerDied","Data":"77374cfaa8a7595261baf559856b18e5b14d2b4fc3bf56dea665205a17fb8f5f"}
Jul 21 04:13:00.575578 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:00.575426    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77374cfaa8a7595261baf559856b18e5b14d2b4fc3bf56dea665205a17fb8f5f"
Jul 21 04:13:05.696796 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.696712    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqmhc"]
Jul 21 04:13:05.697178 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.697015    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e45c92b3-faf6-49ad-8a70-7750a8b09e7e" containerName="console"
Jul 21 04:13:05.697178 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.697026    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e45c92b3-faf6-49ad-8a70-7750a8b09e7e" containerName="console"
Jul 21 04:13:05.697178 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.697036    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3632d6b-e1eb-4862-a76f-df6389f42286" containerName="extract"
Jul 21 04:13:05.697178 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.697041    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3632d6b-e1eb-4862-a76f-df6389f42286" containerName="extract"
Jul 21 04:13:05.697178 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.697052    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3632d6b-e1eb-4862-a76f-df6389f42286" containerName="pull"
Jul 21 04:13:05.697178 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.697057    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3632d6b-e1eb-4862-a76f-df6389f42286" containerName="pull"
Jul 21 04:13:05.697178 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.697065    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3632d6b-e1eb-4862-a76f-df6389f42286" containerName="util"
Jul 21 04:13:05.697178 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.697070    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3632d6b-e1eb-4862-a76f-df6389f42286" containerName="util"
Jul 21 04:13:05.697178 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.697126    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3632d6b-e1eb-4862-a76f-df6389f42286" containerName="extract"
Jul 21 04:13:05.697178 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.697133    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e45c92b3-faf6-49ad-8a70-7750a8b09e7e" containerName="console"
Jul 21 04:13:05.721374 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.721345    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqmhc"]
Jul 21 04:13:05.721532 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.721438    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqmhc"
Jul 21 04:13:05.723953 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.723916    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 21 04:13:05.723953 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.723945    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vk4zk\""
Jul 21 04:13:05.724161 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.724070    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:13:05.865064 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.865022    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/776d2e42-5d21-4aff-99fc-2b1f0a4a5ee9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqmhc\" (UID: \"776d2e42-5d21-4aff-99fc-2b1f0a4a5ee9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqmhc"
Jul 21 04:13:05.865283 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.865152    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwfmt\" (UniqueName: \"kubernetes.io/projected/776d2e42-5d21-4aff-99fc-2b1f0a4a5ee9-kube-api-access-zwfmt\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqmhc\" (UID: \"776d2e42-5d21-4aff-99fc-2b1f0a4a5ee9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqmhc"
Jul 21 04:13:05.966483 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.966396    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwfmt\" (UniqueName: \"kubernetes.io/projected/776d2e42-5d21-4aff-99fc-2b1f0a4a5ee9-kube-api-access-zwfmt\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqmhc\" (UID: \"776d2e42-5d21-4aff-99fc-2b1f0a4a5ee9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqmhc"
Jul 21 04:13:05.966483 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.966441    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/776d2e42-5d21-4aff-99fc-2b1f0a4a5ee9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqmhc\" (UID: \"776d2e42-5d21-4aff-99fc-2b1f0a4a5ee9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqmhc"
Jul 21 04:13:05.966839 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.966822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/776d2e42-5d21-4aff-99fc-2b1f0a4a5ee9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqmhc\" (UID: \"776d2e42-5d21-4aff-99fc-2b1f0a4a5ee9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqmhc"
Jul 21 04:13:05.975230 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:05.975201    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwfmt\" (UniqueName: \"kubernetes.io/projected/776d2e42-5d21-4aff-99fc-2b1f0a4a5ee9-kube-api-access-zwfmt\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqmhc\" (UID: \"776d2e42-5d21-4aff-99fc-2b1f0a4a5ee9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqmhc"
Jul 21 04:13:06.030403 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:06.030363    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqmhc"
Jul 21 04:13:06.194837 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:06.194777    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqmhc"]
Jul 21 04:13:06.200415 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:13:06.200372    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod776d2e42_5d21_4aff_99fc_2b1f0a4a5ee9.slice/crio-f17461317aff2821bbf2c8e76b520f0e94d5161c6ca3a00d2d9ab4842f78fd9c WatchSource:0}: Error finding container f17461317aff2821bbf2c8e76b520f0e94d5161c6ca3a00d2d9ab4842f78fd9c: Status 404 returned error can't find the container with id f17461317aff2821bbf2c8e76b520f0e94d5161c6ca3a00d2d9ab4842f78fd9c
Jul 21 04:13:06.601346 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:06.601309    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqmhc" event={"ID":"776d2e42-5d21-4aff-99fc-2b1f0a4a5ee9","Type":"ContainerStarted","Data":"f17461317aff2821bbf2c8e76b520f0e94d5161c6ca3a00d2d9ab4842f78fd9c"}
Jul 21 04:13:08.613203 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:08.613159    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqmhc" event={"ID":"776d2e42-5d21-4aff-99fc-2b1f0a4a5ee9","Type":"ContainerStarted","Data":"3b68b4cf53e8a867872bf0a911186e8ca412161867c3d21f3e445ecd39535ba6"}
Jul 21 04:13:08.632711 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:08.632631    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqmhc" podStartSLOduration=1.395760134 podStartE2EDuration="3.632611294s" totalImagesPullingTime="2.23685116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:13:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:13:08.631442656 +0000 UTC m=+538.449009439" watchObservedRunningTime="2026-07-21 04:13:08.632611294 +0000 UTC m=+538.450178079"
Jul 21 04:13:09.984272 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:09.984223    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx"]
Jul 21 04:13:09.987099 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:09.987076    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx"
Jul 21 04:13:09.989436 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:09.989409    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-755z7\""
Jul 21 04:13:09.989556 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:09.989457    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 04:13:09.990114 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:09.990099    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 04:13:09.997386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:09.997363    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx"]
Jul 21 04:13:10.102987 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.102956    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftc7s\" (UniqueName: \"kubernetes.io/projected/a5d12a74-d6d8-425a-8192-14be09fec332-kube-api-access-ftc7s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx\" (UID: \"a5d12a74-d6d8-425a-8192-14be09fec332\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx"
Jul 21 04:13:10.103173 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.102996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5d12a74-d6d8-425a-8192-14be09fec332-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx\" (UID: \"a5d12a74-d6d8-425a-8192-14be09fec332\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx"
Jul 21 04:13:10.103173 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.103031    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5d12a74-d6d8-425a-8192-14be09fec332-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx\" (UID: \"a5d12a74-d6d8-425a-8192-14be09fec332\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx"
Jul 21 04:13:10.204338 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.204302    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5d12a74-d6d8-425a-8192-14be09fec332-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx\" (UID: \"a5d12a74-d6d8-425a-8192-14be09fec332\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx"
Jul 21 04:13:10.204494 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.204365    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftc7s\" (UniqueName: \"kubernetes.io/projected/a5d12a74-d6d8-425a-8192-14be09fec332-kube-api-access-ftc7s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx\" (UID: \"a5d12a74-d6d8-425a-8192-14be09fec332\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx"
Jul 21 04:13:10.204494 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.204392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5d12a74-d6d8-425a-8192-14be09fec332-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx\" (UID: \"a5d12a74-d6d8-425a-8192-14be09fec332\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx"
Jul 21 04:13:10.209674 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.205102    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5d12a74-d6d8-425a-8192-14be09fec332-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx\" (UID: \"a5d12a74-d6d8-425a-8192-14be09fec332\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx"
Jul 21 04:13:10.209674 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.205098    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5d12a74-d6d8-425a-8192-14be09fec332-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx\" (UID: \"a5d12a74-d6d8-425a-8192-14be09fec332\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx"
Jul 21 04:13:10.213125 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.213105    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftc7s\" (UniqueName: \"kubernetes.io/projected/a5d12a74-d6d8-425a-8192-14be09fec332-kube-api-access-ftc7s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx\" (UID: \"a5d12a74-d6d8-425a-8192-14be09fec332\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx"
Jul 21 04:13:10.297136 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.297081    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx"
Jul 21 04:13:10.422181 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.422148    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-f8kgs"]
Jul 21 04:13:10.425418 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.425280    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-f8kgs"
Jul 21 04:13:10.425969 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.425899    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx"]
Jul 21 04:13:10.427600 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.427573    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 04:13:10.427725 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.427612    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zk5ns\""
Jul 21 04:13:10.427725 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.427619    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 04:13:10.428161 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:13:10.428143    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d12a74_d6d8_425a_8192_14be09fec332.slice/crio-f50f553e18a9e601ff2af7df2affd613798f86c826ba0dd5a5b7743b6c5417f5 WatchSource:0}: Error finding container f50f553e18a9e601ff2af7df2affd613798f86c826ba0dd5a5b7743b6c5417f5: Status 404 returned error can't find the container with id f50f553e18a9e601ff2af7df2affd613798f86c826ba0dd5a5b7743b6c5417f5
Jul 21 04:13:10.433462 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.433440    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-f8kgs"]
Jul 21 04:13:10.508235 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.508206    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91bb8915-32e1-4833-9a4d-5bed8aefa6e9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-f8kgs\" (UID: \"91bb8915-32e1-4833-9a4d-5bed8aefa6e9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f8kgs"
Jul 21 04:13:10.508405 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.508387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhkvt\" (UniqueName: \"kubernetes.io/projected/91bb8915-32e1-4833-9a4d-5bed8aefa6e9-kube-api-access-bhkvt\") pod \"cert-manager-webhook-6486ffd997-f8kgs\" (UID: \"91bb8915-32e1-4833-9a4d-5bed8aefa6e9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f8kgs"
Jul 21 04:13:10.609469 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.609445    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91bb8915-32e1-4833-9a4d-5bed8aefa6e9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-f8kgs\" (UID: \"91bb8915-32e1-4833-9a4d-5bed8aefa6e9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f8kgs"
Jul 21 04:13:10.609560 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.609504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhkvt\" (UniqueName: \"kubernetes.io/projected/91bb8915-32e1-4833-9a4d-5bed8aefa6e9-kube-api-access-bhkvt\") pod \"cert-manager-webhook-6486ffd997-f8kgs\" (UID: \"91bb8915-32e1-4833-9a4d-5bed8aefa6e9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f8kgs"
Jul 21 04:13:10.622166 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.622144    2576 generic.go:356] "Generic (PLEG): container finished" podID="a5d12a74-d6d8-425a-8192-14be09fec332" containerID="f8bc5e9a222116a20d461ca7123f051a1157babb530df1cc797e2608bb81c719" exitCode=0
Jul 21 04:13:10.622280 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.622190    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx" event={"ID":"a5d12a74-d6d8-425a-8192-14be09fec332","Type":"ContainerDied","Data":"f8bc5e9a222116a20d461ca7123f051a1157babb530df1cc797e2608bb81c719"}
Jul 21 04:13:10.622280 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.622222    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx" event={"ID":"a5d12a74-d6d8-425a-8192-14be09fec332","Type":"ContainerStarted","Data":"f50f553e18a9e601ff2af7df2affd613798f86c826ba0dd5a5b7743b6c5417f5"}
Jul 21 04:13:10.622608 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.622589    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91bb8915-32e1-4833-9a4d-5bed8aefa6e9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-f8kgs\" (UID: \"91bb8915-32e1-4833-9a4d-5bed8aefa6e9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f8kgs"
Jul 21 04:13:10.622794 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.622774    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 04:13:10.633235 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.633216    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 04:13:10.643364 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.643346    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhkvt\" (UniqueName: \"kubernetes.io/projected/91bb8915-32e1-4833-9a4d-5bed8aefa6e9-kube-api-access-bhkvt\") pod \"cert-manager-webhook-6486ffd997-f8kgs\" (UID: \"91bb8915-32e1-4833-9a4d-5bed8aefa6e9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f8kgs"
Jul 21 04:13:10.755026 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.755002    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zk5ns\""
Jul 21 04:13:10.763083 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.763064    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-f8kgs"
Jul 21 04:13:10.890233 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:10.890208    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-f8kgs"]
Jul 21 04:13:10.892976 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:13:10.892952    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91bb8915_32e1_4833_9a4d_5bed8aefa6e9.slice/crio-e9df5e733b17062cbd6e2a9e5da037d0886cac401a6f5686ffa647164ee8d1eb WatchSource:0}: Error finding container e9df5e733b17062cbd6e2a9e5da037d0886cac401a6f5686ffa647164ee8d1eb: Status 404 returned error can't find the container with id e9df5e733b17062cbd6e2a9e5da037d0886cac401a6f5686ffa647164ee8d1eb
Jul 21 04:13:11.631144 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:11.631102    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-f8kgs" event={"ID":"91bb8915-32e1-4833-9a4d-5bed8aefa6e9","Type":"ContainerStarted","Data":"e9df5e733b17062cbd6e2a9e5da037d0886cac401a6f5686ffa647164ee8d1eb"}
Jul 21 04:13:13.644937 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:13.644829    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx" event={"ID":"a5d12a74-d6d8-425a-8192-14be09fec332","Type":"ContainerStarted","Data":"044824cdd14e009acbd19be10d33924d69ba04b98ec5f5dc7eeb9d671b5406c6"}
Jul 21 04:13:13.647019 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:13.646978    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-f8kgs" event={"ID":"91bb8915-32e1-4833-9a4d-5bed8aefa6e9","Type":"ContainerStarted","Data":"264f70ef55b25e0eee5ff54e459a0866a7482478d9ca2327cd45c5ef82b02f30"}
Jul 21 04:13:13.647136 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:13.647048    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-f8kgs"
Jul 21 04:13:13.681889 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:13.681831    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-f8kgs" podStartSLOduration=1.036734703 podStartE2EDuration="3.681808867s" totalImagesPullingTime="2.645074164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:13:13.680834332 +0000 UTC m=+543.498401134" watchObservedRunningTime="2026-07-21 04:13:13.681808867 +0000 UTC m=+543.499375651"
Jul 21 04:13:14.654467 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:14.654432    2576 generic.go:356] "Generic (PLEG): container finished" podID="a5d12a74-d6d8-425a-8192-14be09fec332" containerID="044824cdd14e009acbd19be10d33924d69ba04b98ec5f5dc7eeb9d671b5406c6" exitCode=0
Jul 21 04:13:14.654826 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:14.654509    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx" event={"ID":"a5d12a74-d6d8-425a-8192-14be09fec332","Type":"ContainerDied","Data":"044824cdd14e009acbd19be10d33924d69ba04b98ec5f5dc7eeb9d671b5406c6"}
Jul 21 04:13:15.661719 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:15.661687    2576 generic.go:356] "Generic (PLEG): container finished" podID="a5d12a74-d6d8-425a-8192-14be09fec332" containerID="0f07e7bb2b6d632d453981565f61d4855c32ee0386063a6f0d76ce102ae2b9ef" exitCode=0
Jul 21 04:13:15.662090 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:15.661726    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx" event={"ID":"a5d12a74-d6d8-425a-8192-14be09fec332","Type":"ContainerDied","Data":"0f07e7bb2b6d632d453981565f61d4855c32ee0386063a6f0d76ce102ae2b9ef"}
Jul 21 04:13:15.822075 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:15.822038    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cfsww"]
Jul 21 04:13:15.825925 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:15.825909    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfsww"
Jul 21 04:13:15.828076 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:15.828059    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-q5n68\""
Jul 21 04:13:15.832430 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:15.832409    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cfsww"]
Jul 21 04:13:15.959276 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:15.959212    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94087e3a-20ea-4209-b12c-0412e1620e32-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cfsww\" (UID: \"94087e3a-20ea-4209-b12c-0412e1620e32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfsww"
Jul 21 04:13:15.959276 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:15.959266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc7dt\" (UniqueName: \"kubernetes.io/projected/94087e3a-20ea-4209-b12c-0412e1620e32-kube-api-access-zc7dt\") pod \"cert-manager-cainjector-559cdd8c87-cfsww\" (UID: \"94087e3a-20ea-4209-b12c-0412e1620e32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfsww"
Jul 21 04:13:16.059828 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:16.059785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc7dt\" (UniqueName: \"kubernetes.io/projected/94087e3a-20ea-4209-b12c-0412e1620e32-kube-api-access-zc7dt\") pod \"cert-manager-cainjector-559cdd8c87-cfsww\" (UID: \"94087e3a-20ea-4209-b12c-0412e1620e32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfsww"
Jul 21 04:13:16.059984 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:16.059856    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94087e3a-20ea-4209-b12c-0412e1620e32-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cfsww\" (UID: \"94087e3a-20ea-4209-b12c-0412e1620e32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfsww"
Jul 21 04:13:16.070931 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:16.070902    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94087e3a-20ea-4209-b12c-0412e1620e32-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cfsww\" (UID: \"94087e3a-20ea-4209-b12c-0412e1620e32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfsww"
Jul 21 04:13:16.071056 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:16.070967    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc7dt\" (UniqueName: \"kubernetes.io/projected/94087e3a-20ea-4209-b12c-0412e1620e32-kube-api-access-zc7dt\") pod \"cert-manager-cainjector-559cdd8c87-cfsww\" (UID: \"94087e3a-20ea-4209-b12c-0412e1620e32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfsww"
Jul 21 04:13:16.136026 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:16.136002    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfsww"
Jul 21 04:13:16.263571 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:16.263548    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cfsww"]
Jul 21 04:13:16.265198 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:13:16.265172    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94087e3a_20ea_4209_b12c_0412e1620e32.slice/crio-2da3f5db4be4de367ff250f22c1979aa9c1c85b061e1e149015e229b86bf67cb WatchSource:0}: Error finding container 2da3f5db4be4de367ff250f22c1979aa9c1c85b061e1e149015e229b86bf67cb: Status 404 returned error can't find the container with id 2da3f5db4be4de367ff250f22c1979aa9c1c85b061e1e149015e229b86bf67cb
Jul 21 04:13:16.668384 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:16.668344    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfsww" event={"ID":"94087e3a-20ea-4209-b12c-0412e1620e32","Type":"ContainerStarted","Data":"603f8a0fa78cee9acc00d81f6e750e80f5028b83f66c784cd595702db11eb1ca"}
Jul 21 04:13:16.668384 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:16.668385    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfsww" event={"ID":"94087e3a-20ea-4209-b12c-0412e1620e32","Type":"ContainerStarted","Data":"2da3f5db4be4de367ff250f22c1979aa9c1c85b061e1e149015e229b86bf67cb"}
Jul 21 04:13:16.684505 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:16.684461    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfsww" podStartSLOduration=1.684445634 podStartE2EDuration="1.684445634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:13:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:13:16.683274047 +0000 UTC m=+546.500840832" watchObservedRunningTime="2026-07-21 04:13:16.684445634 +0000 UTC m=+546.502012417"
Jul 21 04:13:16.794939 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:16.794892    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx"
Jul 21 04:13:16.967976 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:16.967896    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5d12a74-d6d8-425a-8192-14be09fec332-util\") pod \"a5d12a74-d6d8-425a-8192-14be09fec332\" (UID: \"a5d12a74-d6d8-425a-8192-14be09fec332\") "
Jul 21 04:13:16.967976 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:16.967939    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5d12a74-d6d8-425a-8192-14be09fec332-bundle\") pod \"a5d12a74-d6d8-425a-8192-14be09fec332\" (UID: \"a5d12a74-d6d8-425a-8192-14be09fec332\") "
Jul 21 04:13:16.968172 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:16.967994    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftc7s\" (UniqueName: \"kubernetes.io/projected/a5d12a74-d6d8-425a-8192-14be09fec332-kube-api-access-ftc7s\") pod \"a5d12a74-d6d8-425a-8192-14be09fec332\" (UID: \"a5d12a74-d6d8-425a-8192-14be09fec332\") "
Jul 21 04:13:16.968373 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:16.968335    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d12a74-d6d8-425a-8192-14be09fec332-bundle" (OuterVolumeSpecName: "bundle") pod "a5d12a74-d6d8-425a-8192-14be09fec332" (UID: "a5d12a74-d6d8-425a-8192-14be09fec332"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:13:16.970115 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:16.970092    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5d12a74-d6d8-425a-8192-14be09fec332-kube-api-access-ftc7s" (OuterVolumeSpecName: "kube-api-access-ftc7s") pod "a5d12a74-d6d8-425a-8192-14be09fec332" (UID: "a5d12a74-d6d8-425a-8192-14be09fec332"). InnerVolumeSpecName "kube-api-access-ftc7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:13:16.972325 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:16.972305    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d12a74-d6d8-425a-8192-14be09fec332-util" (OuterVolumeSpecName: "util") pod "a5d12a74-d6d8-425a-8192-14be09fec332" (UID: "a5d12a74-d6d8-425a-8192-14be09fec332"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:13:17.068772 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:17.068744    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5d12a74-d6d8-425a-8192-14be09fec332-util\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:13:17.068772 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:17.068768    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5d12a74-d6d8-425a-8192-14be09fec332-bundle\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:13:17.068772 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:17.068777    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftc7s\" (UniqueName: \"kubernetes.io/projected/a5d12a74-d6d8-425a-8192-14be09fec332-kube-api-access-ftc7s\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:13:17.675452 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:17.675416    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx" event={"ID":"a5d12a74-d6d8-425a-8192-14be09fec332","Type":"ContainerDied","Data":"f50f553e18a9e601ff2af7df2affd613798f86c826ba0dd5a5b7743b6c5417f5"}
Jul 21 04:13:17.675452 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:17.675438    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplhrx"
Jul 21 04:13:17.676001 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:17.675465    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f50f553e18a9e601ff2af7df2affd613798f86c826ba0dd5a5b7743b6c5417f5"
Jul 21 04:13:19.656055 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:19.656027    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-f8kgs"
Jul 21 04:13:34.044080 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.044045    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm"]
Jul 21 04:13:34.044489 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.044342    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d12a74-d6d8-425a-8192-14be09fec332" containerName="extract"
Jul 21 04:13:34.044489 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.044352    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d12a74-d6d8-425a-8192-14be09fec332" containerName="extract"
Jul 21 04:13:34.044489 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.044364    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d12a74-d6d8-425a-8192-14be09fec332" containerName="util"
Jul 21 04:13:34.044489 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.044369    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d12a74-d6d8-425a-8192-14be09fec332" containerName="util"
Jul 21 04:13:34.044489 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.044383    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d12a74-d6d8-425a-8192-14be09fec332" containerName="pull"
Jul 21 04:13:34.044489 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.044388    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d12a74-d6d8-425a-8192-14be09fec332" containerName="pull"
Jul 21 04:13:34.044489 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.044444    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5d12a74-d6d8-425a-8192-14be09fec332" containerName="extract"
Jul 21 04:13:34.046819 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.046804    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm"
Jul 21 04:13:34.049060 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.049035    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 04:13:34.049060 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.049050    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-755z7\""
Jul 21 04:13:34.049860 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.049840    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 04:13:34.055600 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.055577    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm"]
Jul 21 04:13:34.100748 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.100718    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8l4t\" (UniqueName: \"kubernetes.io/projected/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-kube-api-access-s8l4t\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm\" (UID: \"e4edc515-dcb1-4d07-ae16-3275ba8f49bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm"
Jul 21 04:13:34.100870 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.100760    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm\" (UID: \"e4edc515-dcb1-4d07-ae16-3275ba8f49bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm"
Jul 21 04:13:34.100870 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.100841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm\" (UID: \"e4edc515-dcb1-4d07-ae16-3275ba8f49bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm"
Jul 21 04:13:34.202008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.201979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8l4t\" (UniqueName: \"kubernetes.io/projected/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-kube-api-access-s8l4t\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm\" (UID: \"e4edc515-dcb1-4d07-ae16-3275ba8f49bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm"
Jul 21 04:13:34.202109 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.202019    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm\" (UID: \"e4edc515-dcb1-4d07-ae16-3275ba8f49bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm"
Jul 21 04:13:34.202109 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.202061    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm\" (UID: \"e4edc515-dcb1-4d07-ae16-3275ba8f49bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm"
Jul 21 04:13:34.202366 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.202348    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm\" (UID: \"e4edc515-dcb1-4d07-ae16-3275ba8f49bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm"
Jul 21 04:13:34.202433 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.202395    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm\" (UID: \"e4edc515-dcb1-4d07-ae16-3275ba8f49bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm"
Jul 21 04:13:34.210173 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.210143    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8l4t\" (UniqueName: \"kubernetes.io/projected/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-kube-api-access-s8l4t\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm\" (UID: \"e4edc515-dcb1-4d07-ae16-3275ba8f49bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm"
Jul 21 04:13:34.355920 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.355890    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm"
Jul 21 04:13:34.495698 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.495674    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm"]
Jul 21 04:13:34.500043 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:13:34.500009    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4edc515_dcb1_4d07_ae16_3275ba8f49bd.slice/crio-fed0ae2498856a9a0037c790f8490f902730f86347a60a13b7e6ef8f99b3805e WatchSource:0}: Error finding container fed0ae2498856a9a0037c790f8490f902730f86347a60a13b7e6ef8f99b3805e: Status 404 returned error can't find the container with id fed0ae2498856a9a0037c790f8490f902730f86347a60a13b7e6ef8f99b3805e
Jul 21 04:13:34.755311 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.755238    2576 generic.go:356] "Generic (PLEG): container finished" podID="e4edc515-dcb1-4d07-ae16-3275ba8f49bd" containerID="7abca7d951a58f7dcadfcdbdb783ef9304865fa7a768fe8c093572600c1c2360" exitCode=0
Jul 21 04:13:34.755311 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.755302    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm" event={"ID":"e4edc515-dcb1-4d07-ae16-3275ba8f49bd","Type":"ContainerDied","Data":"7abca7d951a58f7dcadfcdbdb783ef9304865fa7a768fe8c093572600c1c2360"}
Jul 21 04:13:34.755466 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:34.755337    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm" event={"ID":"e4edc515-dcb1-4d07-ae16-3275ba8f49bd","Type":"ContainerStarted","Data":"fed0ae2498856a9a0037c790f8490f902730f86347a60a13b7e6ef8f99b3805e"}
Jul 21 04:13:35.761575 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:35.761546    2576 generic.go:356] "Generic (PLEG): container finished" podID="e4edc515-dcb1-4d07-ae16-3275ba8f49bd" containerID="51608a226749595f221ce00f30d09ad5b55f02244a974c5179ae7f8f4132ec36" exitCode=0
Jul 21 04:13:35.761904 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:35.761612    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm" event={"ID":"e4edc515-dcb1-4d07-ae16-3275ba8f49bd","Type":"ContainerDied","Data":"51608a226749595f221ce00f30d09ad5b55f02244a974c5179ae7f8f4132ec36"}
Jul 21 04:13:36.768614 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:36.768583    2576 generic.go:356] "Generic (PLEG): container finished" podID="e4edc515-dcb1-4d07-ae16-3275ba8f49bd" containerID="990775ce98d77489b3a11402facbd422e4d2aafbe0346f9a83163398bcac9d79" exitCode=0
Jul 21 04:13:36.769067 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:36.768669    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm" event={"ID":"e4edc515-dcb1-4d07-ae16-3275ba8f49bd","Type":"ContainerDied","Data":"990775ce98d77489b3a11402facbd422e4d2aafbe0346f9a83163398bcac9d79"}
Jul 21 04:13:37.901181 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:37.901153    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm"
Jul 21 04:13:37.931379 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:37.931354    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-util\") pod \"e4edc515-dcb1-4d07-ae16-3275ba8f49bd\" (UID: \"e4edc515-dcb1-4d07-ae16-3275ba8f49bd\") "
Jul 21 04:13:37.931492 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:37.931446    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8l4t\" (UniqueName: \"kubernetes.io/projected/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-kube-api-access-s8l4t\") pod \"e4edc515-dcb1-4d07-ae16-3275ba8f49bd\" (UID: \"e4edc515-dcb1-4d07-ae16-3275ba8f49bd\") "
Jul 21 04:13:37.931538 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:37.931488    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-bundle\") pod \"e4edc515-dcb1-4d07-ae16-3275ba8f49bd\" (UID: \"e4edc515-dcb1-4d07-ae16-3275ba8f49bd\") "
Jul 21 04:13:37.932381 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:37.932351    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-bundle" (OuterVolumeSpecName: "bundle") pod "e4edc515-dcb1-4d07-ae16-3275ba8f49bd" (UID: "e4edc515-dcb1-4d07-ae16-3275ba8f49bd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:13:37.933689 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:37.933656    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-kube-api-access-s8l4t" (OuterVolumeSpecName: "kube-api-access-s8l4t") pod "e4edc515-dcb1-4d07-ae16-3275ba8f49bd" (UID: "e4edc515-dcb1-4d07-ae16-3275ba8f49bd"). InnerVolumeSpecName "kube-api-access-s8l4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:13:37.937673 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:37.937622    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-util" (OuterVolumeSpecName: "util") pod "e4edc515-dcb1-4d07-ae16-3275ba8f49bd" (UID: "e4edc515-dcb1-4d07-ae16-3275ba8f49bd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:13:38.032557 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:38.032496    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-bundle\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:13:38.032557 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:38.032518    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-util\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:13:38.032557 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:38.032527    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8l4t\" (UniqueName: \"kubernetes.io/projected/e4edc515-dcb1-4d07-ae16-3275ba8f49bd-kube-api-access-s8l4t\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:13:38.782586 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:38.782559    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm"
Jul 21 04:13:38.782738 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:38.782562    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmfgzm" event={"ID":"e4edc515-dcb1-4d07-ae16-3275ba8f49bd","Type":"ContainerDied","Data":"fed0ae2498856a9a0037c790f8490f902730f86347a60a13b7e6ef8f99b3805e"}
Jul 21 04:13:38.782738 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:38.782679    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fed0ae2498856a9a0037c790f8490f902730f86347a60a13b7e6ef8f99b3805e"
Jul 21 04:13:44.866661 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.866605    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"]
Jul 21 04:13:44.867015 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.866927    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4edc515-dcb1-4d07-ae16-3275ba8f49bd" containerName="pull"
Jul 21 04:13:44.867015 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.866939    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4edc515-dcb1-4d07-ae16-3275ba8f49bd" containerName="pull"
Jul 21 04:13:44.867015 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.866953    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4edc515-dcb1-4d07-ae16-3275ba8f49bd" containerName="util"
Jul 21 04:13:44.867015 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.866958    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4edc515-dcb1-4d07-ae16-3275ba8f49bd" containerName="util"
Jul 21 04:13:44.867015 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.866965    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4edc515-dcb1-4d07-ae16-3275ba8f49bd" containerName="extract"
Jul 21 04:13:44.867015 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.866971    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4edc515-dcb1-4d07-ae16-3275ba8f49bd" containerName="extract"
Jul 21 04:13:44.867197 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.867020    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4edc515-dcb1-4d07-ae16-3275ba8f49bd" containerName="extract"
Jul 21 04:13:44.872111 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.872094    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"
Jul 21 04:13:44.874413 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.874395    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 04:13:44.875188 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.875124    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 04:13:44.875288 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.875191    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:13:44.875288 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.875229    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-x252j\""
Jul 21 04:13:44.875288 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.875267    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 04:13:44.875288 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.875274    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 04:13:44.881628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.881605    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"]
Jul 21 04:13:44.886464 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.886444    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/347b4c96-398e-4a77-9b39-04e4882fcfd6-metrics-cert\") pod \"lws-controller-manager-595b8bf6d6-f7hjt\" (UID: \"347b4c96-398e-4a77-9b39-04e4882fcfd6\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"
Jul 21 04:13:44.886550 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.886489    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/347b4c96-398e-4a77-9b39-04e4882fcfd6-cert\") pod \"lws-controller-manager-595b8bf6d6-f7hjt\" (UID: \"347b4c96-398e-4a77-9b39-04e4882fcfd6\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"
Jul 21 04:13:44.886550 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.886527    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/347b4c96-398e-4a77-9b39-04e4882fcfd6-manager-config\") pod \"lws-controller-manager-595b8bf6d6-f7hjt\" (UID: \"347b4c96-398e-4a77-9b39-04e4882fcfd6\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"
Jul 21 04:13:44.886621 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.886553    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jj5v\" (UniqueName: \"kubernetes.io/projected/347b4c96-398e-4a77-9b39-04e4882fcfd6-kube-api-access-5jj5v\") pod \"lws-controller-manager-595b8bf6d6-f7hjt\" (UID: \"347b4c96-398e-4a77-9b39-04e4882fcfd6\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"
Jul 21 04:13:44.987153 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.987127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/347b4c96-398e-4a77-9b39-04e4882fcfd6-manager-config\") pod \"lws-controller-manager-595b8bf6d6-f7hjt\" (UID: \"347b4c96-398e-4a77-9b39-04e4882fcfd6\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"
Jul 21 04:13:44.987153 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.987155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jj5v\" (UniqueName: \"kubernetes.io/projected/347b4c96-398e-4a77-9b39-04e4882fcfd6-kube-api-access-5jj5v\") pod \"lws-controller-manager-595b8bf6d6-f7hjt\" (UID: \"347b4c96-398e-4a77-9b39-04e4882fcfd6\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"
Jul 21 04:13:44.987338 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.987179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/347b4c96-398e-4a77-9b39-04e4882fcfd6-metrics-cert\") pod \"lws-controller-manager-595b8bf6d6-f7hjt\" (UID: \"347b4c96-398e-4a77-9b39-04e4882fcfd6\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"
Jul 21 04:13:44.987338 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.987239    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/347b4c96-398e-4a77-9b39-04e4882fcfd6-cert\") pod \"lws-controller-manager-595b8bf6d6-f7hjt\" (UID: \"347b4c96-398e-4a77-9b39-04e4882fcfd6\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"
Jul 21 04:13:44.987923 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.987903    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/347b4c96-398e-4a77-9b39-04e4882fcfd6-manager-config\") pod \"lws-controller-manager-595b8bf6d6-f7hjt\" (UID: \"347b4c96-398e-4a77-9b39-04e4882fcfd6\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"
Jul 21 04:13:44.989957 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.989931    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/347b4c96-398e-4a77-9b39-04e4882fcfd6-metrics-cert\") pod \"lws-controller-manager-595b8bf6d6-f7hjt\" (UID: \"347b4c96-398e-4a77-9b39-04e4882fcfd6\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"
Jul 21 04:13:44.990065 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.989971    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/347b4c96-398e-4a77-9b39-04e4882fcfd6-cert\") pod \"lws-controller-manager-595b8bf6d6-f7hjt\" (UID: \"347b4c96-398e-4a77-9b39-04e4882fcfd6\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"
Jul 21 04:13:44.995393 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:44.995371    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jj5v\" (UniqueName: \"kubernetes.io/projected/347b4c96-398e-4a77-9b39-04e4882fcfd6-kube-api-access-5jj5v\") pod \"lws-controller-manager-595b8bf6d6-f7hjt\" (UID: \"347b4c96-398e-4a77-9b39-04e4882fcfd6\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"
Jul 21 04:13:45.182452 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:45.182374    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"
Jul 21 04:13:45.345897 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:45.345872    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"]
Jul 21 04:13:45.348502 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:13:45.348474    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod347b4c96_398e_4a77_9b39_04e4882fcfd6.slice/crio-57cdea1a36e8e06e4f60a0236203378a103ffa4b61ddee388190182605390ece WatchSource:0}: Error finding container 57cdea1a36e8e06e4f60a0236203378a103ffa4b61ddee388190182605390ece: Status 404 returned error can't find the container with id 57cdea1a36e8e06e4f60a0236203378a103ffa4b61ddee388190182605390ece
Jul 21 04:13:45.813444 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:45.813410    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt" event={"ID":"347b4c96-398e-4a77-9b39-04e4882fcfd6","Type":"ContainerStarted","Data":"57cdea1a36e8e06e4f60a0236203378a103ffa4b61ddee388190182605390ece"}
Jul 21 04:13:47.824466 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:47.824429    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt" event={"ID":"347b4c96-398e-4a77-9b39-04e4882fcfd6","Type":"ContainerStarted","Data":"78257088b4eb30e3217239217db4eda5c85a1351695affa9350588b3e531ac65"}
Jul 21 04:13:47.824910 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:47.824550    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"
Jul 21 04:13:47.843203 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:47.843161    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt" podStartSLOduration=2.224217793 podStartE2EDuration="3.843142711s" totalImagesPullingTime="1.618924918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:13:47.841300751 +0000 UTC m=+577.658867535" watchObservedRunningTime="2026-07-21 04:13:47.843142711 +0000 UTC m=+577.660709498"
Jul 21 04:13:48.190294 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.190208    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"]
Jul 21 04:13:48.192920 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.192901    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.195074 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.195053    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 04:13:48.195470 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.195450    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 04:13:48.195470 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.195467    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k7b2b\""
Jul 21 04:13:48.195664 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.195595    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 04:13:48.195728 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.195667    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 04:13:48.213925 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.213904    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55298097-791a-4abc-a613-772bfe062fd1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-k6hpc\" (UID: \"55298097-791a-4abc-a613-772bfe062fd1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.214028 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.213934    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55298097-791a-4abc-a613-772bfe062fd1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-k6hpc\" (UID: \"55298097-791a-4abc-a613-772bfe062fd1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.214028 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.213961    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xllz5\" (UniqueName: \"kubernetes.io/projected/55298097-791a-4abc-a613-772bfe062fd1-kube-api-access-xllz5\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-k6hpc\" (UID: \"55298097-791a-4abc-a613-772bfe062fd1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.214144 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.214044    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55298097-791a-4abc-a613-772bfe062fd1-tmp\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-k6hpc\" (UID: \"55298097-791a-4abc-a613-772bfe062fd1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.214144 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.214083    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/55298097-791a-4abc-a613-772bfe062fd1-manifests\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-k6hpc\" (UID: \"55298097-791a-4abc-a613-772bfe062fd1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.218843 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.218778    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"]
Jul 21 04:13:48.314516 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.314490    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55298097-791a-4abc-a613-772bfe062fd1-tmp\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-k6hpc\" (UID: \"55298097-791a-4abc-a613-772bfe062fd1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.314682 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.314532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/55298097-791a-4abc-a613-772bfe062fd1-manifests\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-k6hpc\" (UID: \"55298097-791a-4abc-a613-772bfe062fd1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.314682 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.314570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55298097-791a-4abc-a613-772bfe062fd1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-k6hpc\" (UID: \"55298097-791a-4abc-a613-772bfe062fd1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.314682 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.314586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55298097-791a-4abc-a613-772bfe062fd1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-k6hpc\" (UID: \"55298097-791a-4abc-a613-772bfe062fd1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.314682 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.314610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xllz5\" (UniqueName: \"kubernetes.io/projected/55298097-791a-4abc-a613-772bfe062fd1-kube-api-access-xllz5\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-k6hpc\" (UID: \"55298097-791a-4abc-a613-772bfe062fd1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.315021 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.314997    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/55298097-791a-4abc-a613-772bfe062fd1-manifests\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-k6hpc\" (UID: \"55298097-791a-4abc-a613-772bfe062fd1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.316884 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.316864    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55298097-791a-4abc-a613-772bfe062fd1-tmp\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-k6hpc\" (UID: \"55298097-791a-4abc-a613-772bfe062fd1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.317259 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.317239    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55298097-791a-4abc-a613-772bfe062fd1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-k6hpc\" (UID: \"55298097-791a-4abc-a613-772bfe062fd1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.317297 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.317244    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55298097-791a-4abc-a613-772bfe062fd1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-k6hpc\" (UID: \"55298097-791a-4abc-a613-772bfe062fd1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.332413 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.332394    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xllz5\" (UniqueName: \"kubernetes.io/projected/55298097-791a-4abc-a613-772bfe062fd1-kube-api-access-xllz5\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-k6hpc\" (UID: \"55298097-791a-4abc-a613-772bfe062fd1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.504880 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.504793    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:48.646879 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.646846    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"]
Jul 21 04:13:48.653364 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:13:48.653335    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55298097_791a_4abc_a613_772bfe062fd1.slice/crio-54bf3263689797d5563783a547142b1110ca1c26abeebdd602465d90f0ee505c WatchSource:0}: Error finding container 54bf3263689797d5563783a547142b1110ca1c26abeebdd602465d90f0ee505c: Status 404 returned error can't find the container with id 54bf3263689797d5563783a547142b1110ca1c26abeebdd602465d90f0ee505c
Jul 21 04:13:48.830615 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:48.830578    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc" event={"ID":"55298097-791a-4abc-a613-772bfe062fd1","Type":"ContainerStarted","Data":"54bf3263689797d5563783a547142b1110ca1c26abeebdd602465d90f0ee505c"}
Jul 21 04:13:51.846819 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:51.846741    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc" event={"ID":"55298097-791a-4abc-a613-772bfe062fd1","Type":"ContainerStarted","Data":"407f76635050ec31a5076fdc1414144ae2ca96389e922ec7f61cd988433e08d9"}
Jul 21 04:13:52.853253 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:52.853220    2576 generic.go:356] "Generic (PLEG): container finished" podID="55298097-791a-4abc-a613-772bfe062fd1" containerID="407f76635050ec31a5076fdc1414144ae2ca96389e922ec7f61cd988433e08d9" exitCode=0
Jul 21 04:13:52.853661 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:52.853279    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc" event={"ID":"55298097-791a-4abc-a613-772bfe062fd1","Type":"ContainerDied","Data":"407f76635050ec31a5076fdc1414144ae2ca96389e922ec7f61cd988433e08d9"}
Jul 21 04:13:53.859410 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:53.859376    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc" event={"ID":"55298097-791a-4abc-a613-772bfe062fd1","Type":"ContainerStarted","Data":"a85d2b1f897a26ad76dc02e660f2a35a330d29b02c2787872ced91ac80c5145f"}
Jul 21 04:13:53.859793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:53.859447    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:13:53.885044 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:53.885000    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc" podStartSLOduration=1.488510322 podStartE2EDuration="5.884985451s" totalImagesPullingTime="3.357566314s" totalInitContainerRuntime="1.038908815s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:13:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:13:53.883264983 +0000 UTC m=+583.700831789" watchObservedRunningTime="2026-07-21 04:13:53.884985451 +0000 UTC m=+583.702552234"
Jul 21 04:13:58.833225 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:13:58.833196    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-f7hjt"
Jul 21 04:14:04.865489 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:04.865456    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-k6hpc"
Jul 21 04:14:09.016811 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.016768    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg"]
Jul 21 04:14:09.021177 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.021153    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg"
Jul 21 04:14:09.023864 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.023840    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 21 04:14:09.023986 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.023887    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tm52c\""
Jul 21 04:14:09.023986 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.023971    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 04:14:09.039604 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.039581    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg"]
Jul 21 04:14:09.084070 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.084044    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393-tmp\") pod \"kube-auth-proxy-6fd7c746b6-xdgdg\" (UID: \"a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg"
Jul 21 04:14:09.084224 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.084075    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmbtk\" (UniqueName: \"kubernetes.io/projected/a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393-kube-api-access-kmbtk\") pod \"kube-auth-proxy-6fd7c746b6-xdgdg\" (UID: \"a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg"
Jul 21 04:14:09.084224 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.084185    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393-tls-certs\") pod \"kube-auth-proxy-6fd7c746b6-xdgdg\" (UID: \"a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg"
Jul 21 04:14:09.184831 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.184785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393-tls-certs\") pod \"kube-auth-proxy-6fd7c746b6-xdgdg\" (UID: \"a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg"
Jul 21 04:14:09.184997 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.184863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393-tmp\") pod \"kube-auth-proxy-6fd7c746b6-xdgdg\" (UID: \"a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg"
Jul 21 04:14:09.184997 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.184890    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmbtk\" (UniqueName: \"kubernetes.io/projected/a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393-kube-api-access-kmbtk\") pod \"kube-auth-proxy-6fd7c746b6-xdgdg\" (UID: \"a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg"
Jul 21 04:14:09.188306 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.188276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393-tls-certs\") pod \"kube-auth-proxy-6fd7c746b6-xdgdg\" (UID: \"a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg"
Jul 21 04:14:09.190836 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.190786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393-tmp\") pod \"kube-auth-proxy-6fd7c746b6-xdgdg\" (UID: \"a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg"
Jul 21 04:14:09.199067 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.199041    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmbtk\" (UniqueName: \"kubernetes.io/projected/a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393-kube-api-access-kmbtk\") pod \"kube-auth-proxy-6fd7c746b6-xdgdg\" (UID: \"a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393\") " pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg"
Jul 21 04:14:09.330927 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.330893    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg"
Jul 21 04:14:09.483354 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.483332    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg"]
Jul 21 04:14:09.485216 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:14:09.485184    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3ad5ab1_4e9b_4d9c_a6be_cfd6e22a1393.slice/crio-a28f35bfdac6a5f5e56ba3dc53062347adb99283264eba0f93f2a9dc6785ebbb WatchSource:0}: Error finding container a28f35bfdac6a5f5e56ba3dc53062347adb99283264eba0f93f2a9dc6785ebbb: Status 404 returned error can't find the container with id a28f35bfdac6a5f5e56ba3dc53062347adb99283264eba0f93f2a9dc6785ebbb
Jul 21 04:14:09.934763 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:09.934726    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg" event={"ID":"a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393","Type":"ContainerStarted","Data":"a28f35bfdac6a5f5e56ba3dc53062347adb99283264eba0f93f2a9dc6785ebbb"}
Jul 21 04:14:12.227196 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:12.227161    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:14:12.229834 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:12.227863    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:14:12.235921 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:12.235900    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 04:14:12.950739 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:12.950700    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg" event={"ID":"a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393","Type":"ContainerStarted","Data":"999b576ab3a0b90fc950990ede0100b2b2ff939d1f4660fa9da5e62c51c3de27"}
Jul 21 04:14:12.968863 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:14:12.968817    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6fd7c746b6-xdgdg" podStartSLOduration=2.222602755 podStartE2EDuration="4.968802596s" totalImagesPullingTime="2.746199841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:14:12.967095946 +0000 UTC m=+602.784662731" watchObservedRunningTime="2026-07-21 04:14:12.968802596 +0000 UTC m=+602.786369379"
Jul 21 04:15:26.016249 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.016217    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6"]
Jul 21 04:15:26.019933 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.019913    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6"
Jul 21 04:15:26.022605 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.022585    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 04:15:26.022605 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.022600    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vq5dx\""
Jul 21 04:15:26.022786 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.022588    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 04:15:26.028176 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.028153    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6"]
Jul 21 04:15:26.100899 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.100876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa3c90b2-f620-4684-a98a-980103e72439-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6\" (UID: \"aa3c90b2-f620-4684-a98a-980103e72439\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6"
Jul 21 04:15:26.101013 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.100921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7mp8\" (UniqueName: \"kubernetes.io/projected/aa3c90b2-f620-4684-a98a-980103e72439-kube-api-access-s7mp8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6\" (UID: \"aa3c90b2-f620-4684-a98a-980103e72439\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6"
Jul 21 04:15:26.101013 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.100941    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa3c90b2-f620-4684-a98a-980103e72439-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6\" (UID: \"aa3c90b2-f620-4684-a98a-980103e72439\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6"
Jul 21 04:15:26.201623 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.201597    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7mp8\" (UniqueName: \"kubernetes.io/projected/aa3c90b2-f620-4684-a98a-980103e72439-kube-api-access-s7mp8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6\" (UID: \"aa3c90b2-f620-4684-a98a-980103e72439\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6"
Jul 21 04:15:26.201749 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.201627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa3c90b2-f620-4684-a98a-980103e72439-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6\" (UID: \"aa3c90b2-f620-4684-a98a-980103e72439\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6"
Jul 21 04:15:26.201749 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.201702    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa3c90b2-f620-4684-a98a-980103e72439-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6\" (UID: \"aa3c90b2-f620-4684-a98a-980103e72439\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6"
Jul 21 04:15:26.202043 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.202028    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa3c90b2-f620-4684-a98a-980103e72439-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6\" (UID: \"aa3c90b2-f620-4684-a98a-980103e72439\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6"
Jul 21 04:15:26.202078 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.202045    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa3c90b2-f620-4684-a98a-980103e72439-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6\" (UID: \"aa3c90b2-f620-4684-a98a-980103e72439\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6"
Jul 21 04:15:26.210484 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.210461    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7mp8\" (UniqueName: \"kubernetes.io/projected/aa3c90b2-f620-4684-a98a-980103e72439-kube-api-access-s7mp8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6\" (UID: \"aa3c90b2-f620-4684-a98a-980103e72439\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6"
Jul 21 04:15:26.330372 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.330352    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6"
Jul 21 04:15:26.459871 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.459831    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6"]
Jul 21 04:15:26.463550 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:15:26.463524    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa3c90b2_f620_4684_a98a_980103e72439.slice/crio-8c75f8847fd863a0a61ff1020a4c3d22a6e21bf97639d0b7c5b2cc74c877a58e WatchSource:0}: Error finding container 8c75f8847fd863a0a61ff1020a4c3d22a6e21bf97639d0b7c5b2cc74c877a58e: Status 404 returned error can't find the container with id 8c75f8847fd863a0a61ff1020a4c3d22a6e21bf97639d0b7c5b2cc74c877a58e
Jul 21 04:15:26.619174 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.619113    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79"]
Jul 21 04:15:26.622491 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.622473    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79"
Jul 21 04:15:26.630904 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.630879    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79"]
Jul 21 04:15:26.705935 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.705912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79\" (UID: \"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79"
Jul 21 04:15:26.706052 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.705950    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7w9d\" (UniqueName: \"kubernetes.io/projected/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-kube-api-access-c7w9d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79\" (UID: \"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79"
Jul 21 04:15:26.706052 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.706002    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79\" (UID: \"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79"
Jul 21 04:15:26.807320 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.807297    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79\" (UID: \"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79"
Jul 21 04:15:26.807413 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.807334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7w9d\" (UniqueName: \"kubernetes.io/projected/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-kube-api-access-c7w9d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79\" (UID: \"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79"
Jul 21 04:15:26.807413 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.807366    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79\" (UID: \"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79"
Jul 21 04:15:26.807831 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.807816    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79\" (UID: \"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79"
Jul 21 04:15:26.807877 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.807865    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79\" (UID: \"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79"
Jul 21 04:15:26.819477 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.819452    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7w9d\" (UniqueName: \"kubernetes.io/projected/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-kube-api-access-c7w9d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79\" (UID: \"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79"
Jul 21 04:15:26.931240 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:26.931194    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79"
Jul 21 04:15:27.060524 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.060501    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79"]
Jul 21 04:15:27.062502 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:15:27.062476    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa87908f_90f8_4b92_a36a_b7d3a8d9d61f.slice/crio-49035fc2e572886674dbeea692bd92227a80edfe231ab1169d66ad173d773740 WatchSource:0}: Error finding container 49035fc2e572886674dbeea692bd92227a80edfe231ab1169d66ad173d773740: Status 404 returned error can't find the container with id 49035fc2e572886674dbeea692bd92227a80edfe231ab1169d66ad173d773740
Jul 21 04:15:27.208020 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.207964    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2"]
Jul 21 04:15:27.211410 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.211391    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2"
Jul 21 04:15:27.219108 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.219078    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2"]
Jul 21 04:15:27.305392 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.305363    2576 generic.go:356] "Generic (PLEG): container finished" podID="aa87908f-90f8-4b92-a36a-b7d3a8d9d61f" containerID="7fcda4784fa0661a7819d868afec1fb90f9fd6df941cf11c8881fcf6d885b1c5" exitCode=0
Jul 21 04:15:27.305524 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.305448    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79" event={"ID":"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f","Type":"ContainerDied","Data":"7fcda4784fa0661a7819d868afec1fb90f9fd6df941cf11c8881fcf6d885b1c5"}
Jul 21 04:15:27.305524 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.305499    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79" event={"ID":"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f","Type":"ContainerStarted","Data":"49035fc2e572886674dbeea692bd92227a80edfe231ab1169d66ad173d773740"}
Jul 21 04:15:27.305942 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.305925    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:15:27.307017 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.306997    2576 generic.go:356] "Generic (PLEG): container finished" podID="aa3c90b2-f620-4684-a98a-980103e72439" containerID="86951be13813dc17ec64d3e93df1c5307eb5c420a00b65b99cec3eae36ad4756" exitCode=0
Jul 21 04:15:27.307103 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.307026    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6" event={"ID":"aa3c90b2-f620-4684-a98a-980103e72439","Type":"ContainerDied","Data":"86951be13813dc17ec64d3e93df1c5307eb5c420a00b65b99cec3eae36ad4756"}
Jul 21 04:15:27.307103 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.307051    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6" event={"ID":"aa3c90b2-f620-4684-a98a-980103e72439","Type":"ContainerStarted","Data":"8c75f8847fd863a0a61ff1020a4c3d22a6e21bf97639d0b7c5b2cc74c877a58e"}
Jul 21 04:15:27.311109 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.311089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4faa6cb7-4b22-439b-93ae-039240a2a0b3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2\" (UID: \"4faa6cb7-4b22-439b-93ae-039240a2a0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2"
Jul 21 04:15:27.311208 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.311145    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlntd\" (UniqueName: \"kubernetes.io/projected/4faa6cb7-4b22-439b-93ae-039240a2a0b3-kube-api-access-mlntd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2\" (UID: \"4faa6cb7-4b22-439b-93ae-039240a2a0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2"
Jul 21 04:15:27.311270 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.311216    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4faa6cb7-4b22-439b-93ae-039240a2a0b3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2\" (UID: \"4faa6cb7-4b22-439b-93ae-039240a2a0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2"
Jul 21 04:15:27.417320 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.417285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4faa6cb7-4b22-439b-93ae-039240a2a0b3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2\" (UID: \"4faa6cb7-4b22-439b-93ae-039240a2a0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2"
Jul 21 04:15:27.417551 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.417530    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4faa6cb7-4b22-439b-93ae-039240a2a0b3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2\" (UID: \"4faa6cb7-4b22-439b-93ae-039240a2a0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2"
Jul 21 04:15:27.417631 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.417594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlntd\" (UniqueName: \"kubernetes.io/projected/4faa6cb7-4b22-439b-93ae-039240a2a0b3-kube-api-access-mlntd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2\" (UID: \"4faa6cb7-4b22-439b-93ae-039240a2a0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2"
Jul 21 04:15:27.417923 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.417905    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4faa6cb7-4b22-439b-93ae-039240a2a0b3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2\" (UID: \"4faa6cb7-4b22-439b-93ae-039240a2a0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2"
Jul 21 04:15:27.417981 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.417949    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4faa6cb7-4b22-439b-93ae-039240a2a0b3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2\" (UID: \"4faa6cb7-4b22-439b-93ae-039240a2a0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2"
Jul 21 04:15:27.427201 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.427180    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlntd\" (UniqueName: \"kubernetes.io/projected/4faa6cb7-4b22-439b-93ae-039240a2a0b3-kube-api-access-mlntd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2\" (UID: \"4faa6cb7-4b22-439b-93ae-039240a2a0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2"
Jul 21 04:15:27.543138 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.543079    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2"
Jul 21 04:15:27.615005 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.614973    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2"]
Jul 21 04:15:27.618899 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.618879    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2"
Jul 21 04:15:27.627532 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.627335    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2"]
Jul 21 04:15:27.682786 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.682764    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2"]
Jul 21 04:15:27.684827 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:15:27.684798    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4faa6cb7_4b22_439b_93ae_039240a2a0b3.slice/crio-1fd1b9dd7612d63d289599332651cfbba652adf70b24a2f442075267f5af1a88 WatchSource:0}: Error finding container 1fd1b9dd7612d63d289599332651cfbba652adf70b24a2f442075267f5af1a88: Status 404 returned error can't find the container with id 1fd1b9dd7612d63d289599332651cfbba652adf70b24a2f442075267f5af1a88
Jul 21 04:15:27.720531 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.720508    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqwvq\" (UniqueName: \"kubernetes.io/projected/81ff9cc4-0e01-481a-a618-a0513c758a06-kube-api-access-fqwvq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2\" (UID: \"81ff9cc4-0e01-481a-a618-a0513c758a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2"
Jul 21 04:15:27.720621 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.720545    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81ff9cc4-0e01-481a-a618-a0513c758a06-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2\" (UID: \"81ff9cc4-0e01-481a-a618-a0513c758a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2"
Jul 21 04:15:27.720621 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.720578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81ff9cc4-0e01-481a-a618-a0513c758a06-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2\" (UID: \"81ff9cc4-0e01-481a-a618-a0513c758a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2"
Jul 21 04:15:27.821399 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.821372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqwvq\" (UniqueName: \"kubernetes.io/projected/81ff9cc4-0e01-481a-a618-a0513c758a06-kube-api-access-fqwvq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2\" (UID: \"81ff9cc4-0e01-481a-a618-a0513c758a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2"
Jul 21 04:15:27.821514 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.821423    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81ff9cc4-0e01-481a-a618-a0513c758a06-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2\" (UID: \"81ff9cc4-0e01-481a-a618-a0513c758a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2"
Jul 21 04:15:27.821586 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.821552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81ff9cc4-0e01-481a-a618-a0513c758a06-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2\" (UID: \"81ff9cc4-0e01-481a-a618-a0513c758a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2"
Jul 21 04:15:27.821782 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.821764    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81ff9cc4-0e01-481a-a618-a0513c758a06-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2\" (UID: \"81ff9cc4-0e01-481a-a618-a0513c758a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2"
Jul 21 04:15:27.821907 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.821887    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81ff9cc4-0e01-481a-a618-a0513c758a06-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2\" (UID: \"81ff9cc4-0e01-481a-a618-a0513c758a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2"
Jul 21 04:15:27.829289 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.829269    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqwvq\" (UniqueName: \"kubernetes.io/projected/81ff9cc4-0e01-481a-a618-a0513c758a06-kube-api-access-fqwvq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2\" (UID: \"81ff9cc4-0e01-481a-a618-a0513c758a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2"
Jul 21 04:15:27.930441 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:27.930418    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2"
Jul 21 04:15:28.066789 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:28.066762    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2"]
Jul 21 04:15:28.092245 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:15:28.092187    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81ff9cc4_0e01_481a_a618_a0513c758a06.slice/crio-d56cbc061fe1b656ab08e38c0ebc2a69477da39ca32c3fc5e91aa9a3027eddc8 WatchSource:0}: Error finding container d56cbc061fe1b656ab08e38c0ebc2a69477da39ca32c3fc5e91aa9a3027eddc8: Status 404 returned error can't find the container with id d56cbc061fe1b656ab08e38c0ebc2a69477da39ca32c3fc5e91aa9a3027eddc8
Jul 21 04:15:28.312981 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:28.312946    2576 generic.go:356] "Generic (PLEG): container finished" podID="4faa6cb7-4b22-439b-93ae-039240a2a0b3" containerID="2f621598a6ee656fd81a4c6fda324565dbd73d4d5b2b5997c1a9837b5d07ec4a" exitCode=0
Jul 21 04:15:28.313119 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:28.313027    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2" event={"ID":"4faa6cb7-4b22-439b-93ae-039240a2a0b3","Type":"ContainerDied","Data":"2f621598a6ee656fd81a4c6fda324565dbd73d4d5b2b5997c1a9837b5d07ec4a"}
Jul 21 04:15:28.313119 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:28.313083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2" event={"ID":"4faa6cb7-4b22-439b-93ae-039240a2a0b3","Type":"ContainerStarted","Data":"1fd1b9dd7612d63d289599332651cfbba652adf70b24a2f442075267f5af1a88"}
Jul 21 04:15:28.314611 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:28.314583    2576 generic.go:356] "Generic (PLEG): container finished" podID="81ff9cc4-0e01-481a-a618-a0513c758a06" containerID="665f7a8cecd9dee4511c45b9406945639b66cb889f13c8df11299cf6db2da849" exitCode=0
Jul 21 04:15:28.314699 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:28.314677    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2" event={"ID":"81ff9cc4-0e01-481a-a618-a0513c758a06","Type":"ContainerDied","Data":"665f7a8cecd9dee4511c45b9406945639b66cb889f13c8df11299cf6db2da849"}
Jul 21 04:15:28.314758 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:28.314720    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2" event={"ID":"81ff9cc4-0e01-481a-a618-a0513c758a06","Type":"ContainerStarted","Data":"d56cbc061fe1b656ab08e38c0ebc2a69477da39ca32c3fc5e91aa9a3027eddc8"}
Jul 21 04:15:28.316990 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:28.316971    2576 generic.go:356] "Generic (PLEG): container finished" podID="aa87908f-90f8-4b92-a36a-b7d3a8d9d61f" containerID="51db3a6237ec51e2e3dd800c7ec89a53e9be8f5276701f4d5c3e0d5e61fc3132" exitCode=0
Jul 21 04:15:28.317080 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:28.317058    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79" event={"ID":"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f","Type":"ContainerDied","Data":"51db3a6237ec51e2e3dd800c7ec89a53e9be8f5276701f4d5c3e0d5e61fc3132"}
Jul 21 04:15:29.324958 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:29.324902    2576 generic.go:356] "Generic (PLEG): container finished" podID="aa87908f-90f8-4b92-a36a-b7d3a8d9d61f" containerID="a8f590a8be663d65b4e30ef49f6a836f5a1c54f081266304322c012d162399af" exitCode=0
Jul 21 04:15:29.325286 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:29.324975    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79" event={"ID":"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f","Type":"ContainerDied","Data":"a8f590a8be663d65b4e30ef49f6a836f5a1c54f081266304322c012d162399af"}
Jul 21 04:15:29.326556 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:29.326533    2576 generic.go:356] "Generic (PLEG): container finished" podID="4faa6cb7-4b22-439b-93ae-039240a2a0b3" containerID="ce1b70ad9083acdb8dc2f78636132969d37f61bf0a1117729ad0f2cf2540b1c3" exitCode=0
Jul 21 04:15:29.326654 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:29.326611    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2" event={"ID":"4faa6cb7-4b22-439b-93ae-039240a2a0b3","Type":"ContainerDied","Data":"ce1b70ad9083acdb8dc2f78636132969d37f61bf0a1117729ad0f2cf2540b1c3"}
Jul 21 04:15:29.328566 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:29.328546    2576 generic.go:356] "Generic (PLEG): container finished" podID="81ff9cc4-0e01-481a-a618-a0513c758a06" containerID="331dcfcb39b56aae76ed40e8afe80a84f2b8bf416b4e85ea15c529e99b468388" exitCode=0
Jul 21 04:15:29.328686 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:29.328618    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2" event={"ID":"81ff9cc4-0e01-481a-a618-a0513c758a06","Type":"ContainerDied","Data":"331dcfcb39b56aae76ed40e8afe80a84f2b8bf416b4e85ea15c529e99b468388"}
Jul 21 04:15:29.330565 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:29.330547    2576 generic.go:356] "Generic (PLEG): container finished" podID="aa3c90b2-f620-4684-a98a-980103e72439" containerID="c59433e17f629edefd312ff1d1b2295ebdcae3b97536a8684e10552177db3be2" exitCode=0
Jul 21 04:15:29.330672 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:29.330602    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6" event={"ID":"aa3c90b2-f620-4684-a98a-980103e72439","Type":"ContainerDied","Data":"c59433e17f629edefd312ff1d1b2295ebdcae3b97536a8684e10552177db3be2"}
Jul 21 04:15:30.338279 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:30.338244    2576 generic.go:356] "Generic (PLEG): container finished" podID="4faa6cb7-4b22-439b-93ae-039240a2a0b3" containerID="8a57869f947db64e0084afad6c7885aa524f23cb87a796263d2c3128591bc6c6" exitCode=0
Jul 21 04:15:30.338675 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:30.338334    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2" event={"ID":"4faa6cb7-4b22-439b-93ae-039240a2a0b3","Type":"ContainerDied","Data":"8a57869f947db64e0084afad6c7885aa524f23cb87a796263d2c3128591bc6c6"}
Jul 21 04:15:30.340326 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:30.340303    2576 generic.go:356] "Generic (PLEG): container finished" podID="81ff9cc4-0e01-481a-a618-a0513c758a06" containerID="b25199beacf7d067aa268a4582c0e84455e519a305c40a4e025841ae507d51da" exitCode=0
Jul 21 04:15:30.340428 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:30.340372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2" event={"ID":"81ff9cc4-0e01-481a-a618-a0513c758a06","Type":"ContainerDied","Data":"b25199beacf7d067aa268a4582c0e84455e519a305c40a4e025841ae507d51da"}
Jul 21 04:15:30.342374 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:30.342355    2576 generic.go:356] "Generic (PLEG): container finished" podID="aa3c90b2-f620-4684-a98a-980103e72439" containerID="95b337abcfb912b1b4f65b266d903470796894576fb40b9eb9c982980c74e31c" exitCode=0
Jul 21 04:15:30.342446 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:30.342415    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6" event={"ID":"aa3c90b2-f620-4684-a98a-980103e72439","Type":"ContainerDied","Data":"95b337abcfb912b1b4f65b266d903470796894576fb40b9eb9c982980c74e31c"}
Jul 21 04:15:30.476234 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:30.476213    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79"
Jul 21 04:15:30.645473 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:30.645449    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-bundle\") pod \"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f\" (UID: \"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f\") "
Jul 21 04:15:30.645597 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:30.645545    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7w9d\" (UniqueName: \"kubernetes.io/projected/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-kube-api-access-c7w9d\") pod \"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f\" (UID: \"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f\") "
Jul 21 04:15:30.645597 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:30.645567    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-util\") pod \"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f\" (UID: \"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f\") "
Jul 21 04:15:30.645949 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:30.645927    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-bundle" (OuterVolumeSpecName: "bundle") pod "aa87908f-90f8-4b92-a36a-b7d3a8d9d61f" (UID: "aa87908f-90f8-4b92-a36a-b7d3a8d9d61f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:15:30.647818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:30.647800    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-kube-api-access-c7w9d" (OuterVolumeSpecName: "kube-api-access-c7w9d") pod "aa87908f-90f8-4b92-a36a-b7d3a8d9d61f" (UID: "aa87908f-90f8-4b92-a36a-b7d3a8d9d61f"). InnerVolumeSpecName "kube-api-access-c7w9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:15:30.650233 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:30.650213    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-util" (OuterVolumeSpecName: "util") pod "aa87908f-90f8-4b92-a36a-b7d3a8d9d61f" (UID: "aa87908f-90f8-4b92-a36a-b7d3a8d9d61f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:15:30.746948 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:30.746926    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-bundle\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:15:30.746948 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:30.746947    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7w9d\" (UniqueName: \"kubernetes.io/projected/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-kube-api-access-c7w9d\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:15:30.747057 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:30.746956    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa87908f-90f8-4b92-a36a-b7d3a8d9d61f-util\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:15:31.348747 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.348703    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79"
Jul 21 04:15:31.348747 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.348708    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79" event={"ID":"aa87908f-90f8-4b92-a36a-b7d3a8d9d61f","Type":"ContainerDied","Data":"49035fc2e572886674dbeea692bd92227a80edfe231ab1169d66ad173d773740"}
Jul 21 04:15:31.349289 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.348771    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49035fc2e572886674dbeea692bd92227a80edfe231ab1169d66ad173d773740"
Jul 21 04:15:31.491709 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.491667    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6"
Jul 21 04:15:31.538937 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.538916    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2"
Jul 21 04:15:31.541712 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.541693    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2"
Jul 21 04:15:31.654072 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.654004    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlntd\" (UniqueName: \"kubernetes.io/projected/4faa6cb7-4b22-439b-93ae-039240a2a0b3-kube-api-access-mlntd\") pod \"4faa6cb7-4b22-439b-93ae-039240a2a0b3\" (UID: \"4faa6cb7-4b22-439b-93ae-039240a2a0b3\") "
Jul 21 04:15:31.654072 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.654045    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81ff9cc4-0e01-481a-a618-a0513c758a06-bundle\") pod \"81ff9cc4-0e01-481a-a618-a0513c758a06\" (UID: \"81ff9cc4-0e01-481a-a618-a0513c758a06\") "
Jul 21 04:15:31.654228 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.654081    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4faa6cb7-4b22-439b-93ae-039240a2a0b3-bundle\") pod \"4faa6cb7-4b22-439b-93ae-039240a2a0b3\" (UID: \"4faa6cb7-4b22-439b-93ae-039240a2a0b3\") "
Jul 21 04:15:31.654228 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.654119    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa3c90b2-f620-4684-a98a-980103e72439-bundle\") pod \"aa3c90b2-f620-4684-a98a-980103e72439\" (UID: \"aa3c90b2-f620-4684-a98a-980103e72439\") "
Jul 21 04:15:31.654228 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.654202    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81ff9cc4-0e01-481a-a618-a0513c758a06-util\") pod \"81ff9cc4-0e01-481a-a618-a0513c758a06\" (UID: \"81ff9cc4-0e01-481a-a618-a0513c758a06\") "
Jul 21 04:15:31.654372 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.654233    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa3c90b2-f620-4684-a98a-980103e72439-util\") pod \"aa3c90b2-f620-4684-a98a-980103e72439\" (UID: \"aa3c90b2-f620-4684-a98a-980103e72439\") "
Jul 21 04:15:31.654372 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.654256    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4faa6cb7-4b22-439b-93ae-039240a2a0b3-util\") pod \"4faa6cb7-4b22-439b-93ae-039240a2a0b3\" (UID: \"4faa6cb7-4b22-439b-93ae-039240a2a0b3\") "
Jul 21 04:15:31.654372 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.654282    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqwvq\" (UniqueName: \"kubernetes.io/projected/81ff9cc4-0e01-481a-a618-a0513c758a06-kube-api-access-fqwvq\") pod \"81ff9cc4-0e01-481a-a618-a0513c758a06\" (UID: \"81ff9cc4-0e01-481a-a618-a0513c758a06\") "
Jul 21 04:15:31.654372 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.654316    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7mp8\" (UniqueName: \"kubernetes.io/projected/aa3c90b2-f620-4684-a98a-980103e72439-kube-api-access-s7mp8\") pod \"aa3c90b2-f620-4684-a98a-980103e72439\" (UID: \"aa3c90b2-f620-4684-a98a-980103e72439\") "
Jul 21 04:15:31.654931 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.654763    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81ff9cc4-0e01-481a-a618-a0513c758a06-bundle" (OuterVolumeSpecName: "bundle") pod "81ff9cc4-0e01-481a-a618-a0513c758a06" (UID: "81ff9cc4-0e01-481a-a618-a0513c758a06"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:15:31.654931 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.654917    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa3c90b2-f620-4684-a98a-980103e72439-bundle" (OuterVolumeSpecName: "bundle") pod "aa3c90b2-f620-4684-a98a-980103e72439" (UID: "aa3c90b2-f620-4684-a98a-980103e72439"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:15:31.656498 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.656459    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4faa6cb7-4b22-439b-93ae-039240a2a0b3-bundle" (OuterVolumeSpecName: "bundle") pod "4faa6cb7-4b22-439b-93ae-039240a2a0b3" (UID: "4faa6cb7-4b22-439b-93ae-039240a2a0b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:15:31.656601 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.656541    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4faa6cb7-4b22-439b-93ae-039240a2a0b3-kube-api-access-mlntd" (OuterVolumeSpecName: "kube-api-access-mlntd") pod "4faa6cb7-4b22-439b-93ae-039240a2a0b3" (UID: "4faa6cb7-4b22-439b-93ae-039240a2a0b3"). InnerVolumeSpecName "kube-api-access-mlntd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:15:31.656892 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.656868    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa3c90b2-f620-4684-a98a-980103e72439-kube-api-access-s7mp8" (OuterVolumeSpecName: "kube-api-access-s7mp8") pod "aa3c90b2-f620-4684-a98a-980103e72439" (UID: "aa3c90b2-f620-4684-a98a-980103e72439"). InnerVolumeSpecName "kube-api-access-s7mp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:15:31.657347 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.657334    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81ff9cc4-0e01-481a-a618-a0513c758a06-kube-api-access-fqwvq" (OuterVolumeSpecName: "kube-api-access-fqwvq") pod "81ff9cc4-0e01-481a-a618-a0513c758a06" (UID: "81ff9cc4-0e01-481a-a618-a0513c758a06"). InnerVolumeSpecName "kube-api-access-fqwvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:15:31.660555 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.660521    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81ff9cc4-0e01-481a-a618-a0513c758a06-util" (OuterVolumeSpecName: "util") pod "81ff9cc4-0e01-481a-a618-a0513c758a06" (UID: "81ff9cc4-0e01-481a-a618-a0513c758a06"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:15:31.663028 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.663003    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4faa6cb7-4b22-439b-93ae-039240a2a0b3-util" (OuterVolumeSpecName: "util") pod "4faa6cb7-4b22-439b-93ae-039240a2a0b3" (UID: "4faa6cb7-4b22-439b-93ae-039240a2a0b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:15:31.663359 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.663341    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa3c90b2-f620-4684-a98a-980103e72439-util" (OuterVolumeSpecName: "util") pod "aa3c90b2-f620-4684-a98a-980103e72439" (UID: "aa3c90b2-f620-4684-a98a-980103e72439"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:15:31.755458 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.755435    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81ff9cc4-0e01-481a-a618-a0513c758a06-util\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:15:31.755458 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.755456    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa3c90b2-f620-4684-a98a-980103e72439-util\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:15:31.755567 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.755463    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4faa6cb7-4b22-439b-93ae-039240a2a0b3-util\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:15:31.755567 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.755471    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqwvq\" (UniqueName: \"kubernetes.io/projected/81ff9cc4-0e01-481a-a618-a0513c758a06-kube-api-access-fqwvq\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:15:31.755567 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.755481    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7mp8\" (UniqueName: \"kubernetes.io/projected/aa3c90b2-f620-4684-a98a-980103e72439-kube-api-access-s7mp8\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:15:31.755567 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.755489    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlntd\" (UniqueName: \"kubernetes.io/projected/4faa6cb7-4b22-439b-93ae-039240a2a0b3-kube-api-access-mlntd\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:15:31.755567 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.755497    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81ff9cc4-0e01-481a-a618-a0513c758a06-bundle\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:15:31.755567 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.755505    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4faa6cb7-4b22-439b-93ae-039240a2a0b3-bundle\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:15:31.755567 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:31.755512    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa3c90b2-f620-4684-a98a-980103e72439-bundle\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:15:32.355027 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:32.354997    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2"
Jul 21 04:15:32.355395 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:32.354996    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2" event={"ID":"4faa6cb7-4b22-439b-93ae-039240a2a0b3","Type":"ContainerDied","Data":"1fd1b9dd7612d63d289599332651cfbba652adf70b24a2f442075267f5af1a88"}
Jul 21 04:15:32.355395 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:32.355156    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fd1b9dd7612d63d289599332651cfbba652adf70b24a2f442075267f5af1a88"
Jul 21 04:15:32.356855 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:32.356834    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2"
Jul 21 04:15:32.357005 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:32.356838    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2" event={"ID":"81ff9cc4-0e01-481a-a618-a0513c758a06","Type":"ContainerDied","Data":"d56cbc061fe1b656ab08e38c0ebc2a69477da39ca32c3fc5e91aa9a3027eddc8"}
Jul 21 04:15:32.357005 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:32.356956    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d56cbc061fe1b656ab08e38c0ebc2a69477da39ca32c3fc5e91aa9a3027eddc8"
Jul 21 04:15:32.358668 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:32.358621    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6" event={"ID":"aa3c90b2-f620-4684-a98a-980103e72439","Type":"ContainerDied","Data":"8c75f8847fd863a0a61ff1020a4c3d22a6e21bf97639d0b7c5b2cc74c877a58e"}
Jul 21 04:15:32.358668 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:32.358664    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6"
Jul 21 04:15:32.358786 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:32.358680    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c75f8847fd863a0a61ff1020a4c3d22a6e21bf97639d0b7c5b2cc74c877a58e"
Jul 21 04:15:44.664580 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664545    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bc847f449-7dv27"]
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664859    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4faa6cb7-4b22-439b-93ae-039240a2a0b3" containerName="util"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664875    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4faa6cb7-4b22-439b-93ae-039240a2a0b3" containerName="util"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664885    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa87908f-90f8-4b92-a36a-b7d3a8d9d61f" containerName="pull"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664889    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa87908f-90f8-4b92-a36a-b7d3a8d9d61f" containerName="pull"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664897    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81ff9cc4-0e01-481a-a618-a0513c758a06" containerName="pull"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664902    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="81ff9cc4-0e01-481a-a618-a0513c758a06" containerName="pull"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664909    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4faa6cb7-4b22-439b-93ae-039240a2a0b3" containerName="extract"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664914    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4faa6cb7-4b22-439b-93ae-039240a2a0b3" containerName="extract"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664920    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81ff9cc4-0e01-481a-a618-a0513c758a06" containerName="extract"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664925    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="81ff9cc4-0e01-481a-a618-a0513c758a06" containerName="extract"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664931    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa87908f-90f8-4b92-a36a-b7d3a8d9d61f" containerName="extract"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664936    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa87908f-90f8-4b92-a36a-b7d3a8d9d61f" containerName="extract"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664942    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa3c90b2-f620-4684-a98a-980103e72439" containerName="pull"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664947    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa3c90b2-f620-4684-a98a-980103e72439" containerName="pull"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664955    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa87908f-90f8-4b92-a36a-b7d3a8d9d61f" containerName="util"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664959    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa87908f-90f8-4b92-a36a-b7d3a8d9d61f" containerName="util"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664966    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81ff9cc4-0e01-481a-a618-a0513c758a06" containerName="util"
Jul 21 04:15:44.664963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664972    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="81ff9cc4-0e01-481a-a618-a0513c758a06" containerName="util"
Jul 21 04:15:44.665447 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664977    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa3c90b2-f620-4684-a98a-980103e72439" containerName="extract"
Jul 21 04:15:44.665447 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664982    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa3c90b2-f620-4684-a98a-980103e72439" containerName="extract"
Jul 21 04:15:44.665447 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664994    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa3c90b2-f620-4684-a98a-980103e72439" containerName="util"
Jul 21 04:15:44.665447 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.664998    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa3c90b2-f620-4684-a98a-980103e72439" containerName="util"
Jul 21 04:15:44.665447 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.665003    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4faa6cb7-4b22-439b-93ae-039240a2a0b3" containerName="pull"
Jul 21 04:15:44.665447 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.665007    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4faa6cb7-4b22-439b-93ae-039240a2a0b3" containerName="pull"
Jul 21 04:15:44.665447 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.665057    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa87908f-90f8-4b92-a36a-b7d3a8d9d61f" containerName="extract"
Jul 21 04:15:44.665447 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.665064    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa3c90b2-f620-4684-a98a-980103e72439" containerName="extract"
Jul 21 04:15:44.665447 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.665069    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4faa6cb7-4b22-439b-93ae-039240a2a0b3" containerName="extract"
Jul 21 04:15:44.665447 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.665075    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="81ff9cc4-0e01-481a-a618-a0513c758a06" containerName="extract"
Jul 21 04:15:44.667933 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.667918    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.678137 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.678111    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc847f449-7dv27"]
Jul 21 04:15:44.754630 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.754598    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-console-serving-cert\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.754630 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.754630    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-trusted-ca-bundle\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.754815 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.754679    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-console-oauth-config\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.754815 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.754701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-oauth-serving-cert\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.754815 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.754726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-service-ca\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.754815 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.754795    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjbpr\" (UniqueName: \"kubernetes.io/projected/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-kube-api-access-mjbpr\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.754937 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.754836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-console-config\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.855941 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.855912    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-service-ca\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.856058 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.855956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjbpr\" (UniqueName: \"kubernetes.io/projected/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-kube-api-access-mjbpr\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.856058 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.855976    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-console-config\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.856058 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.856008    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-console-serving-cert\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.856058 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.856032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-trusted-ca-bundle\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.856058 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.856057    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-console-oauth-config\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.856298 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.856085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-oauth-serving-cert\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.856814 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.856736    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-service-ca\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.856814 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.856761    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-console-config\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.856814 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.856822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-oauth-serving-cert\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.857130 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.857085    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-trusted-ca-bundle\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.858499 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.858480    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-console-oauth-config\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.858700 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.858682    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-console-serving-cert\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.863617 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.863598    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjbpr\" (UniqueName: \"kubernetes.io/projected/7c4c2311-4d7e-45e6-9d9e-a05b90586ff1-kube-api-access-mjbpr\") pod \"console-7bc847f449-7dv27\" (UID: \"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1\") " pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:44.976832 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:44.976772    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:45.121831 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:45.121805    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc847f449-7dv27"]
Jul 21 04:15:45.123597 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:15:45.123572    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c4c2311_4d7e_45e6_9d9e_a05b90586ff1.slice/crio-b267c3a98556a55a8a765333f8612e400e618550267292a98278ee1cf4cda178 WatchSource:0}: Error finding container b267c3a98556a55a8a765333f8612e400e618550267292a98278ee1cf4cda178: Status 404 returned error can't find the container with id b267c3a98556a55a8a765333f8612e400e618550267292a98278ee1cf4cda178
Jul 21 04:15:45.427474 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:45.427435    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc847f449-7dv27" event={"ID":"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1","Type":"ContainerStarted","Data":"703128f9dba4f79e6ea704b4eda823a6da303506d0074374f4695f889d7e258a"}
Jul 21 04:15:45.427695 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:45.427495    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc847f449-7dv27" event={"ID":"7c4c2311-4d7e-45e6-9d9e-a05b90586ff1","Type":"ContainerStarted","Data":"b267c3a98556a55a8a765333f8612e400e618550267292a98278ee1cf4cda178"}
Jul 21 04:15:45.465406 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:45.465360    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bc847f449-7dv27" podStartSLOduration=1.465344733 podStartE2EDuration="1.465344733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:15:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:15:45.46245141 +0000 UTC m=+695.280018195" watchObservedRunningTime="2026-07-21 04:15:45.465344733 +0000 UTC m=+695.282911516"
Jul 21 04:15:54.977122 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:54.977086    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:54.977563 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:54.977178    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:54.981985 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:54.981960    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:55.479969 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:55.479941    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bc847f449-7dv27"
Jul 21 04:15:55.529595 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:55.529556    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9554d6fbc-pk6v5"]
Jul 21 04:15:58.898017 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:58.897980    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj"]
Jul 21 04:15:58.902573 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:58.902554    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj"
Jul 21 04:15:58.906255 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:58.906221    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 21 04:15:58.906255 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:58.906244    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 04:15:58.906497 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:58.906483    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vq5dx\""
Jul 21 04:15:58.906689 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:58.906675    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 21 04:15:58.906775 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:58.906719    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 04:15:58.916721 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:58.916693    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj"]
Jul 21 04:15:58.965904 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:58.965869    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlf5b\" (UniqueName: \"kubernetes.io/projected/2e56ce89-8709-4d29-b0be-9ab34d43cef1-kube-api-access-hlf5b\") pod \"kuadrant-console-plugin-66b5774985-tj8bj\" (UID: \"2e56ce89-8709-4d29-b0be-9ab34d43cef1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj"
Jul 21 04:15:58.966077 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:58.965910    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2e56ce89-8709-4d29-b0be-9ab34d43cef1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tj8bj\" (UID: \"2e56ce89-8709-4d29-b0be-9ab34d43cef1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj"
Jul 21 04:15:58.966077 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:58.965969    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e56ce89-8709-4d29-b0be-9ab34d43cef1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tj8bj\" (UID: \"2e56ce89-8709-4d29-b0be-9ab34d43cef1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj"
Jul 21 04:15:59.066902 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:59.066864    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlf5b\" (UniqueName: \"kubernetes.io/projected/2e56ce89-8709-4d29-b0be-9ab34d43cef1-kube-api-access-hlf5b\") pod \"kuadrant-console-plugin-66b5774985-tj8bj\" (UID: \"2e56ce89-8709-4d29-b0be-9ab34d43cef1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj"
Jul 21 04:15:59.067071 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:59.066910    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2e56ce89-8709-4d29-b0be-9ab34d43cef1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tj8bj\" (UID: \"2e56ce89-8709-4d29-b0be-9ab34d43cef1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj"
Jul 21 04:15:59.067071 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:59.066969    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e56ce89-8709-4d29-b0be-9ab34d43cef1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tj8bj\" (UID: \"2e56ce89-8709-4d29-b0be-9ab34d43cef1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj"
Jul 21 04:15:59.067563 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:59.067537    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2e56ce89-8709-4d29-b0be-9ab34d43cef1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tj8bj\" (UID: \"2e56ce89-8709-4d29-b0be-9ab34d43cef1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj"
Jul 21 04:15:59.069522 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:59.069503    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e56ce89-8709-4d29-b0be-9ab34d43cef1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tj8bj\" (UID: \"2e56ce89-8709-4d29-b0be-9ab34d43cef1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj"
Jul 21 04:15:59.077896 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:59.077864    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlf5b\" (UniqueName: \"kubernetes.io/projected/2e56ce89-8709-4d29-b0be-9ab34d43cef1-kube-api-access-hlf5b\") pod \"kuadrant-console-plugin-66b5774985-tj8bj\" (UID: \"2e56ce89-8709-4d29-b0be-9ab34d43cef1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj"
Jul 21 04:15:59.211858 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:59.211776    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj"
Jul 21 04:15:59.341232 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:59.341207    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj"]
Jul 21 04:15:59.343475 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:15:59.343446    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e56ce89_8709_4d29_b0be_9ab34d43cef1.slice/crio-dd50ab8dee26a497450f9d9c0bd30428458846b2623aca551aa8d06838d5d05f WatchSource:0}: Error finding container dd50ab8dee26a497450f9d9c0bd30428458846b2623aca551aa8d06838d5d05f: Status 404 returned error can't find the container with id dd50ab8dee26a497450f9d9c0bd30428458846b2623aca551aa8d06838d5d05f
Jul 21 04:15:59.502727 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:15:59.502630    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj" event={"ID":"2e56ce89-8709-4d29-b0be-9ab34d43cef1","Type":"ContainerStarted","Data":"dd50ab8dee26a497450f9d9c0bd30428458846b2623aca551aa8d06838d5d05f"}
Jul 21 04:16:20.550774 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:20.550721    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9554d6fbc-pk6v5" podUID="45d2d85a-4eda-4345-bc32-e291f9d9562d" containerName="console" containerID="cri-o://7fc882f837a21d83e655e0a0dc65c79c794f67f76ba27ae9d5ee5bca305608a4" gracePeriod=15
Jul 21 04:16:21.431457 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.431428    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:16:21.577606 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.577581    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-oauth-config\") pod \"45d2d85a-4eda-4345-bc32-e291f9d9562d\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") "
Jul 21 04:16:21.578052 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.577615    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-service-ca\") pod \"45d2d85a-4eda-4345-bc32-e291f9d9562d\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") "
Jul 21 04:16:21.578052 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.577634    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-config\") pod \"45d2d85a-4eda-4345-bc32-e291f9d9562d\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") "
Jul 21 04:16:21.578052 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.577681    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-oauth-serving-cert\") pod \"45d2d85a-4eda-4345-bc32-e291f9d9562d\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") "
Jul 21 04:16:21.578052 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.577728    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-trusted-ca-bundle\") pod \"45d2d85a-4eda-4345-bc32-e291f9d9562d\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") "
Jul 21 04:16:21.578052 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.577746    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-serving-cert\") pod \"45d2d85a-4eda-4345-bc32-e291f9d9562d\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") "
Jul 21 04:16:21.578052 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.577770    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wq4g8\" (UniqueName: \"kubernetes.io/projected/45d2d85a-4eda-4345-bc32-e291f9d9562d-kube-api-access-wq4g8\") pod \"45d2d85a-4eda-4345-bc32-e291f9d9562d\" (UID: \"45d2d85a-4eda-4345-bc32-e291f9d9562d\") "
Jul 21 04:16:21.578340 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.578138    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-service-ca" (OuterVolumeSpecName: "service-ca") pod "45d2d85a-4eda-4345-bc32-e291f9d9562d" (UID: "45d2d85a-4eda-4345-bc32-e291f9d9562d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:16:21.578340 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.578149    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-config" (OuterVolumeSpecName: "console-config") pod "45d2d85a-4eda-4345-bc32-e291f9d9562d" (UID: "45d2d85a-4eda-4345-bc32-e291f9d9562d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:16:21.578340 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.578158    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "45d2d85a-4eda-4345-bc32-e291f9d9562d" (UID: "45d2d85a-4eda-4345-bc32-e291f9d9562d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:16:21.578340 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.578225    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "45d2d85a-4eda-4345-bc32-e291f9d9562d" (UID: "45d2d85a-4eda-4345-bc32-e291f9d9562d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:16:21.579791 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.579771    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "45d2d85a-4eda-4345-bc32-e291f9d9562d" (UID: "45d2d85a-4eda-4345-bc32-e291f9d9562d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:16:21.579983 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.579967    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "45d2d85a-4eda-4345-bc32-e291f9d9562d" (UID: "45d2d85a-4eda-4345-bc32-e291f9d9562d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:16:21.580039 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.580022    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d2d85a-4eda-4345-bc32-e291f9d9562d-kube-api-access-wq4g8" (OuterVolumeSpecName: "kube-api-access-wq4g8") pod "45d2d85a-4eda-4345-bc32-e291f9d9562d" (UID: "45d2d85a-4eda-4345-bc32-e291f9d9562d"). InnerVolumeSpecName "kube-api-access-wq4g8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:16:21.640132 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.640102    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj" event={"ID":"2e56ce89-8709-4d29-b0be-9ab34d43cef1","Type":"ContainerStarted","Data":"4094f0e68ec60e5e725706a1ea94371d7bf5db9c3b375e805837443e13ee9800"}
Jul 21 04:16:21.641518 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.641497    2576 generic.go:356] "Generic (PLEG): container finished" podID="45d2d85a-4eda-4345-bc32-e291f9d9562d" containerID="7fc882f837a21d83e655e0a0dc65c79c794f67f76ba27ae9d5ee5bca305608a4" exitCode=0
Jul 21 04:16:21.641626 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.641528    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9554d6fbc-pk6v5"
Jul 21 04:16:21.641626 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.641555    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9554d6fbc-pk6v5" event={"ID":"45d2d85a-4eda-4345-bc32-e291f9d9562d","Type":"ContainerDied","Data":"7fc882f837a21d83e655e0a0dc65c79c794f67f76ba27ae9d5ee5bca305608a4"}
Jul 21 04:16:21.641626 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.641588    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9554d6fbc-pk6v5" event={"ID":"45d2d85a-4eda-4345-bc32-e291f9d9562d","Type":"ContainerDied","Data":"6e3f3d4d7cf078896abd395d69739028d49ce86e4238db6ff1c24066f554fd82"}
Jul 21 04:16:21.641626 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.641606    2576 scope.go:117] "RemoveContainer" containerID="7fc882f837a21d83e655e0a0dc65c79c794f67f76ba27ae9d5ee5bca305608a4"
Jul 21 04:16:21.650460 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.650444    2576 scope.go:117] "RemoveContainer" containerID="7fc882f837a21d83e655e0a0dc65c79c794f67f76ba27ae9d5ee5bca305608a4"
Jul 21 04:16:21.650743 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:16:21.650726    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fc882f837a21d83e655e0a0dc65c79c794f67f76ba27ae9d5ee5bca305608a4\": container with ID starting with 7fc882f837a21d83e655e0a0dc65c79c794f67f76ba27ae9d5ee5bca305608a4 not found: ID does not exist" containerID="7fc882f837a21d83e655e0a0dc65c79c794f67f76ba27ae9d5ee5bca305608a4"
Jul 21 04:16:21.650809 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.650752    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fc882f837a21d83e655e0a0dc65c79c794f67f76ba27ae9d5ee5bca305608a4"} err="failed to get container status \"7fc882f837a21d83e655e0a0dc65c79c794f67f76ba27ae9d5ee5bca305608a4\": rpc error: code = NotFound desc = could not find container \"7fc882f837a21d83e655e0a0dc65c79c794f67f76ba27ae9d5ee5bca305608a4\": container with ID starting with 7fc882f837a21d83e655e0a0dc65c79c794f67f76ba27ae9d5ee5bca305608a4 not found: ID does not exist"
Jul 21 04:16:21.678904 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.678880    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-oauth-config\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:16:21.678904 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.678900    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-service-ca\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:16:21.679026 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.678913    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-config\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:16:21.679026 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.678921    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-oauth-serving-cert\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:16:21.679026 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.678929    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d2d85a-4eda-4345-bc32-e291f9d9562d-trusted-ca-bundle\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:16:21.679026 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.678937    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45d2d85a-4eda-4345-bc32-e291f9d9562d-console-serving-cert\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:16:21.679026 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.678946    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wq4g8\" (UniqueName: \"kubernetes.io/projected/45d2d85a-4eda-4345-bc32-e291f9d9562d-kube-api-access-wq4g8\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:16:21.681550 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.681512    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tj8bj" podStartSLOduration=1.678115038 podStartE2EDuration="23.681500428s" totalImagesPullingTime="22.00338539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:16:21.680239521 +0000 UTC m=+731.497806304" watchObservedRunningTime="2026-07-21 04:16:21.681500428 +0000 UTC m=+731.499067232"
Jul 21 04:16:21.718226 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.718202    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9554d6fbc-pk6v5"]
Jul 21 04:16:21.724633 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:21.724611    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9554d6fbc-pk6v5"]
Jul 21 04:16:22.663586 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:22.663551    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45d2d85a-4eda-4345-bc32-e291f9d9562d" path="/var/lib/kubelet/pods/45d2d85a-4eda-4345-bc32-e291f9d9562d/volumes"
Jul 21 04:16:53.773787 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:53.773745    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:16:53.774293 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:53.774244    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45d2d85a-4eda-4345-bc32-e291f9d9562d" containerName="console"
Jul 21 04:16:53.774293 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:53.774264    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="45d2d85a-4eda-4345-bc32-e291f9d9562d" containerName="console"
Jul 21 04:16:53.774410 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:53.774367    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="45d2d85a-4eda-4345-bc32-e291f9d9562d" containerName="console"
Jul 21 04:16:53.816033 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:53.815997    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:16:53.816033 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:53.816038    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:16:53.816216 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:53.816112    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"
Jul 21 04:16:53.818446 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:53.818427    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 04:16:53.846610 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:53.846584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7wgm\" (UniqueName: \"kubernetes.io/projected/f953cbc0-3538-4c0d-b541-a7901ad98610-kube-api-access-f7wgm\") pod \"limitador-limitador-54d6d988d5-f6qm5\" (UID: \"f953cbc0-3538-4c0d-b541-a7901ad98610\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"
Jul 21 04:16:53.846718 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:53.846614    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f953cbc0-3538-4c0d-b541-a7901ad98610-config-file\") pod \"limitador-limitador-54d6d988d5-f6qm5\" (UID: \"f953cbc0-3538-4c0d-b541-a7901ad98610\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"
Jul 21 04:16:53.947557 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:53.947524    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7wgm\" (UniqueName: \"kubernetes.io/projected/f953cbc0-3538-4c0d-b541-a7901ad98610-kube-api-access-f7wgm\") pod \"limitador-limitador-54d6d988d5-f6qm5\" (UID: \"f953cbc0-3538-4c0d-b541-a7901ad98610\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"
Jul 21 04:16:53.947557 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:53.947558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f953cbc0-3538-4c0d-b541-a7901ad98610-config-file\") pod \"limitador-limitador-54d6d988d5-f6qm5\" (UID: \"f953cbc0-3538-4c0d-b541-a7901ad98610\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"
Jul 21 04:16:53.948179 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:53.948159    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f953cbc0-3538-4c0d-b541-a7901ad98610-config-file\") pod \"limitador-limitador-54d6d988d5-f6qm5\" (UID: \"f953cbc0-3538-4c0d-b541-a7901ad98610\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"
Jul 21 04:16:53.956239 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:53.956216    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7wgm\" (UniqueName: \"kubernetes.io/projected/f953cbc0-3538-4c0d-b541-a7901ad98610-kube-api-access-f7wgm\") pod \"limitador-limitador-54d6d988d5-f6qm5\" (UID: \"f953cbc0-3538-4c0d-b541-a7901ad98610\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"
Jul 21 04:16:54.126085 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:54.126056    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"
Jul 21 04:16:54.259263 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:54.259237    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:16:54.261130 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:16:54.261098    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf953cbc0_3538_4c0d_b541_a7901ad98610.slice/crio-3cb2a1f08eb71d77d9a0c0eaf80caefde2597f971152810060925df534f4aed7 WatchSource:0}: Error finding container 3cb2a1f08eb71d77d9a0c0eaf80caefde2597f971152810060925df534f4aed7: Status 404 returned error can't find the container with id 3cb2a1f08eb71d77d9a0c0eaf80caefde2597f971152810060925df534f4aed7
Jul 21 04:16:54.592520 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:54.592491    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-nnftd"]
Jul 21 04:16:54.597348 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:54.597326    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nnftd"
Jul 21 04:16:54.601519 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:54.601497    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-htl9d\""
Jul 21 04:16:54.603938 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:54.603915    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nnftd"]
Jul 21 04:16:54.653924 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:54.653899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82ws4\" (UniqueName: \"kubernetes.io/projected/efaaae64-f6fc-49d8-97bc-a864a204417a-kube-api-access-82ws4\") pod \"authorino-75d556bd77-nnftd\" (UID: \"efaaae64-f6fc-49d8-97bc-a864a204417a\") " pod="kuadrant-system/authorino-75d556bd77-nnftd"
Jul 21 04:16:54.755512 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:54.754415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82ws4\" (UniqueName: \"kubernetes.io/projected/efaaae64-f6fc-49d8-97bc-a864a204417a-kube-api-access-82ws4\") pod \"authorino-75d556bd77-nnftd\" (UID: \"efaaae64-f6fc-49d8-97bc-a864a204417a\") " pod="kuadrant-system/authorino-75d556bd77-nnftd"
Jul 21 04:16:54.763762 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:54.763736    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82ws4\" (UniqueName: \"kubernetes.io/projected/efaaae64-f6fc-49d8-97bc-a864a204417a-kube-api-access-82ws4\") pod \"authorino-75d556bd77-nnftd\" (UID: \"efaaae64-f6fc-49d8-97bc-a864a204417a\") " pod="kuadrant-system/authorino-75d556bd77-nnftd"
Jul 21 04:16:54.812889 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:54.812852    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-f6qm5" event={"ID":"f953cbc0-3538-4c0d-b541-a7901ad98610","Type":"ContainerStarted","Data":"3cb2a1f08eb71d77d9a0c0eaf80caefde2597f971152810060925df534f4aed7"}
Jul 21 04:16:54.908265 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:54.907998    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nnftd"
Jul 21 04:16:55.082433 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:55.082401    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nnftd"]
Jul 21 04:16:55.084034 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:16:55.084007    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefaaae64_f6fc_49d8_97bc_a864a204417a.slice/crio-bf297636ace69443ba0070eb62bb28aa79610c86b546bf3a8b5ab4e723f31fab WatchSource:0}: Error finding container bf297636ace69443ba0070eb62bb28aa79610c86b546bf3a8b5ab4e723f31fab: Status 404 returned error can't find the container with id bf297636ace69443ba0070eb62bb28aa79610c86b546bf3a8b5ab4e723f31fab
Jul 21 04:16:55.820069 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:55.820025    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nnftd" event={"ID":"efaaae64-f6fc-49d8-97bc-a864a204417a","Type":"ContainerStarted","Data":"bf297636ace69443ba0070eb62bb28aa79610c86b546bf3a8b5ab4e723f31fab"}
Jul 21 04:16:57.834975 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:57.834915    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-f6qm5" event={"ID":"f953cbc0-3538-4c0d-b541-a7901ad98610","Type":"ContainerStarted","Data":"56723450e4dca2a0219473481b0c5b21b91fc946c24cc09c8f1fdad4b5ea1c87"}
Jul 21 04:16:57.835470 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:57.835080    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"
Jul 21 04:16:57.853012 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:57.852969    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-f6qm5" podStartSLOduration=2.236346145 podStartE2EDuration="4.852952586s" totalImagesPullingTime="2.616606441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:16:57.852085528 +0000 UTC m=+767.669652309" watchObservedRunningTime="2026-07-21 04:16:57.852952586 +0000 UTC m=+767.670519399"
Jul 21 04:16:58.842889 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:58.842860    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nnftd" event={"ID":"efaaae64-f6fc-49d8-97bc-a864a204417a","Type":"ContainerStarted","Data":"15853da6a3bf7a560965b7bd31ea542c6e38e12a9f2a9057e24c7daa34df3aff"}
Jul 21 04:16:58.855904 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:16:58.855864    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-nnftd" podStartSLOduration=1.164487717 podStartE2EDuration="4.85585011s" totalImagesPullingTime="3.691362393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:16:58.854258263 +0000 UTC m=+768.671825048" watchObservedRunningTime="2026-07-21 04:16:58.85585011 +0000 UTC m=+768.673416894"
Jul 21 04:17:08.844218 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:08.844174    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"
Jul 21 04:17:28.027866 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:28.027831    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-554df5966d-wg878"]
Jul 21 04:17:28.036084 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:28.036054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-554df5966d-wg878"
Jul 21 04:17:28.038352 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:28.038333    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 21 04:17:28.038671 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:28.038651    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-554df5966d-wg878"]
Jul 21 04:17:28.041617 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:28.041591    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41d22158-111f-49d1-b638-7d79af78df55-tls-cert\") pod \"authorino-554df5966d-wg878\" (UID: \"41d22158-111f-49d1-b638-7d79af78df55\") " pod="kuadrant-system/authorino-554df5966d-wg878"
Jul 21 04:17:28.041751 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:28.041684    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8qq7\" (UniqueName: \"kubernetes.io/projected/41d22158-111f-49d1-b638-7d79af78df55-kube-api-access-t8qq7\") pod \"authorino-554df5966d-wg878\" (UID: \"41d22158-111f-49d1-b638-7d79af78df55\") " pod="kuadrant-system/authorino-554df5966d-wg878"
Jul 21 04:17:28.142026 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:28.141999    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8qq7\" (UniqueName: \"kubernetes.io/projected/41d22158-111f-49d1-b638-7d79af78df55-kube-api-access-t8qq7\") pod \"authorino-554df5966d-wg878\" (UID: \"41d22158-111f-49d1-b638-7d79af78df55\") " pod="kuadrant-system/authorino-554df5966d-wg878"
Jul 21 04:17:28.142138 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:28.142049    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41d22158-111f-49d1-b638-7d79af78df55-tls-cert\") pod \"authorino-554df5966d-wg878\" (UID: \"41d22158-111f-49d1-b638-7d79af78df55\") " pod="kuadrant-system/authorino-554df5966d-wg878"
Jul 21 04:17:28.144559 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:28.144536    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41d22158-111f-49d1-b638-7d79af78df55-tls-cert\") pod \"authorino-554df5966d-wg878\" (UID: \"41d22158-111f-49d1-b638-7d79af78df55\") " pod="kuadrant-system/authorino-554df5966d-wg878"
Jul 21 04:17:28.149952 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:28.149927    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8qq7\" (UniqueName: \"kubernetes.io/projected/41d22158-111f-49d1-b638-7d79af78df55-kube-api-access-t8qq7\") pod \"authorino-554df5966d-wg878\" (UID: \"41d22158-111f-49d1-b638-7d79af78df55\") " pod="kuadrant-system/authorino-554df5966d-wg878"
Jul 21 04:17:28.346734 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:28.346703    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-554df5966d-wg878"
Jul 21 04:17:28.478136 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:28.478112    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-554df5966d-wg878"]
Jul 21 04:17:28.480269 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:17:28.480242    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41d22158_111f_49d1_b638_7d79af78df55.slice/crio-2b1e621f09b9152fe4c942cb005b707f40cb18c99e36b31040b5798765564ae1 WatchSource:0}: Error finding container 2b1e621f09b9152fe4c942cb005b707f40cb18c99e36b31040b5798765564ae1: Status 404 returned error can't find the container with id 2b1e621f09b9152fe4c942cb005b707f40cb18c99e36b31040b5798765564ae1
Jul 21 04:17:29.002926 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:29.002889    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-554df5966d-wg878" event={"ID":"41d22158-111f-49d1-b638-7d79af78df55","Type":"ContainerStarted","Data":"fec1476836ae3ceda43deb99be32ddde98d30451ce339548ec6b20fe7c43589d"}
Jul 21 04:17:29.002926 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:29.002933    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-554df5966d-wg878" event={"ID":"41d22158-111f-49d1-b638-7d79af78df55","Type":"ContainerStarted","Data":"2b1e621f09b9152fe4c942cb005b707f40cb18c99e36b31040b5798765564ae1"}
Jul 21 04:17:29.019726 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:29.019676    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-554df5966d-wg878" podStartSLOduration=0.690321656 podStartE2EDuration="1.019662083s" totalImagesPullingTime="329.340427ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:17:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:17:29.018568317 +0000 UTC m=+798.836135102" watchObservedRunningTime="2026-07-21 04:17:29.019662083 +0000 UTC m=+798.837228858"
Jul 21 04:17:29.048780 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:29.048750    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nnftd"]
Jul 21 04:17:29.049178 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:29.048916    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-nnftd" podUID="efaaae64-f6fc-49d8-97bc-a864a204417a" containerName="authorino" containerID="cri-o://15853da6a3bf7a560965b7bd31ea542c6e38e12a9f2a9057e24c7daa34df3aff" gracePeriod=30
Jul 21 04:17:29.287704 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:29.287669    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nnftd"
Jul 21 04:17:29.350866 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:29.350842    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82ws4\" (UniqueName: \"kubernetes.io/projected/efaaae64-f6fc-49d8-97bc-a864a204417a-kube-api-access-82ws4\") pod \"efaaae64-f6fc-49d8-97bc-a864a204417a\" (UID: \"efaaae64-f6fc-49d8-97bc-a864a204417a\") "
Jul 21 04:17:29.352978 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:29.352952    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efaaae64-f6fc-49d8-97bc-a864a204417a-kube-api-access-82ws4" (OuterVolumeSpecName: "kube-api-access-82ws4") pod "efaaae64-f6fc-49d8-97bc-a864a204417a" (UID: "efaaae64-f6fc-49d8-97bc-a864a204417a"). InnerVolumeSpecName "kube-api-access-82ws4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:17:29.452038 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:29.451984    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82ws4\" (UniqueName: \"kubernetes.io/projected/efaaae64-f6fc-49d8-97bc-a864a204417a-kube-api-access-82ws4\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:17:30.009551 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:30.009515    2576 generic.go:356] "Generic (PLEG): container finished" podID="efaaae64-f6fc-49d8-97bc-a864a204417a" containerID="15853da6a3bf7a560965b7bd31ea542c6e38e12a9f2a9057e24c7daa34df3aff" exitCode=0
Jul 21 04:17:30.009551 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:30.009551    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nnftd"
Jul 21 04:17:30.009793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:30.009597    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nnftd" event={"ID":"efaaae64-f6fc-49d8-97bc-a864a204417a","Type":"ContainerDied","Data":"15853da6a3bf7a560965b7bd31ea542c6e38e12a9f2a9057e24c7daa34df3aff"}
Jul 21 04:17:30.009793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:30.009658    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nnftd" event={"ID":"efaaae64-f6fc-49d8-97bc-a864a204417a","Type":"ContainerDied","Data":"bf297636ace69443ba0070eb62bb28aa79610c86b546bf3a8b5ab4e723f31fab"}
Jul 21 04:17:30.009793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:30.009676    2576 scope.go:117] "RemoveContainer" containerID="15853da6a3bf7a560965b7bd31ea542c6e38e12a9f2a9057e24c7daa34df3aff"
Jul 21 04:17:30.020996 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:30.020955    2576 scope.go:117] "RemoveContainer" containerID="15853da6a3bf7a560965b7bd31ea542c6e38e12a9f2a9057e24c7daa34df3aff"
Jul 21 04:17:30.021379 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:17:30.021360    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15853da6a3bf7a560965b7bd31ea542c6e38e12a9f2a9057e24c7daa34df3aff\": container with ID starting with 15853da6a3bf7a560965b7bd31ea542c6e38e12a9f2a9057e24c7daa34df3aff not found: ID does not exist" containerID="15853da6a3bf7a560965b7bd31ea542c6e38e12a9f2a9057e24c7daa34df3aff"
Jul 21 04:17:30.021484 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:30.021384    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15853da6a3bf7a560965b7bd31ea542c6e38e12a9f2a9057e24c7daa34df3aff"} err="failed to get container status \"15853da6a3bf7a560965b7bd31ea542c6e38e12a9f2a9057e24c7daa34df3aff\": rpc error: code = NotFound desc = could not find container \"15853da6a3bf7a560965b7bd31ea542c6e38e12a9f2a9057e24c7daa34df3aff\": container with ID starting with 15853da6a3bf7a560965b7bd31ea542c6e38e12a9f2a9057e24c7daa34df3aff not found: ID does not exist"
Jul 21 04:17:30.032697 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:30.032676    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nnftd"]
Jul 21 04:17:30.036931 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:30.036914    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nnftd"]
Jul 21 04:17:30.665625 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:17:30.665596    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efaaae64-f6fc-49d8-97bc-a864a204417a" path="/var/lib/kubelet/pods/efaaae64-f6fc-49d8-97bc-a864a204417a/volumes"
Jul 21 04:18:12.378477 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:18:12.378443    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:18:34.942222 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:18:34.942191    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:18:45.041399 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:18:45.041361    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:19:11.354785 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:11.354744    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:19:12.269792 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:12.269679    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:19:12.276600 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:12.269968    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:19:34.052834 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:34.052786    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:19:43.948393 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:43.948337    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:19:46.540778 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.540744    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"]
Jul 21 04:19:46.541151 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.541127    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efaaae64-f6fc-49d8-97bc-a864a204417a" containerName="authorino"
Jul 21 04:19:46.541151 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.541142    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="efaaae64-f6fc-49d8-97bc-a864a204417a" containerName="authorino"
Jul 21 04:19:46.541229 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.541220    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="efaaae64-f6fc-49d8-97bc-a864a204417a" containerName="authorino"
Jul 21 04:19:46.544201 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.544185    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.547479 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.547452    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 04:19:46.547479 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.547471    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s7zhr\""
Jul 21 04:19:46.547479 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.547485    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 04:19:46.547815 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.547471    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 21 04:19:46.555309 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.555277    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"]
Jul 21 04:19:46.615823 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.615783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtb6n\" (UniqueName: \"kubernetes.io/projected/eec1b510-2853-44a2-a946-44ced3bb3506-kube-api-access-rtb6n\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.616013 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.615854    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eec1b510-2853-44a2-a946-44ced3bb3506-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.616013 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.615897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eec1b510-2853-44a2-a946-44ced3bb3506-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.616013 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.615927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eec1b510-2853-44a2-a946-44ced3bb3506-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.616013 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.615971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eec1b510-2853-44a2-a946-44ced3bb3506-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.616013 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.615994    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eec1b510-2853-44a2-a946-44ced3bb3506-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.716952 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.716913    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eec1b510-2853-44a2-a946-44ced3bb3506-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.716952 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.716954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eec1b510-2853-44a2-a946-44ced3bb3506-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.717221 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.716983    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eec1b510-2853-44a2-a946-44ced3bb3506-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.717221 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.717042    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtb6n\" (UniqueName: \"kubernetes.io/projected/eec1b510-2853-44a2-a946-44ced3bb3506-kube-api-access-rtb6n\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.717221 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.717121    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eec1b510-2853-44a2-a946-44ced3bb3506-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.717221 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.717181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eec1b510-2853-44a2-a946-44ced3bb3506-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.717430 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.717409    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eec1b510-2853-44a2-a946-44ced3bb3506-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.717501 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.717461    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eec1b510-2853-44a2-a946-44ced3bb3506-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.717722 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.717698    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eec1b510-2853-44a2-a946-44ced3bb3506-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.719455 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.719436    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eec1b510-2853-44a2-a946-44ced3bb3506-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.719855 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.719835    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eec1b510-2853-44a2-a946-44ced3bb3506-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.726852 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.726826    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtb6n\" (UniqueName: \"kubernetes.io/projected/eec1b510-2853-44a2-a946-44ced3bb3506-kube-api-access-rtb6n\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krfwg\" (UID: \"eec1b510-2853-44a2-a946-44ced3bb3506\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.853879 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.853842    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:46.998000 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:46.997938    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"]
Jul 21 04:19:47.000552 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:19:47.000522    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeec1b510_2853_44a2_a946_44ced3bb3506.slice/crio-339011d9f9a0196d5963651f1571c534ccd64440774f841294572acaf82b584d WatchSource:0}: Error finding container 339011d9f9a0196d5963651f1571c534ccd64440774f841294572acaf82b584d: Status 404 returned error can't find the container with id 339011d9f9a0196d5963651f1571c534ccd64440774f841294572acaf82b584d
Jul 21 04:19:47.740889 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:47.740845    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg" event={"ID":"eec1b510-2853-44a2-a946-44ced3bb3506","Type":"ContainerStarted","Data":"339011d9f9a0196d5963651f1571c534ccd64440774f841294572acaf82b584d"}
Jul 21 04:19:48.747630 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:48.747588    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg" event={"ID":"eec1b510-2853-44a2-a946-44ced3bb3506","Type":"ContainerStarted","Data":"6951bca59e82cca60d4f2bcc4e1803bfdb79f8aac53c57e9f227f2edb5bc337e"}
Jul 21 04:19:48.766426 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:48.766364    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg" podStartSLOduration=1.71942994 podStartE2EDuration="2.766345041s" totalImagesPullingTime="1.046915101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:19:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:19:48.76402446 +0000 UTC m=+938.581591241" watchObservedRunningTime="2026-07-21 04:19:48.766345041 +0000 UTC m=+938.583911802"
Jul 21 04:19:51.749099 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:51.749059    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:19:56.854915 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:56.854876    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:56.854915 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:56.854922    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:56.867385 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:56.867354    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:19:57.806906 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:19:57.806872    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krfwg"
Jul 21 04:20:33.822332 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:33.822240    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59b45c9589-fwxm2"]
Jul 21 04:20:33.826073 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:33.826047    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59b45c9589-fwxm2"
Jul 21 04:20:33.833903 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:33.833870    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59b45c9589-fwxm2"]
Jul 21 04:20:33.944913 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:33.944869    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq25l\" (UniqueName: \"kubernetes.io/projected/74d05fa2-78ec-46d7-a2a7-7f777db24707-kube-api-access-lq25l\") pod \"authorino-59b45c9589-fwxm2\" (UID: \"74d05fa2-78ec-46d7-a2a7-7f777db24707\") " pod="kuadrant-system/authorino-59b45c9589-fwxm2"
Jul 21 04:20:33.945106 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:33.944996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/74d05fa2-78ec-46d7-a2a7-7f777db24707-tls-cert\") pod \"authorino-59b45c9589-fwxm2\" (UID: \"74d05fa2-78ec-46d7-a2a7-7f777db24707\") " pod="kuadrant-system/authorino-59b45c9589-fwxm2"
Jul 21 04:20:34.046353 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:34.046308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/74d05fa2-78ec-46d7-a2a7-7f777db24707-tls-cert\") pod \"authorino-59b45c9589-fwxm2\" (UID: \"74d05fa2-78ec-46d7-a2a7-7f777db24707\") " pod="kuadrant-system/authorino-59b45c9589-fwxm2"
Jul 21 04:20:34.046543 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:34.046363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq25l\" (UniqueName: \"kubernetes.io/projected/74d05fa2-78ec-46d7-a2a7-7f777db24707-kube-api-access-lq25l\") pod \"authorino-59b45c9589-fwxm2\" (UID: \"74d05fa2-78ec-46d7-a2a7-7f777db24707\") " pod="kuadrant-system/authorino-59b45c9589-fwxm2"
Jul 21 04:20:34.048952 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:34.048929    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/74d05fa2-78ec-46d7-a2a7-7f777db24707-tls-cert\") pod \"authorino-59b45c9589-fwxm2\" (UID: \"74d05fa2-78ec-46d7-a2a7-7f777db24707\") " pod="kuadrant-system/authorino-59b45c9589-fwxm2"
Jul 21 04:20:34.054683 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:34.054625    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq25l\" (UniqueName: \"kubernetes.io/projected/74d05fa2-78ec-46d7-a2a7-7f777db24707-kube-api-access-lq25l\") pod \"authorino-59b45c9589-fwxm2\" (UID: \"74d05fa2-78ec-46d7-a2a7-7f777db24707\") " pod="kuadrant-system/authorino-59b45c9589-fwxm2"
Jul 21 04:20:34.136516 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:34.136424    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59b45c9589-fwxm2"
Jul 21 04:20:34.281147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:34.281120    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59b45c9589-fwxm2"]
Jul 21 04:20:34.283366 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:20:34.283330    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74d05fa2_78ec_46d7_a2a7_7f777db24707.slice/crio-0780fc2729d841419fdd476ee85064d5724a4dbac0d2643de3ef974d4da09c18 WatchSource:0}: Error finding container 0780fc2729d841419fdd476ee85064d5724a4dbac0d2643de3ef974d4da09c18: Status 404 returned error can't find the container with id 0780fc2729d841419fdd476ee85064d5724a4dbac0d2643de3ef974d4da09c18
Jul 21 04:20:34.284690 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:34.284672    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:20:35.002280 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:35.002223    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59b45c9589-fwxm2" event={"ID":"74d05fa2-78ec-46d7-a2a7-7f777db24707","Type":"ContainerStarted","Data":"02a11878c49a73d4385417dd686c62ded05557ac793204425a07c525202f2a34"}
Jul 21 04:20:35.002769 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:35.002677    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59b45c9589-fwxm2" event={"ID":"74d05fa2-78ec-46d7-a2a7-7f777db24707","Type":"ContainerStarted","Data":"0780fc2729d841419fdd476ee85064d5724a4dbac0d2643de3ef974d4da09c18"}
Jul 21 04:20:35.020832 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:35.020771    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59b45c9589-fwxm2" podStartSLOduration=1.421249146 podStartE2EDuration="2.020754095s" totalImagesPullingTime="599.504949ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:20:35.01865903 +0000 UTC m=+984.836225810" watchObservedRunningTime="2026-07-21 04:20:35.020754095 +0000 UTC m=+984.838320878"
Jul 21 04:20:35.050307 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:35.050250    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-554df5966d-wg878"]
Jul 21 04:20:35.051053 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:35.051020    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-554df5966d-wg878" podUID="41d22158-111f-49d1-b638-7d79af78df55" containerName="authorino" containerID="cri-o://fec1476836ae3ceda43deb99be32ddde98d30451ce339548ec6b20fe7c43589d" gracePeriod=30
Jul 21 04:20:35.325327 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:35.325298    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-554df5966d-wg878"
Jul 21 04:20:35.461006 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:35.460912    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41d22158-111f-49d1-b638-7d79af78df55-tls-cert\") pod \"41d22158-111f-49d1-b638-7d79af78df55\" (UID: \"41d22158-111f-49d1-b638-7d79af78df55\") "
Jul 21 04:20:35.461191 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:35.461028    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8qq7\" (UniqueName: \"kubernetes.io/projected/41d22158-111f-49d1-b638-7d79af78df55-kube-api-access-t8qq7\") pod \"41d22158-111f-49d1-b638-7d79af78df55\" (UID: \"41d22158-111f-49d1-b638-7d79af78df55\") "
Jul 21 04:20:35.463194 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:35.463162    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41d22158-111f-49d1-b638-7d79af78df55-kube-api-access-t8qq7" (OuterVolumeSpecName: "kube-api-access-t8qq7") pod "41d22158-111f-49d1-b638-7d79af78df55" (UID: "41d22158-111f-49d1-b638-7d79af78df55"). InnerVolumeSpecName "kube-api-access-t8qq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:20:35.473870 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:35.473838    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d22158-111f-49d1-b638-7d79af78df55-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "41d22158-111f-49d1-b638-7d79af78df55" (UID: "41d22158-111f-49d1-b638-7d79af78df55"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:20:35.562575 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:35.562534    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8qq7\" (UniqueName: \"kubernetes.io/projected/41d22158-111f-49d1-b638-7d79af78df55-kube-api-access-t8qq7\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:20:35.562575 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:35.562567    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41d22158-111f-49d1-b638-7d79af78df55-tls-cert\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:20:36.015676 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:36.012702    2576 generic.go:356] "Generic (PLEG): container finished" podID="41d22158-111f-49d1-b638-7d79af78df55" containerID="fec1476836ae3ceda43deb99be32ddde98d30451ce339548ec6b20fe7c43589d" exitCode=0
Jul 21 04:20:36.015676 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:36.013427    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-554df5966d-wg878"
Jul 21 04:20:36.019988 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:36.019716    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-554df5966d-wg878" event={"ID":"41d22158-111f-49d1-b638-7d79af78df55","Type":"ContainerDied","Data":"fec1476836ae3ceda43deb99be32ddde98d30451ce339548ec6b20fe7c43589d"}
Jul 21 04:20:36.020196 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:36.020176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-554df5966d-wg878" event={"ID":"41d22158-111f-49d1-b638-7d79af78df55","Type":"ContainerDied","Data":"2b1e621f09b9152fe4c942cb005b707f40cb18c99e36b31040b5798765564ae1"}
Jul 21 04:20:36.020411 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:36.020322    2576 scope.go:117] "RemoveContainer" containerID="fec1476836ae3ceda43deb99be32ddde98d30451ce339548ec6b20fe7c43589d"
Jul 21 04:20:36.033947 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:36.033925    2576 scope.go:117] "RemoveContainer" containerID="fec1476836ae3ceda43deb99be32ddde98d30451ce339548ec6b20fe7c43589d"
Jul 21 04:20:36.034311 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:20:36.034290    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fec1476836ae3ceda43deb99be32ddde98d30451ce339548ec6b20fe7c43589d\": container with ID starting with fec1476836ae3ceda43deb99be32ddde98d30451ce339548ec6b20fe7c43589d not found: ID does not exist" containerID="fec1476836ae3ceda43deb99be32ddde98d30451ce339548ec6b20fe7c43589d"
Jul 21 04:20:36.034387 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:36.034326    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec1476836ae3ceda43deb99be32ddde98d30451ce339548ec6b20fe7c43589d"} err="failed to get container status \"fec1476836ae3ceda43deb99be32ddde98d30451ce339548ec6b20fe7c43589d\": rpc error: code = NotFound desc = could not find container \"fec1476836ae3ceda43deb99be32ddde98d30451ce339548ec6b20fe7c43589d\": container with ID starting with fec1476836ae3ceda43deb99be32ddde98d30451ce339548ec6b20fe7c43589d not found: ID does not exist"
Jul 21 04:20:36.043531 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:36.043503    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-554df5966d-wg878"]
Jul 21 04:20:36.052248 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:36.052221    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-554df5966d-wg878"]
Jul 21 04:20:36.666214 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:20:36.666170    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41d22158-111f-49d1-b638-7d79af78df55" path="/var/lib/kubelet/pods/41d22158-111f-49d1-b638-7d79af78df55/volumes"
Jul 21 04:21:04.055765 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:21:04.055724    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:21:14.368356 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:21:14.368323    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:21:24.964071 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:21:24.964032    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:23:04.047963 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:23:04.047928    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:23:13.547782 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:23:13.547732    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:23:48.150361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:23:48.150320    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:23:57.850739 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:23:57.850694    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:24:08.250354 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:24:08.250316    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:24:12.305995 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:24:12.305880    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:24:12.309170 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:24:12.307478    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:24:14.543161 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:24:14.543123    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:24:23.551581 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:24:23.551545    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:24:35.551649 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:24:35.551588    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:24:46.443015 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:24:46.442973    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:24:56.351529 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:24:56.351490    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:25:18.046051 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:25:18.046015    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:25:29.638393 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:25:29.638349    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:25:52.546084 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:25:52.546038    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:26:03.344199 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:26:03.344157    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:26:19.661662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:26:19.661608    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:26:30.046012 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:26:30.045977    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:26:47.748941 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:26:47.748854    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:26:57.650135 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:26:57.650096    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:28:46.543977 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:28:46.543921    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:28:58.251382 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:28:58.251346    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:29:07.157802 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:29:07.157761    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:29:12.342763 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:29:12.342737    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:29:12.345263 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:29:12.345245    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:29:20.245748 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:29:20.245713    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:29:30.044019 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:29:30.043978    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:29:39.345929 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:29:39.345844    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:29:47.441424 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:29:47.441387    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:29:56.446426 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:29:56.446391    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:30:05.849680 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:30:05.849631    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:30:15.036736 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:30:15.036703    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:30:28.338065 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:30:28.338029    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:30:35.850855 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:30:35.850816    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:30:53.549109 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:30:53.549064    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:31:02.852959 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:02.852872    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:31:04.846977 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:04.846874    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"]
Jul 21 04:31:04.847494 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:04.847472    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d22158-111f-49d1-b638-7d79af78df55" containerName="authorino"
Jul 21 04:31:04.847557 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:04.847500    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d22158-111f-49d1-b638-7d79af78df55" containerName="authorino"
Jul 21 04:31:04.847656 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:04.847625    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="41d22158-111f-49d1-b638-7d79af78df55" containerName="authorino"
Jul 21 04:31:04.850860 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:04.850843    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:04.853353 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:04.853331    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-ea07417e-kserve-self-signed-certs\""
Jul 21 04:31:04.859500 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:04.859468    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"]
Jul 21 04:31:04.933571 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:04.933529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-dshm\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:04.933571 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:04.933569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-home\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:04.933810 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:04.933597    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-tmp-dir\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:04.933810 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:04.933673    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrvgd\" (UniqueName: \"kubernetes.io/projected/ed6302c4-4f4b-4445-89ee-afb8017a8a83-kube-api-access-qrvgd\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:04.933810 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:04.933745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6302c4-4f4b-4445-89ee-afb8017a8a83-tls-certs\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:04.933810 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:04.933774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-model-cache\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:05.034708 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.034665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-model-cache\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:05.034887 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.034723    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-dshm\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:05.034887 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.034857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-home\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:05.035024 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.034909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-tmp-dir\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:05.035024 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.034959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrvgd\" (UniqueName: \"kubernetes.io/projected/ed6302c4-4f4b-4445-89ee-afb8017a8a83-kube-api-access-qrvgd\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:05.035129 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.035067    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6302c4-4f4b-4445-89ee-afb8017a8a83-tls-certs\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:05.035214 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.035197    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-model-cache\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:05.035271 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.035228    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-home\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:05.035314 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.035289    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-tmp-dir\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:05.037195 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.037174    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-dshm\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:05.037459 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.037443    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6302c4-4f4b-4445-89ee-afb8017a8a83-tls-certs\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:05.043418 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.043386    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrvgd\" (UniqueName: \"kubernetes.io/projected/ed6302c4-4f4b-4445-89ee-afb8017a8a83-kube-api-access-qrvgd\") pod \"e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") " pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:05.163611 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.163518    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:05.306258 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.306232    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"]
Jul 21 04:31:05.307976 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:31:05.307948    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded6302c4_4f4b_4445_89ee_afb8017a8a83.slice/crio-50b862dc7ce1808f5cd68d8c481f34ce6c37e2cc63b52b0e511f31c2e6443ac4 WatchSource:0}: Error finding container 50b862dc7ce1808f5cd68d8c481f34ce6c37e2cc63b52b0e511f31c2e6443ac4: Status 404 returned error can't find the container with id 50b862dc7ce1808f5cd68d8c481f34ce6c37e2cc63b52b0e511f31c2e6443ac4
Jul 21 04:31:05.418929 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.418832    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk" event={"ID":"ed6302c4-4f4b-4445-89ee-afb8017a8a83","Type":"ContainerStarted","Data":"08e2b6b675483ac700b0a4c5f6bae9f855d952a47c26de2a72f808734872306f"}
Jul 21 04:31:05.418929 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.418880    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk" event={"ID":"ed6302c4-4f4b-4445-89ee-afb8017a8a83","Type":"ContainerStarted","Data":"50b862dc7ce1808f5cd68d8c481f34ce6c37e2cc63b52b0e511f31c2e6443ac4"}
Jul 21 04:31:05.435733 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:05.435670    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk" podStartSLOduration=1.435628969 podStartE2EDuration="1.435628969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:31:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:31:05.434587974 +0000 UTC m=+1615.252154755" watchObservedRunningTime="2026-07-21 04:31:05.435628969 +0000 UTC m=+1615.253195753"
Jul 21 04:31:15.163911 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:15.163795    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:15.163911 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:15.163880    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:15.176625 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:15.176596    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:15.489530 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:15.489453    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:17.347059 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:17.347022    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:31:29.285375 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:29.285340    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:31:44.297260 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:44.297226    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"]
Jul 21 04:31:48.149903 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:48.149862    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:31:59.319163 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.319126    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk" podUID="ed6302c4-4f4b-4445-89ee-afb8017a8a83" containerName="main" containerID="cri-o://08e2b6b675483ac700b0a4c5f6bae9f855d952a47c26de2a72f808734872306f" gracePeriod=45
Jul 21 04:31:59.559605 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.559580    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:59.630565 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.630532    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrvgd\" (UniqueName: \"kubernetes.io/projected/ed6302c4-4f4b-4445-89ee-afb8017a8a83-kube-api-access-qrvgd\") pod \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") "
Jul 21 04:31:59.630729 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.630574    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6302c4-4f4b-4445-89ee-afb8017a8a83-tls-certs\") pod \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") "
Jul 21 04:31:59.630729 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.630631    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-tmp-dir\") pod \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") "
Jul 21 04:31:59.630729 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.630691    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-home\") pod \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") "
Jul 21 04:31:59.630729 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.630722    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-model-cache\") pod \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") "
Jul 21 04:31:59.630919 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.630760    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-dshm\") pod \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\" (UID: \"ed6302c4-4f4b-4445-89ee-afb8017a8a83\") "
Jul 21 04:31:59.631028 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.630997    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-home" (OuterVolumeSpecName: "home") pod "ed6302c4-4f4b-4445-89ee-afb8017a8a83" (UID: "ed6302c4-4f4b-4445-89ee-afb8017a8a83"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:31:59.631028 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.631013    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-model-cache" (OuterVolumeSpecName: "model-cache") pod "ed6302c4-4f4b-4445-89ee-afb8017a8a83" (UID: "ed6302c4-4f4b-4445-89ee-afb8017a8a83"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:31:59.631202 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.630997    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ed6302c4-4f4b-4445-89ee-afb8017a8a83" (UID: "ed6302c4-4f4b-4445-89ee-afb8017a8a83"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:31:59.632996 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.632968    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed6302c4-4f4b-4445-89ee-afb8017a8a83-kube-api-access-qrvgd" (OuterVolumeSpecName: "kube-api-access-qrvgd") pod "ed6302c4-4f4b-4445-89ee-afb8017a8a83" (UID: "ed6302c4-4f4b-4445-89ee-afb8017a8a83"). InnerVolumeSpecName "kube-api-access-qrvgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:31:59.633094 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.633010    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-dshm" (OuterVolumeSpecName: "dshm") pod "ed6302c4-4f4b-4445-89ee-afb8017a8a83" (UID: "ed6302c4-4f4b-4445-89ee-afb8017a8a83"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:31:59.633094 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.633015    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed6302c4-4f4b-4445-89ee-afb8017a8a83-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ed6302c4-4f4b-4445-89ee-afb8017a8a83" (UID: "ed6302c4-4f4b-4445-89ee-afb8017a8a83"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:31:59.716757 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.716717    2576 generic.go:356] "Generic (PLEG): container finished" podID="ed6302c4-4f4b-4445-89ee-afb8017a8a83" containerID="08e2b6b675483ac700b0a4c5f6bae9f855d952a47c26de2a72f808734872306f" exitCode=0
Jul 21 04:31:59.716921 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.716768    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"
Jul 21 04:31:59.716921 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.716802    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk" event={"ID":"ed6302c4-4f4b-4445-89ee-afb8017a8a83","Type":"ContainerDied","Data":"08e2b6b675483ac700b0a4c5f6bae9f855d952a47c26de2a72f808734872306f"}
Jul 21 04:31:59.716921 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.716846    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk" event={"ID":"ed6302c4-4f4b-4445-89ee-afb8017a8a83","Type":"ContainerDied","Data":"50b862dc7ce1808f5cd68d8c481f34ce6c37e2cc63b52b0e511f31c2e6443ac4"}
Jul 21 04:31:59.716921 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.716867    2576 scope.go:117] "RemoveContainer" containerID="08e2b6b675483ac700b0a4c5f6bae9f855d952a47c26de2a72f808734872306f"
Jul 21 04:31:59.726317 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.726301    2576 scope.go:117] "RemoveContainer" containerID="08e2b6b675483ac700b0a4c5f6bae9f855d952a47c26de2a72f808734872306f"
Jul 21 04:31:59.726574 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:31:59.726557    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08e2b6b675483ac700b0a4c5f6bae9f855d952a47c26de2a72f808734872306f\": container with ID starting with 08e2b6b675483ac700b0a4c5f6bae9f855d952a47c26de2a72f808734872306f not found: ID does not exist" containerID="08e2b6b675483ac700b0a4c5f6bae9f855d952a47c26de2a72f808734872306f"
Jul 21 04:31:59.726619 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.726581    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e2b6b675483ac700b0a4c5f6bae9f855d952a47c26de2a72f808734872306f"} err="failed to get container status \"08e2b6b675483ac700b0a4c5f6bae9f855d952a47c26de2a72f808734872306f\": rpc error: code = NotFound desc = could not find container \"08e2b6b675483ac700b0a4c5f6bae9f855d952a47c26de2a72f808734872306f\": container with ID starting with 08e2b6b675483ac700b0a4c5f6bae9f855d952a47c26de2a72f808734872306f not found: ID does not exist"
Jul 21 04:31:59.732320 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.732299    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-dshm\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:31:59.737826 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.737804    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrvgd\" (UniqueName: \"kubernetes.io/projected/ed6302c4-4f4b-4445-89ee-afb8017a8a83-kube-api-access-qrvgd\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:31:59.737961 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.737947    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6302c4-4f4b-4445-89ee-afb8017a8a83-tls-certs\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:31:59.738044 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.738035    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-tmp-dir\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:31:59.738124 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.738106    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-home\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:31:59.738185 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.738134    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed6302c4-4f4b-4445-89ee-afb8017a8a83-model-cache\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:31:59.745369 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.745349    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"]
Jul 21 04:31:59.754342 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:31:59.754323    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-ea07417e-kserve-5fbc9f44bc-kdkfk"]
Jul 21 04:32:00.665172 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:32:00.665130    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed6302c4-4f4b-4445-89ee-afb8017a8a83" path="/var/lib/kubelet/pods/ed6302c4-4f4b-4445-89ee-afb8017a8a83/volumes"
Jul 21 04:32:02.439668 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:32:02.439604    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:32:10.447602 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:32:10.447563    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:32:21.344327 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:32:21.344292    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:32:31.143944 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:32:31.143907    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:32:40.642135 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:32:40.642040    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:32:48.745949 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:32:48.745910    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:32:59.743730 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:32:59.743682    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:33:09.041053 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:33:09.041010    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:33:22.261696 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:33:22.261654    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:33:31.251892 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:33:31.251851    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:33:41.542269 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:33:41.542227    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:33:51.245354 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:33:51.245309    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:34:04.245962 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:34:04.245916    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:34:12.383427 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:34:12.383301    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:34:12.391075 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:34:12.389279    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:34:13.247067 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:34:13.247020    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:34:26.344457 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:34:26.344416    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:34:38.244373 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:34:38.244333    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:34:49.339929 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:34:49.339896    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:35:01.941096 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:01.941051    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:35:14.841854 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:14.841816    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:35:30.941263 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:30.941225    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:35:51.013463 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:51.013429    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22"]
Jul 21 04:35:51.013915 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:51.013798    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed6302c4-4f4b-4445-89ee-afb8017a8a83" containerName="main"
Jul 21 04:35:51.013915 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:51.013810    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed6302c4-4f4b-4445-89ee-afb8017a8a83" containerName="main"
Jul 21 04:35:51.013915 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:51.013871    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed6302c4-4f4b-4445-89ee-afb8017a8a83" containerName="main"
Jul 21 04:35:51.016854 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:51.016838    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22"
Jul 21 04:35:51.019032 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:51.019007    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 04:35:51.019145 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:51.019069    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k4z5s\""
Jul 21 04:35:51.022842 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:51.022821    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22"]
Jul 21 04:35:51.075010 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:51.074983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c9fb617-13d3-41e5-9f76-ded22c0f3be9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22\" (UID: \"6c9fb617-13d3-41e5-9f76-ded22c0f3be9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22"
Jul 21 04:35:51.175879 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:51.175851    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c9fb617-13d3-41e5-9f76-ded22c0f3be9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22\" (UID: \"6c9fb617-13d3-41e5-9f76-ded22c0f3be9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22"
Jul 21 04:35:51.176432 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:51.176412    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c9fb617-13d3-41e5-9f76-ded22c0f3be9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22\" (UID: \"6c9fb617-13d3-41e5-9f76-ded22c0f3be9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22"
Jul 21 04:35:51.329562 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:51.329541    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22"
Jul 21 04:35:51.460845 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:51.460818    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22"]
Jul 21 04:35:51.462358 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:35:51.462333    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c9fb617_13d3_41e5_9f76_ded22c0f3be9.slice/crio-99f6e764dd01cc6ab3bfa1f0fd8df49e1d612249d4d364ef3b3621b2369e74b7 WatchSource:0}: Error finding container 99f6e764dd01cc6ab3bfa1f0fd8df49e1d612249d4d364ef3b3621b2369e74b7: Status 404 returned error can't find the container with id 99f6e764dd01cc6ab3bfa1f0fd8df49e1d612249d4d364ef3b3621b2369e74b7
Jul 21 04:35:51.464234 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:51.464218    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:35:51.940964 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:51.940930    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22" event={"ID":"6c9fb617-13d3-41e5-9f76-ded22c0f3be9","Type":"ContainerStarted","Data":"99f6e764dd01cc6ab3bfa1f0fd8df49e1d612249d4d364ef3b3621b2369e74b7"}
Jul 21 04:35:53.953478 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:53.953439    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22" event={"ID":"6c9fb617-13d3-41e5-9f76-ded22c0f3be9","Type":"ContainerStarted","Data":"33d1227e9663d1ba28e20eb143025ec767a6eadfa421a3e79f5cdef179fd8f7e"}
Jul 21 04:35:53.967674 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:53.967610    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22" podStartSLOduration=1.9609875639999998 podStartE2EDuration="3.967593599s" totalImagesPullingTime="2.006606035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:35:53.966428958 +0000 UTC m=+1903.783995749" watchObservedRunningTime="2026-07-21 04:35:53.967593599 +0000 UTC m=+1903.785160382"
Jul 21 04:35:54.959418 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:54.959382    2576 generic.go:356] "Generic (PLEG): container finished" podID="6c9fb617-13d3-41e5-9f76-ded22c0f3be9" containerID="33d1227e9663d1ba28e20eb143025ec767a6eadfa421a3e79f5cdef179fd8f7e" exitCode=0
Jul 21 04:35:54.959809 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:54.959427    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22" event={"ID":"6c9fb617-13d3-41e5-9f76-ded22c0f3be9","Type":"ContainerDied","Data":"33d1227e9663d1ba28e20eb143025ec767a6eadfa421a3e79f5cdef179fd8f7e"}
Jul 21 04:35:56.099964 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:56.099940    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22"
Jul 21 04:35:56.215544 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:56.215460    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c9fb617-13d3-41e5-9f76-ded22c0f3be9-maas-api-service-ca\") pod \"6c9fb617-13d3-41e5-9f76-ded22c0f3be9\" (UID: \"6c9fb617-13d3-41e5-9f76-ded22c0f3be9\") "
Jul 21 04:35:56.215827 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:56.215806    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c9fb617-13d3-41e5-9f76-ded22c0f3be9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6c9fb617-13d3-41e5-9f76-ded22c0f3be9" (UID: "6c9fb617-13d3-41e5-9f76-ded22c0f3be9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:35:56.316648 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:56.316611    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c9fb617-13d3-41e5-9f76-ded22c0f3be9-maas-api-service-ca\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:35:56.971118 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:56.971044    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22" event={"ID":"6c9fb617-13d3-41e5-9f76-ded22c0f3be9","Type":"ContainerDied","Data":"99f6e764dd01cc6ab3bfa1f0fd8df49e1d612249d4d364ef3b3621b2369e74b7"}
Jul 21 04:35:56.971118 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:56.971068    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22"
Jul 21 04:35:56.971118 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:35:56.971091    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99f6e764dd01cc6ab3bfa1f0fd8df49e1d612249d4d364ef3b3621b2369e74b7"
Jul 21 04:36:04.543540 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:36:04.543498    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:36:06.090754 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:36:06.090721    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22"]
Jul 21 04:36:06.094883 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:36:06.094858    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9c65d45-wrr22"]
Jul 21 04:36:06.665018 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:36:06.664976    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c9fb617-13d3-41e5-9f76-ded22c0f3be9" path="/var/lib/kubelet/pods/6c9fb617-13d3-41e5-9f76-ded22c0f3be9/volumes"
Jul 21 04:36:15.848751 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:36:15.848714    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:36:47.637897 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:36:47.637863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:36:59.251386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:36:59.251346    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:37:18.684937 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:18.684905    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e7463e5-788h9"]
Jul 21 04:37:18.685397 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:18.685253    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c9fb617-13d3-41e5-9f76-ded22c0f3be9" containerName="revoke-keys"
Jul 21 04:37:18.685397 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:18.685268    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c9fb617-13d3-41e5-9f76-ded22c0f3be9" containerName="revoke-keys"
Jul 21 04:37:18.685397 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:18.685355    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c9fb617-13d3-41e5-9f76-ded22c0f3be9" containerName="revoke-keys"
Jul 21 04:37:18.688352 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:18.688332    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e7463e5-788h9"
Jul 21 04:37:18.690906 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:18.690883    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 04:37:18.691165 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:18.690970    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k4z5s\""
Jul 21 04:37:18.696185 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:18.696164    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e7463e5-788h9"]
Jul 21 04:37:18.746097 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:18.746073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5a19863-e6bd-4ac5-9933-6b387016e893-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4e7463e5-788h9\" (UID: \"c5a19863-e6bd-4ac5-9933-6b387016e893\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e7463e5-788h9"
Jul 21 04:37:18.846748 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:18.846718    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5a19863-e6bd-4ac5-9933-6b387016e893-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4e7463e5-788h9\" (UID: \"c5a19863-e6bd-4ac5-9933-6b387016e893\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e7463e5-788h9"
Jul 21 04:37:18.847294 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:18.847275    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5a19863-e6bd-4ac5-9933-6b387016e893-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4e7463e5-788h9\" (UID: \"c5a19863-e6bd-4ac5-9933-6b387016e893\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e7463e5-788h9"
Jul 21 04:37:19.000242 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:19.000173    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e7463e5-788h9"
Jul 21 04:37:19.132357 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:19.132330    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e7463e5-788h9"]
Jul 21 04:37:19.134319 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:37:19.134294    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5a19863_e6bd_4ac5_9933_6b387016e893.slice/crio-ccd1500689d8c7a87041522bf1090b4cc8078f734dae0b4c55328b4e71f5fa2c WatchSource:0}: Error finding container ccd1500689d8c7a87041522bf1090b4cc8078f734dae0b4c55328b4e71f5fa2c: Status 404 returned error can't find the container with id ccd1500689d8c7a87041522bf1090b4cc8078f734dae0b4c55328b4e71f5fa2c
Jul 21 04:37:19.390691 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:19.390633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e7463e5-788h9" event={"ID":"c5a19863-e6bd-4ac5-9933-6b387016e893","Type":"ContainerStarted","Data":"ccd1500689d8c7a87041522bf1090b4cc8078f734dae0b4c55328b4e71f5fa2c"}
Jul 21 04:37:20.397148 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:20.397116    2576 generic.go:356] "Generic (PLEG): container finished" podID="c5a19863-e6bd-4ac5-9933-6b387016e893" containerID="0411e366d9374486f842d4497b501e6201ad47400f15a179d11ae21519d0f9a1" exitCode=0
Jul 21 04:37:20.397488 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:20.397153    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e7463e5-788h9" event={"ID":"c5a19863-e6bd-4ac5-9933-6b387016e893","Type":"ContainerDied","Data":"0411e366d9374486f842d4497b501e6201ad47400f15a179d11ae21519d0f9a1"}
Jul 21 04:37:21.530112 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:21.530084    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e7463e5-788h9"
Jul 21 04:37:21.672577 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:21.672482    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5a19863-e6bd-4ac5-9933-6b387016e893-maas-api-service-ca\") pod \"c5a19863-e6bd-4ac5-9933-6b387016e893\" (UID: \"c5a19863-e6bd-4ac5-9933-6b387016e893\") "
Jul 21 04:37:21.672911 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:21.672890    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5a19863-e6bd-4ac5-9933-6b387016e893-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c5a19863-e6bd-4ac5-9933-6b387016e893" (UID: "c5a19863-e6bd-4ac5-9933-6b387016e893"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:37:21.773404 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:21.773370    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5a19863-e6bd-4ac5-9933-6b387016e893-maas-api-service-ca\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:37:22.408336 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:22.408308    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e7463e5-788h9"
Jul 21 04:37:22.408504 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:22.408340    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e7463e5-788h9" event={"ID":"c5a19863-e6bd-4ac5-9933-6b387016e893","Type":"ContainerDied","Data":"ccd1500689d8c7a87041522bf1090b4cc8078f734dae0b4c55328b4e71f5fa2c"}
Jul 21 04:37:22.408504 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:22.408390    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccd1500689d8c7a87041522bf1090b4cc8078f734dae0b4c55328b4e71f5fa2c"
Jul 21 04:37:32.254225 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:32.254188    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:37:33.797043 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:33.797006    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e7463e5-788h9"]
Jul 21 04:37:33.800060 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:33.800032    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e7463e5-788h9"]
Jul 21 04:37:34.664341 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:34.664308    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5a19863-e6bd-4ac5-9933-6b387016e893" path="/var/lib/kubelet/pods/c5a19863-e6bd-4ac5-9933-6b387016e893/volumes"
Jul 21 04:37:43.354405 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:37:43.354367    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:38:17.584043 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:38:17.584010    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:39:12.421863 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:39:12.421730    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:39:12.430029 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:39:12.430010    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:39:51.144291 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:39:51.144252    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:40:00.647948 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:00.647912    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:40:13.157135 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:13.157057    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:40:20.269541 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:20.269507    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7"]
Jul 21 04:40:20.270004 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:20.269944    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5a19863-e6bd-4ac5-9933-6b387016e893" containerName="revoke-keys"
Jul 21 04:40:20.270004 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:20.269961    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5a19863-e6bd-4ac5-9933-6b387016e893" containerName="revoke-keys"
Jul 21 04:40:20.270076 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:20.270041    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5a19863-e6bd-4ac5-9933-6b387016e893" containerName="revoke-keys"
Jul 21 04:40:20.273156 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:20.273138    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7"
Jul 21 04:40:20.275513 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:20.275488    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 04:40:20.275684 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:20.275536    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k4z5s\""
Jul 21 04:40:20.281347 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:20.281323    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7"]
Jul 21 04:40:20.405377 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:20.405348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a74cc5b-12ac-4970-aa2d-57292c9317a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7\" (UID: \"8a74cc5b-12ac-4970-aa2d-57292c9317a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7"
Jul 21 04:40:20.505783 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:20.505754    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a74cc5b-12ac-4970-aa2d-57292c9317a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7\" (UID: \"8a74cc5b-12ac-4970-aa2d-57292c9317a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7"
Jul 21 04:40:20.506396 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:20.506375    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a74cc5b-12ac-4970-aa2d-57292c9317a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7\" (UID: \"8a74cc5b-12ac-4970-aa2d-57292c9317a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7"
Jul 21 04:40:20.584629 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:20.584609    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7"
Jul 21 04:40:20.713706 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:20.713681    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7"]
Jul 21 04:40:20.715958 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:40:20.715934    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a74cc5b_12ac_4970_aa2d_57292c9317a4.slice/crio-682502b8dcbf7ecd4b8210f97af74f2b63be281ac16bbefcd984fae08d0fdb24 WatchSource:0}: Error finding container 682502b8dcbf7ecd4b8210f97af74f2b63be281ac16bbefcd984fae08d0fdb24: Status 404 returned error can't find the container with id 682502b8dcbf7ecd4b8210f97af74f2b63be281ac16bbefcd984fae08d0fdb24
Jul 21 04:40:21.364501 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:21.364460    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7" event={"ID":"8a74cc5b-12ac-4970-aa2d-57292c9317a4","Type":"ContainerStarted","Data":"b0ea807e7240fa4853cc4f3778a9eef488568ca6e643beab04710e769091b910"}
Jul 21 04:40:21.364901 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:21.364521    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7" event={"ID":"8a74cc5b-12ac-4970-aa2d-57292c9317a4","Type":"ContainerStarted","Data":"682502b8dcbf7ecd4b8210f97af74f2b63be281ac16bbefcd984fae08d0fdb24"}
Jul 21 04:40:21.382156 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:21.382110    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7" podStartSLOduration=1.382094104 podStartE2EDuration="1.382094104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:40:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:40:21.380687448 +0000 UTC m=+2171.198254233" watchObservedRunningTime="2026-07-21 04:40:21.382094104 +0000 UTC m=+2171.199660914"
Jul 21 04:40:22.372189 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:22.372151    2576 generic.go:356] "Generic (PLEG): container finished" podID="8a74cc5b-12ac-4970-aa2d-57292c9317a4" containerID="b0ea807e7240fa4853cc4f3778a9eef488568ca6e643beab04710e769091b910" exitCode=0
Jul 21 04:40:22.372613 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:22.372216    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7" event={"ID":"8a74cc5b-12ac-4970-aa2d-57292c9317a4","Type":"ContainerDied","Data":"b0ea807e7240fa4853cc4f3778a9eef488568ca6e643beab04710e769091b910"}
Jul 21 04:40:23.512139 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:23.512117    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7"
Jul 21 04:40:23.631467 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:23.631384    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a74cc5b-12ac-4970-aa2d-57292c9317a4-maas-api-service-ca\") pod \"8a74cc5b-12ac-4970-aa2d-57292c9317a4\" (UID: \"8a74cc5b-12ac-4970-aa2d-57292c9317a4\") "
Jul 21 04:40:23.631742 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:23.631719    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a74cc5b-12ac-4970-aa2d-57292c9317a4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a74cc5b-12ac-4970-aa2d-57292c9317a4" (UID: "8a74cc5b-12ac-4970-aa2d-57292c9317a4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:40:23.732240 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:23.732207    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a74cc5b-12ac-4970-aa2d-57292c9317a4-maas-api-service-ca\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:40:24.384236 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:24.384210    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7"
Jul 21 04:40:24.384236 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:24.384217    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7" event={"ID":"8a74cc5b-12ac-4970-aa2d-57292c9317a4","Type":"ContainerDied","Data":"682502b8dcbf7ecd4b8210f97af74f2b63be281ac16bbefcd984fae08d0fdb24"}
Jul 21 04:40:24.384446 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:24.384259    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="682502b8dcbf7ecd4b8210f97af74f2b63be281ac16bbefcd984fae08d0fdb24"
Jul 21 04:40:33.740658 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:33.740601    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:40:35.347827 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:35.347795    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7"]
Jul 21 04:40:35.349843 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:35.349820    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-70ff50f3-g9nd7"]
Jul 21 04:40:36.664622 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:40:36.664587    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a74cc5b-12ac-4970-aa2d-57292c9317a4" path="/var/lib/kubelet/pods/8a74cc5b-12ac-4970-aa2d-57292c9317a4/volumes"
Jul 21 04:41:08.939925 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:08.939894    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:41:23.248740 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.248701    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"]
Jul 21 04:41:23.249235 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.249218    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a74cc5b-12ac-4970-aa2d-57292c9317a4" containerName="revoke-keys"
Jul 21 04:41:23.249282 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.249238    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a74cc5b-12ac-4970-aa2d-57292c9317a4" containerName="revoke-keys"
Jul 21 04:41:23.249360 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.249349    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a74cc5b-12ac-4970-aa2d-57292c9317a4" containerName="revoke-keys"
Jul 21 04:41:23.252836 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.252819    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.255561 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.255526    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3a722384\"/\"openshift-service-ca.crt\""
Jul 21 04:41:23.255722 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.255577    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3a722384\"/\"kube-root-ca.crt\""
Jul 21 04:41:23.256295 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.256274    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3a722384\"/\"default-dockercfg-ws82n\""
Jul 21 04:41:23.256403 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.256318    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3a722384\"/\"e2e-lifecycle-model-3a722384-kserve-self-signed-certs\""
Jul 21 04:41:23.261141 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.261118    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"]
Jul 21 04:41:23.408994 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.408960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-tmp-dir\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.409164 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.409003    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-dshm\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.409164 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.409086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-model-cache\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.409257 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.409156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm4f4\" (UniqueName: \"kubernetes.io/projected/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-kube-api-access-fm4f4\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.409257 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.409190    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-home\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.409257 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.409211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-tls-certs\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.510434 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.510360    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-dshm\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.510434 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.510431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-model-cache\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.510621 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.510459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm4f4\" (UniqueName: \"kubernetes.io/projected/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-kube-api-access-fm4f4\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.510621 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.510487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-home\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.510621 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.510513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-tls-certs\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.510621 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.510550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-tmp-dir\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.510914 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.510894    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-tmp-dir\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.510981 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.510934    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-home\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.511027 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.510983    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-model-cache\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.512828 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.512810    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-dshm\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.513225 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.513201    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-tls-certs\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.518878 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.518857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm4f4\" (UniqueName: \"kubernetes.io/projected/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-kube-api-access-fm4f4\") pod \"e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") " pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.564654 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.564614    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:23.698851 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:23.698827    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"]
Jul 21 04:41:23.701351 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:41:23.701323    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c42ba43_ba43_47a3_85b7_7a07e8b105f4.slice/crio-fc179e557a6e96e03266a81b7d781de72e88f377230e219711ef1e6ab6fa9acb WatchSource:0}: Error finding container fc179e557a6e96e03266a81b7d781de72e88f377230e219711ef1e6ab6fa9acb: Status 404 returned error can't find the container with id fc179e557a6e96e03266a81b7d781de72e88f377230e219711ef1e6ab6fa9acb
Jul 21 04:41:24.709878 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:24.709841    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k" event={"ID":"6c42ba43-ba43-47a3-85b7-7a07e8b105f4","Type":"ContainerStarted","Data":"3fd3b345c67f08de04fcddb0e03f7951642da32779374eb0ea4d7da3286fb1c3"}
Jul 21 04:41:24.709878 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:24.709889    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k" event={"ID":"6c42ba43-ba43-47a3-85b7-7a07e8b105f4","Type":"ContainerStarted","Data":"fc179e557a6e96e03266a81b7d781de72e88f377230e219711ef1e6ab6fa9acb"}
Jul 21 04:41:24.728156 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:24.728112    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k" podStartSLOduration=1.7280982790000001 podStartE2EDuration="1.728098279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:41:24.726003242 +0000 UTC m=+2234.543570039" watchObservedRunningTime="2026-07-21 04:41:24.728098279 +0000 UTC m=+2234.545665062"
Jul 21 04:41:26.544765 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:26.544723    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:41:33.565355 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:33.565263    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:33.565355 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:33.565325    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:33.577790 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:33.577766    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:33.769951 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:33.769924    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:41:44.842531 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:41:44.842495    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:42:01.650192 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:01.650151    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:42:10.142262 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:10.142223    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:42:10.850198 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:10.850168    2576 scope.go:117] "RemoveContainer" containerID="33d1227e9663d1ba28e20eb143025ec767a6eadfa421a3e79f5cdef179fd8f7e"
Jul 21 04:42:15.094989 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:15.094950    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"]
Jul 21 04:42:30.116311 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.116274    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k" podUID="6c42ba43-ba43-47a3-85b7-7a07e8b105f4" containerName="main" containerID="cri-o://3fd3b345c67f08de04fcddb0e03f7951642da32779374eb0ea4d7da3286fb1c3" gracePeriod=45
Jul 21 04:42:30.362293 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.362265    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:42:30.374119 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.373964    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-model-cache\") pod \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") "
Jul 21 04:42:30.374119 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.374093    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-dshm\") pod \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") "
Jul 21 04:42:30.374299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.374144    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-tls-certs\") pod \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") "
Jul 21 04:42:30.374299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.374212    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm4f4\" (UniqueName: \"kubernetes.io/projected/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-kube-api-access-fm4f4\") pod \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") "
Jul 21 04:42:30.374625 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.374513    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-model-cache" (OuterVolumeSpecName: "model-cache") pod "6c42ba43-ba43-47a3-85b7-7a07e8b105f4" (UID: "6c42ba43-ba43-47a3-85b7-7a07e8b105f4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:42:30.375176 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.374902    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-model-cache\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:42:30.376957 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.376863    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-dshm" (OuterVolumeSpecName: "dshm") pod "6c42ba43-ba43-47a3-85b7-7a07e8b105f4" (UID: "6c42ba43-ba43-47a3-85b7-7a07e8b105f4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:42:30.378368 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.377243    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6c42ba43-ba43-47a3-85b7-7a07e8b105f4" (UID: "6c42ba43-ba43-47a3-85b7-7a07e8b105f4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:42:30.385903 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.385240    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-kube-api-access-fm4f4" (OuterVolumeSpecName: "kube-api-access-fm4f4") pod "6c42ba43-ba43-47a3-85b7-7a07e8b105f4" (UID: "6c42ba43-ba43-47a3-85b7-7a07e8b105f4"). InnerVolumeSpecName "kube-api-access-fm4f4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:42:30.475775 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.475738    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-tmp-dir\") pod \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") "
Jul 21 04:42:30.475775 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.475780    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-home\") pod \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\" (UID: \"6c42ba43-ba43-47a3-85b7-7a07e8b105f4\") "
Jul 21 04:42:30.476015 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.476003    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-dshm\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:42:30.476015 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.475990    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6c42ba43-ba43-47a3-85b7-7a07e8b105f4" (UID: "6c42ba43-ba43-47a3-85b7-7a07e8b105f4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:42:30.476089 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.476018    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-tls-certs\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:42:30.476089 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.476029    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm4f4\" (UniqueName: \"kubernetes.io/projected/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-kube-api-access-fm4f4\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:42:30.476089 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.476036    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-home" (OuterVolumeSpecName: "home") pod "6c42ba43-ba43-47a3-85b7-7a07e8b105f4" (UID: "6c42ba43-ba43-47a3-85b7-7a07e8b105f4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:42:30.577347 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.577324    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-tmp-dir\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:42:30.577347 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:30.577344    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c42ba43-ba43-47a3-85b7-7a07e8b105f4-home\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:42:31.066172 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:31.066085    2576 generic.go:356] "Generic (PLEG): container finished" podID="6c42ba43-ba43-47a3-85b7-7a07e8b105f4" containerID="3fd3b345c67f08de04fcddb0e03f7951642da32779374eb0ea4d7da3286fb1c3" exitCode=0
Jul 21 04:42:31.066172 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:31.066140    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"
Jul 21 04:42:31.066375 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:31.066170    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k" event={"ID":"6c42ba43-ba43-47a3-85b7-7a07e8b105f4","Type":"ContainerDied","Data":"3fd3b345c67f08de04fcddb0e03f7951642da32779374eb0ea4d7da3286fb1c3"}
Jul 21 04:42:31.066375 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:31.066213    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k" event={"ID":"6c42ba43-ba43-47a3-85b7-7a07e8b105f4","Type":"ContainerDied","Data":"fc179e557a6e96e03266a81b7d781de72e88f377230e219711ef1e6ab6fa9acb"}
Jul 21 04:42:31.066375 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:31.066231    2576 scope.go:117] "RemoveContainer" containerID="3fd3b345c67f08de04fcddb0e03f7951642da32779374eb0ea4d7da3286fb1c3"
Jul 21 04:42:31.074944 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:31.074927    2576 scope.go:117] "RemoveContainer" containerID="3fd3b345c67f08de04fcddb0e03f7951642da32779374eb0ea4d7da3286fb1c3"
Jul 21 04:42:31.075190 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:42:31.075173    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fd3b345c67f08de04fcddb0e03f7951642da32779374eb0ea4d7da3286fb1c3\": container with ID starting with 3fd3b345c67f08de04fcddb0e03f7951642da32779374eb0ea4d7da3286fb1c3 not found: ID does not exist" containerID="3fd3b345c67f08de04fcddb0e03f7951642da32779374eb0ea4d7da3286fb1c3"
Jul 21 04:42:31.075232 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:31.075199    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fd3b345c67f08de04fcddb0e03f7951642da32779374eb0ea4d7da3286fb1c3"} err="failed to get container status \"3fd3b345c67f08de04fcddb0e03f7951642da32779374eb0ea4d7da3286fb1c3\": rpc error: code = NotFound desc = could not find container \"3fd3b345c67f08de04fcddb0e03f7951642da32779374eb0ea4d7da3286fb1c3\": container with ID starting with 3fd3b345c67f08de04fcddb0e03f7951642da32779374eb0ea4d7da3286fb1c3 not found: ID does not exist"
Jul 21 04:42:31.083317 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:31.083296    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"]
Jul 21 04:42:31.087527 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:31.087507    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-3a722384/e2e-lifecycle-model-3a722384-kserve-6f4cb74d75-5wz9k"]
Jul 21 04:42:32.664574 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:42:32.664531    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c42ba43-ba43-47a3-85b7-7a07e8b105f4" path="/var/lib/kubelet/pods/6c42ba43-ba43-47a3-85b7-7a07e8b105f4/volumes"
Jul 21 04:43:17.058983 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:43:17.058947    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:43:29.652416 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:43:29.652370    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:44:10.884104 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:10.884067    2576 scope.go:117] "RemoveContainer" containerID="0411e366d9374486f842d4497b501e6201ad47400f15a179d11ae21519d0f9a1"
Jul 21 04:44:12.464038 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:12.463918    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:44:12.472250 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:12.472230    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:44:19.242536 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:19.242502    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:44:32.243213 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:32.243133    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:44:40.349308 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.349277    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"]
Jul 21 04:44:40.349759 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.349630    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c42ba43-ba43-47a3-85b7-7a07e8b105f4" containerName="main"
Jul 21 04:44:40.349759 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.349660    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c42ba43-ba43-47a3-85b7-7a07e8b105f4" containerName="main"
Jul 21 04:44:40.349759 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.349741    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c42ba43-ba43-47a3-85b7-7a07e8b105f4" containerName="main"
Jul 21 04:44:40.352885 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.352869    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.355285 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.355262    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-628b16\"/\"openshift-service-ca.crt\""
Jul 21 04:44:40.356052 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.356031    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-628b16\"/\"default-dockercfg-b6xsv\""
Jul 21 04:44:40.356148 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.356127    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-628b16\"/\"kube-root-ca.crt\""
Jul 21 04:44:40.356192 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.356179    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-628b16\"/\"test-model-628b16-kserve-self-signed-certs\""
Jul 21 04:44:40.363999 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.363975    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"]
Jul 21 04:44:40.427515 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.427481    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-tmp-dir\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.427515 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.427517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-home\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.427765 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.427535    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs72c\" (UniqueName: \"kubernetes.io/projected/83214843-8092-43cc-a024-4fee4b3ee0f3-kube-api-access-zs72c\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.427765 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.427605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83214843-8092-43cc-a024-4fee4b3ee0f3-tls-certs\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.427765 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.427688    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-dshm\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.427765 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.427720    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-model-cache\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.528590 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.528555    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-model-cache\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.528775 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.528620    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-tmp-dir\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.528775 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.528658    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-home\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.528775 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.528675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs72c\" (UniqueName: \"kubernetes.io/projected/83214843-8092-43cc-a024-4fee4b3ee0f3-kube-api-access-zs72c\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.528941 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.528849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83214843-8092-43cc-a024-4fee4b3ee0f3-tls-certs\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.528941 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.528924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-dshm\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.529042 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.528978    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-model-cache\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.529042 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.529023    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-tmp-dir\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.529147 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.529052    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-home\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.531341 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.531313    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-dshm\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.531480 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.531464    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83214843-8092-43cc-a024-4fee4b3ee0f3-tls-certs\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.537178 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.537159    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs72c\" (UniqueName: \"kubernetes.io/projected/83214843-8092-43cc-a024-4fee4b3ee0f3-kube-api-access-zs72c\") pod \"test-model-628b16-kserve-c5979c859-cpxhm\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") " pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.662818 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.662729    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:40.796018 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:40.795992    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"]
Jul 21 04:44:40.797809 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:44:40.797780    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83214843_8092_43cc_a024_4fee4b3ee0f3.slice/crio-2f50af4328dc93dd8c81167b5d462cf47791f78ad23f639ffa0732f9c0b514ab WatchSource:0}: Error finding container 2f50af4328dc93dd8c81167b5d462cf47791f78ad23f639ffa0732f9c0b514ab: Status 404 returned error can't find the container with id 2f50af4328dc93dd8c81167b5d462cf47791f78ad23f639ffa0732f9c0b514ab
Jul 21 04:44:41.763983 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:41.763946    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm" event={"ID":"83214843-8092-43cc-a024-4fee4b3ee0f3","Type":"ContainerStarted","Data":"a4f9246a732f8aaa8b8176e60df9b7ab63dda3ca656c55541307ac0bf84adc0e"}
Jul 21 04:44:41.763983 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:41.763992    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm" event={"ID":"83214843-8092-43cc-a024-4fee4b3ee0f3","Type":"ContainerStarted","Data":"2f50af4328dc93dd8c81167b5d462cf47791f78ad23f639ffa0732f9c0b514ab"}
Jul 21 04:44:41.783139 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:41.783083    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm" podStartSLOduration=1.783066789 podStartE2EDuration="1.783066789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:44:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:44:41.782478467 +0000 UTC m=+2431.600045252" watchObservedRunningTime="2026-07-21 04:44:41.783066789 +0000 UTC m=+2431.600633572"
Jul 21 04:44:46.046218 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:46.046182    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:44:50.664790 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:50.664751    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:50.665159 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:50.664809    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:50.676179 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:50.676155    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:50.823301 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:50.823267    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:44:57.152656 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:44:57.152604    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:45:00.142241 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.142198    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-628b16-29743485-d99c2"]
Jul 21 04:45:00.145742 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.145716    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c8ed6c-29743485-pcgpn"]
Jul 21 04:45:00.145896 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.145848    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-628b16-29743485-d99c2"
Jul 21 04:45:00.149170 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.149146    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k4z5s\""
Jul 21 04:45:00.151801 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.151774    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-628b16-29743485-d99c2"]
Jul 21 04:45:00.151927 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.151883    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c8ed6c-29743485-pcgpn"
Jul 21 04:45:00.153929 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.153902    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c8ed6c-29743485-pcgpn"]
Jul 21 04:45:00.161204 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.160864    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-628b16-29743485-d99c2"
Jul 21 04:45:00.170068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.170046    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c8ed6c-29743485-pcgpn"
Jul 21 04:45:00.327354 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.327310    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-628b16-29743485-d99c2"]
Jul 21 04:45:00.330591 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:45:00.330555    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc82fbd8_cc59_4ea6_b162_967d01bb273d.slice/crio-ff3d840d91ab336adefd05551dd1a2e17f248f0a7125048807cf31e867f03d06 WatchSource:0}: Error finding container ff3d840d91ab336adefd05551dd1a2e17f248f0a7125048807cf31e867f03d06: Status 404 returned error can't find the container with id ff3d840d91ab336adefd05551dd1a2e17f248f0a7125048807cf31e867f03d06
Jul 21 04:45:00.361794 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.361760    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c8ed6c-29743485-pcgpn"]
Jul 21 04:45:00.365420 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:45:00.365385    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f30615_2fee_4a5a_a84a_444a57be11e3.slice/crio-fb8d398abda8388c6df1bb5867f1fdaa2c572d31f28928669ea8f6ec383e5a34 WatchSource:0}: Error finding container fb8d398abda8388c6df1bb5867f1fdaa2c572d31f28928669ea8f6ec383e5a34: Status 404 returned error can't find the container with id fb8d398abda8388c6df1bb5867f1fdaa2c572d31f28928669ea8f6ec383e5a34
Jul 21 04:45:00.873782 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.873746    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c8ed6c-29743485-pcgpn" event={"ID":"51f30615-2fee-4a5a-a84a-444a57be11e3","Type":"ContainerStarted","Data":"363f4c94868d8843125ae0e77641e58a128e3f72b4d6f50687be414ae49a74fe"}
Jul 21 04:45:00.874002 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.873812    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c8ed6c-29743485-pcgpn" event={"ID":"51f30615-2fee-4a5a-a84a-444a57be11e3","Type":"ContainerStarted","Data":"fb8d398abda8388c6df1bb5867f1fdaa2c572d31f28928669ea8f6ec383e5a34"}
Jul 21 04:45:00.875361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.875337    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-628b16-29743485-d99c2" event={"ID":"cc82fbd8-cc59-4ea6-b162-967d01bb273d","Type":"ContainerStarted","Data":"6518698382d52f61b95ed8a71b4537b6f033042b109859241ff99346f9f26053"}
Jul 21 04:45:00.875479 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.875384    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-628b16-29743485-d99c2" event={"ID":"cc82fbd8-cc59-4ea6-b162-967d01bb273d","Type":"ContainerStarted","Data":"ff3d840d91ab336adefd05551dd1a2e17f248f0a7125048807cf31e867f03d06"}
Jul 21 04:45:00.889165 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.889120    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c8ed6c-29743485-pcgpn" podStartSLOduration=0.889106896 podStartE2EDuration="889.106896ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:45:00.887981202 +0000 UTC m=+2450.705547996" watchObservedRunningTime="2026-07-21 04:45:00.889106896 +0000 UTC m=+2450.706673704"
Jul 21 04:45:00.905060 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:00.905005    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-628b16-29743485-d99c2" podStartSLOduration=0.904990961 podStartE2EDuration="904.990961ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:45:00.902619388 +0000 UTC m=+2450.720186181" watchObservedRunningTime="2026-07-21 04:45:00.904990961 +0000 UTC m=+2450.722557745"
Jul 21 04:45:01.530362 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.530278    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"]
Jul 21 04:45:01.533705 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.533689    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.535940 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.535920    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c8ed6c\"/\"openshift-service-ca.crt\""
Jul 21 04:45:01.536067 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.535974    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c8ed6c\"/\"default-dockercfg-k9tmc\""
Jul 21 04:45:01.536834 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.536816    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c8ed6c\"/\"kube-root-ca.crt\""
Jul 21 04:45:01.536928 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.536831    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c8ed6c\"/\"test-model-c8ed6c-kserve-self-signed-certs\""
Jul 21 04:45:01.544160 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.544137    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"]
Jul 21 04:45:01.605008 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.604974    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-dshm\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.605213 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.605021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffbfb435-2417-4196-814b-8b3937a72db2-tls-certs\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.605213 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.605152    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-home\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.605213 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.605191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c269\" (UniqueName: \"kubernetes.io/projected/ffbfb435-2417-4196-814b-8b3937a72db2-kube-api-access-2c269\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.605377 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.605236    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-tmp-dir\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.605377 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.605272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-model-cache\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.706752 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.706713    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-home\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.706752 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.706753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c269\" (UniqueName: \"kubernetes.io/projected/ffbfb435-2417-4196-814b-8b3937a72db2-kube-api-access-2c269\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.707013 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.706782    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-tmp-dir\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.707013 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.706967    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-model-cache\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.707138 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.707010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-dshm\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.707138 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.707060    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffbfb435-2417-4196-814b-8b3937a72db2-tls-certs\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.707231 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.707164    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-tmp-dir\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.707231 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.707205    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-home\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.707302 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.707269    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-model-cache\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.709540 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.709517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-dshm\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.709772 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.709757    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffbfb435-2417-4196-814b-8b3937a72db2-tls-certs\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.714448 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.714429    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c269\" (UniqueName: \"kubernetes.io/projected/ffbfb435-2417-4196-814b-8b3937a72db2-kube-api-access-2c269\") pod \"test-model-c8ed6c-kserve-6695759675-pgx5j\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") " pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.843871 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.843835    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:01.882573 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.882540    2576 generic.go:356] "Generic (PLEG): container finished" podID="51f30615-2fee-4a5a-a84a-444a57be11e3" containerID="363f4c94868d8843125ae0e77641e58a128e3f72b4d6f50687be414ae49a74fe" exitCode=0
Jul 21 04:45:01.882750 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.882612    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c8ed6c-29743485-pcgpn" event={"ID":"51f30615-2fee-4a5a-a84a-444a57be11e3","Type":"ContainerDied","Data":"363f4c94868d8843125ae0e77641e58a128e3f72b4d6f50687be414ae49a74fe"}
Jul 21 04:45:01.884328 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.884297    2576 generic.go:356] "Generic (PLEG): container finished" podID="cc82fbd8-cc59-4ea6-b162-967d01bb273d" containerID="6518698382d52f61b95ed8a71b4537b6f033042b109859241ff99346f9f26053" exitCode=0
Jul 21 04:45:01.884434 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.884369    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-628b16-29743485-d99c2" event={"ID":"cc82fbd8-cc59-4ea6-b162-967d01bb273d","Type":"ContainerDied","Data":"6518698382d52f61b95ed8a71b4537b6f033042b109859241ff99346f9f26053"}
Jul 21 04:45:01.990259 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:01.990224    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"]
Jul 21 04:45:01.991270 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:45:01.991243    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffbfb435_2417_4196_814b_8b3937a72db2.slice/crio-c201c3068c563767a803a390677df6a5e11d3d01f61ec5bb68a322d12a66d53d WatchSource:0}: Error finding container c201c3068c563767a803a390677df6a5e11d3d01f61ec5bb68a322d12a66d53d: Status 404 returned error can't find the container with id c201c3068c563767a803a390677df6a5e11d3d01f61ec5bb68a322d12a66d53d
Jul 21 04:45:02.892059 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:02.892024    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j" event={"ID":"ffbfb435-2417-4196-814b-8b3937a72db2","Type":"ContainerStarted","Data":"ad5fb918f95e2ab27056868ce4af09fcbe870e4de055c9e84f2fe0d000351ee5"}
Jul 21 04:45:02.892059 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:02.892062    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j" event={"ID":"ffbfb435-2417-4196-814b-8b3937a72db2","Type":"ContainerStarted","Data":"c201c3068c563767a803a390677df6a5e11d3d01f61ec5bb68a322d12a66d53d"}
Jul 21 04:45:02.911137 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:02.911087    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j" podStartSLOduration=1.9110690099999998 podStartE2EDuration="1.91106901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:45:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:45:02.910194974 +0000 UTC m=+2452.727761758" watchObservedRunningTime="2026-07-21 04:45:02.91106901 +0000 UTC m=+2452.728635793"
Jul 21 04:45:03.033435 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:03.033414    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-628b16-29743485-d99c2"
Jul 21 04:45:03.036423 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:03.036405    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c8ed6c-29743485-pcgpn"
Jul 21 04:45:03.897940 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:03.897912    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c8ed6c-29743485-pcgpn"
Jul 21 04:45:03.898353 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:03.897911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c8ed6c-29743485-pcgpn" event={"ID":"51f30615-2fee-4a5a-a84a-444a57be11e3","Type":"ContainerDied","Data":"fb8d398abda8388c6df1bb5867f1fdaa2c572d31f28928669ea8f6ec383e5a34"}
Jul 21 04:45:03.898353 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:03.898031    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb8d398abda8388c6df1bb5867f1fdaa2c572d31f28928669ea8f6ec383e5a34"
Jul 21 04:45:03.899159 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:03.899140    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-628b16-29743485-d99c2"
Jul 21 04:45:03.899271 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:03.899177    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-628b16-29743485-d99c2" event={"ID":"cc82fbd8-cc59-4ea6-b162-967d01bb273d","Type":"ContainerDied","Data":"ff3d840d91ab336adefd05551dd1a2e17f248f0a7125048807cf31e867f03d06"}
Jul 21 04:45:03.899271 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:03.899217    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff3d840d91ab336adefd05551dd1a2e17f248f0a7125048807cf31e867f03d06"
Jul 21 04:45:10.346550 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:10.346512    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:45:11.844226 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:11.844184    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:11.844709 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:11.844238    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:11.856908 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:11.856882    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:11.954755 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:11.954731    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:45:43.778046 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:43.778000    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"]
Jul 21 04:45:44.732870 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:44.732837    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"]
Jul 21 04:45:46.857180 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:46.857138    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:45:55.335695 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:55.335631    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-628b16-29743485-d99c2"]
Jul 21 04:45:55.341873 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:55.341847    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-628b16-29743485-d99c2"]
Jul 21 04:45:56.664453 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:56.664417    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc82fbd8-cc59-4ea6-b162-967d01bb273d" path="/var/lib/kubelet/pods/cc82fbd8-cc59-4ea6-b162-967d01bb273d/volumes"
Jul 21 04:45:58.150978 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:58.150942    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:45:58.798308 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:58.798250    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm" podUID="83214843-8092-43cc-a024-4fee4b3ee0f3" containerName="main" containerID="cri-o://a4f9246a732f8aaa8b8176e60df9b7ab63dda3ca656c55541307ac0bf84adc0e" gracePeriod=45
Jul 21 04:45:59.051844 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.051786    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:45:59.087537 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.087512    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-model-cache\") pod \"83214843-8092-43cc-a024-4fee4b3ee0f3\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") "
Jul 21 04:45:59.087692 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.087549    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83214843-8092-43cc-a024-4fee4b3ee0f3-tls-certs\") pod \"83214843-8092-43cc-a024-4fee4b3ee0f3\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") "
Jul 21 04:45:59.087692 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.087602    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-home\") pod \"83214843-8092-43cc-a024-4fee4b3ee0f3\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") "
Jul 21 04:45:59.087692 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.087625    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zs72c\" (UniqueName: \"kubernetes.io/projected/83214843-8092-43cc-a024-4fee4b3ee0f3-kube-api-access-zs72c\") pod \"83214843-8092-43cc-a024-4fee4b3ee0f3\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") "
Jul 21 04:45:59.087692 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.087679    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-dshm\") pod \"83214843-8092-43cc-a024-4fee4b3ee0f3\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") "
Jul 21 04:45:59.087914 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.087728    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-tmp-dir\") pod \"83214843-8092-43cc-a024-4fee4b3ee0f3\" (UID: \"83214843-8092-43cc-a024-4fee4b3ee0f3\") "
Jul 21 04:45:59.087914 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.087808    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "83214843-8092-43cc-a024-4fee4b3ee0f3" (UID: "83214843-8092-43cc-a024-4fee4b3ee0f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:45:59.088023 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.087939    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-home" (OuterVolumeSpecName: "home") pod "83214843-8092-43cc-a024-4fee4b3ee0f3" (UID: "83214843-8092-43cc-a024-4fee4b3ee0f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:45:59.088023 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.088011    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "83214843-8092-43cc-a024-4fee4b3ee0f3" (UID: "83214843-8092-43cc-a024-4fee4b3ee0f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:45:59.088120 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.088061    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-model-cache\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:45:59.088120 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.088079    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-home\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:45:59.090071 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.090041    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-dshm" (OuterVolumeSpecName: "dshm") pod "83214843-8092-43cc-a024-4fee4b3ee0f3" (UID: "83214843-8092-43cc-a024-4fee4b3ee0f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:45:59.090177 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.090094    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83214843-8092-43cc-a024-4fee4b3ee0f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "83214843-8092-43cc-a024-4fee4b3ee0f3" (UID: "83214843-8092-43cc-a024-4fee4b3ee0f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:45:59.090381 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.090363    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83214843-8092-43cc-a024-4fee4b3ee0f3-kube-api-access-zs72c" (OuterVolumeSpecName: "kube-api-access-zs72c") pod "83214843-8092-43cc-a024-4fee4b3ee0f3" (UID: "83214843-8092-43cc-a024-4fee4b3ee0f3"). InnerVolumeSpecName "kube-api-access-zs72c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:45:59.188601 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.188572    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs72c\" (UniqueName: \"kubernetes.io/projected/83214843-8092-43cc-a024-4fee4b3ee0f3-kube-api-access-zs72c\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:45:59.188930 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.188603    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-dshm\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:45:59.188930 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.188615    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83214843-8092-43cc-a024-4fee4b3ee0f3-tmp-dir\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:45:59.188930 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.188626    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83214843-8092-43cc-a024-4fee4b3ee0f3-tls-certs\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:45:59.193942 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.193916    2576 generic.go:356] "Generic (PLEG): container finished" podID="83214843-8092-43cc-a024-4fee4b3ee0f3" containerID="a4f9246a732f8aaa8b8176e60df9b7ab63dda3ca656c55541307ac0bf84adc0e" exitCode=0
Jul 21 04:45:59.194021 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.193961    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"
Jul 21 04:45:59.194021 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.194001    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm" event={"ID":"83214843-8092-43cc-a024-4fee4b3ee0f3","Type":"ContainerDied","Data":"a4f9246a732f8aaa8b8176e60df9b7ab63dda3ca656c55541307ac0bf84adc0e"}
Jul 21 04:45:59.194087 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.194042    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm" event={"ID":"83214843-8092-43cc-a024-4fee4b3ee0f3","Type":"ContainerDied","Data":"2f50af4328dc93dd8c81167b5d462cf47791f78ad23f639ffa0732f9c0b514ab"}
Jul 21 04:45:59.194087 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.194060    2576 scope.go:117] "RemoveContainer" containerID="a4f9246a732f8aaa8b8176e60df9b7ab63dda3ca656c55541307ac0bf84adc0e"
Jul 21 04:45:59.203457 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.203440    2576 scope.go:117] "RemoveContainer" containerID="a4f9246a732f8aaa8b8176e60df9b7ab63dda3ca656c55541307ac0bf84adc0e"
Jul 21 04:45:59.203718 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:45:59.203700    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4f9246a732f8aaa8b8176e60df9b7ab63dda3ca656c55541307ac0bf84adc0e\": container with ID starting with a4f9246a732f8aaa8b8176e60df9b7ab63dda3ca656c55541307ac0bf84adc0e not found: ID does not exist" containerID="a4f9246a732f8aaa8b8176e60df9b7ab63dda3ca656c55541307ac0bf84adc0e"
Jul 21 04:45:59.203791 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.203724    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4f9246a732f8aaa8b8176e60df9b7ab63dda3ca656c55541307ac0bf84adc0e"} err="failed to get container status \"a4f9246a732f8aaa8b8176e60df9b7ab63dda3ca656c55541307ac0bf84adc0e\": rpc error: code = NotFound desc = could not find container \"a4f9246a732f8aaa8b8176e60df9b7ab63dda3ca656c55541307ac0bf84adc0e\": container with ID starting with a4f9246a732f8aaa8b8176e60df9b7ab63dda3ca656c55541307ac0bf84adc0e not found: ID does not exist"
Jul 21 04:45:59.215065 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.215035    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"]
Jul 21 04:45:59.219980 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.219961    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-628b16/test-model-628b16-kserve-c5979c859-cpxhm"]
Jul 21 04:45:59.753811 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:45:59.753774    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j" podUID="ffbfb435-2417-4196-814b-8b3937a72db2" containerName="main" containerID="cri-o://ad5fb918f95e2ab27056868ce4af09fcbe870e4de055c9e84f2fe0d000351ee5" gracePeriod=45
Jul 21 04:46:00.003615 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.003593    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:46:00.096030 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.095998    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-dshm\") pod \"ffbfb435-2417-4196-814b-8b3937a72db2\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") "
Jul 21 04:46:00.096196 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.096035    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-tmp-dir\") pod \"ffbfb435-2417-4196-814b-8b3937a72db2\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") "
Jul 21 04:46:00.096196 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.096077    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2c269\" (UniqueName: \"kubernetes.io/projected/ffbfb435-2417-4196-814b-8b3937a72db2-kube-api-access-2c269\") pod \"ffbfb435-2417-4196-814b-8b3937a72db2\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") "
Jul 21 04:46:00.096196 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.096142    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-home\") pod \"ffbfb435-2417-4196-814b-8b3937a72db2\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") "
Jul 21 04:46:00.096196 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.096194    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-model-cache\") pod \"ffbfb435-2417-4196-814b-8b3937a72db2\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") "
Jul 21 04:46:00.096400 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.096232    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffbfb435-2417-4196-814b-8b3937a72db2-tls-certs\") pod \"ffbfb435-2417-4196-814b-8b3937a72db2\" (UID: \"ffbfb435-2417-4196-814b-8b3937a72db2\") "
Jul 21 04:46:00.096400 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.096323    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ffbfb435-2417-4196-814b-8b3937a72db2" (UID: "ffbfb435-2417-4196-814b-8b3937a72db2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:46:00.096485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.096423    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-home" (OuterVolumeSpecName: "home") pod "ffbfb435-2417-4196-814b-8b3937a72db2" (UID: "ffbfb435-2417-4196-814b-8b3937a72db2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:46:00.096485 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.096448    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-model-cache" (OuterVolumeSpecName: "model-cache") pod "ffbfb435-2417-4196-814b-8b3937a72db2" (UID: "ffbfb435-2417-4196-814b-8b3937a72db2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:46:00.096593 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.096574    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-tmp-dir\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:46:00.096630 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.096600    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-home\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:46:00.096630 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.096616    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-model-cache\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:46:00.098400 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.098371    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-dshm" (OuterVolumeSpecName: "dshm") pod "ffbfb435-2417-4196-814b-8b3937a72db2" (UID: "ffbfb435-2417-4196-814b-8b3937a72db2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:46:00.098400 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.098372    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffbfb435-2417-4196-814b-8b3937a72db2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ffbfb435-2417-4196-814b-8b3937a72db2" (UID: "ffbfb435-2417-4196-814b-8b3937a72db2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:46:00.098541 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.098421    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffbfb435-2417-4196-814b-8b3937a72db2-kube-api-access-2c269" (OuterVolumeSpecName: "kube-api-access-2c269") pod "ffbfb435-2417-4196-814b-8b3937a72db2" (UID: "ffbfb435-2417-4196-814b-8b3937a72db2"). InnerVolumeSpecName "kube-api-access-2c269". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:46:00.197216 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.197191    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffbfb435-2417-4196-814b-8b3937a72db2-tls-certs\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:46:00.197216 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.197211    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffbfb435-2417-4196-814b-8b3937a72db2-dshm\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:46:00.197734 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.197227    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2c269\" (UniqueName: \"kubernetes.io/projected/ffbfb435-2417-4196-814b-8b3937a72db2-kube-api-access-2c269\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:46:00.202402 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.202375    2576 generic.go:356] "Generic (PLEG): container finished" podID="ffbfb435-2417-4196-814b-8b3937a72db2" containerID="ad5fb918f95e2ab27056868ce4af09fcbe870e4de055c9e84f2fe0d000351ee5" exitCode=0
Jul 21 04:46:00.202498 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.202417    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"
Jul 21 04:46:00.202498 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.202455    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j" event={"ID":"ffbfb435-2417-4196-814b-8b3937a72db2","Type":"ContainerDied","Data":"ad5fb918f95e2ab27056868ce4af09fcbe870e4de055c9e84f2fe0d000351ee5"}
Jul 21 04:46:00.202498 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.202490    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j" event={"ID":"ffbfb435-2417-4196-814b-8b3937a72db2","Type":"ContainerDied","Data":"c201c3068c563767a803a390677df6a5e11d3d01f61ec5bb68a322d12a66d53d"}
Jul 21 04:46:00.202605 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.202506    2576 scope.go:117] "RemoveContainer" containerID="ad5fb918f95e2ab27056868ce4af09fcbe870e4de055c9e84f2fe0d000351ee5"
Jul 21 04:46:00.212522 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.212506    2576 scope.go:117] "RemoveContainer" containerID="ad5fb918f95e2ab27056868ce4af09fcbe870e4de055c9e84f2fe0d000351ee5"
Jul 21 04:46:00.212788 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:46:00.212768    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad5fb918f95e2ab27056868ce4af09fcbe870e4de055c9e84f2fe0d000351ee5\": container with ID starting with ad5fb918f95e2ab27056868ce4af09fcbe870e4de055c9e84f2fe0d000351ee5 not found: ID does not exist" containerID="ad5fb918f95e2ab27056868ce4af09fcbe870e4de055c9e84f2fe0d000351ee5"
Jul 21 04:46:00.212836 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.212796    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad5fb918f95e2ab27056868ce4af09fcbe870e4de055c9e84f2fe0d000351ee5"} err="failed to get container status \"ad5fb918f95e2ab27056868ce4af09fcbe870e4de055c9e84f2fe0d000351ee5\": rpc error: code = NotFound desc = could not find container \"ad5fb918f95e2ab27056868ce4af09fcbe870e4de055c9e84f2fe0d000351ee5\": container with ID starting with ad5fb918f95e2ab27056868ce4af09fcbe870e4de055c9e84f2fe0d000351ee5 not found: ID does not exist"
Jul 21 04:46:00.229418 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.229391    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"]
Jul 21 04:46:00.234392 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.234370    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-c8ed6c/test-model-c8ed6c-kserve-6695759675-pgx5j"]
Jul 21 04:46:00.664332 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.664299    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83214843-8092-43cc-a024-4fee4b3ee0f3" path="/var/lib/kubelet/pods/83214843-8092-43cc-a024-4fee4b3ee0f3/volumes"
Jul 21 04:46:00.664730 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:00.664713    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffbfb435-2417-4196-814b-8b3937a72db2" path="/var/lib/kubelet/pods/ffbfb435-2417-4196-814b-8b3937a72db2/volumes"
Jul 21 04:46:17.460523 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:17.460493    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c8ed6c-29743485-pcgpn"]
Jul 21 04:46:17.462521 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:17.462498    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c8ed6c-29743485-pcgpn"]
Jul 21 04:46:18.664331 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:18.664296    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51f30615-2fee-4a5a-a84a-444a57be11e3" path="/var/lib/kubelet/pods/51f30615-2fee-4a5a-a84a-444a57be11e3/volumes"
Jul 21 04:46:20.454689 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:20.454652    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:46:39.255088 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:39.255044    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:46:53.963404 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.963368    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8ae251-42tx2"]
Jul 21 04:46:53.963835 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.963771    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83214843-8092-43cc-a024-4fee4b3ee0f3" containerName="main"
Jul 21 04:46:53.963835 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.963783    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="83214843-8092-43cc-a024-4fee4b3ee0f3" containerName="main"
Jul 21 04:46:53.963835 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.963793    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc82fbd8-cc59-4ea6-b162-967d01bb273d" containerName="cleanup"
Jul 21 04:46:53.963835 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.963799    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc82fbd8-cc59-4ea6-b162-967d01bb273d" containerName="cleanup"
Jul 21 04:46:53.963835 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.963808    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffbfb435-2417-4196-814b-8b3937a72db2" containerName="main"
Jul 21 04:46:53.963835 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.963814    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffbfb435-2417-4196-814b-8b3937a72db2" containerName="main"
Jul 21 04:46:53.963835 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.963827    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f30615-2fee-4a5a-a84a-444a57be11e3" containerName="cleanup"
Jul 21 04:46:53.963835 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.963832    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f30615-2fee-4a5a-a84a-444a57be11e3" containerName="cleanup"
Jul 21 04:46:53.964082 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.963891    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffbfb435-2417-4196-814b-8b3937a72db2" containerName="main"
Jul 21 04:46:53.964082 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.963898    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="83214843-8092-43cc-a024-4fee4b3ee0f3" containerName="main"
Jul 21 04:46:53.964082 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.963905    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc82fbd8-cc59-4ea6-b162-967d01bb273d" containerName="cleanup"
Jul 21 04:46:53.964082 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.963910    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="51f30615-2fee-4a5a-a84a-444a57be11e3" containerName="cleanup"
Jul 21 04:46:53.967124 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.967102    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8ae251-42tx2"
Jul 21 04:46:53.969516 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.969495    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k4z5s\""
Jul 21 04:46:53.969633 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.969533    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 04:46:53.974066 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:53.974040    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8ae251-42tx2"]
Jul 21 04:46:54.026944 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:54.026903    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd05129-0455-4de3-8fa4-eb68ddfc17ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-8ae251-42tx2\" (UID: \"fbd05129-0455-4de3-8fa4-eb68ddfc17ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8ae251-42tx2"
Jul 21 04:46:54.053407 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:54.053374    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:46:54.127555 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:54.127506    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd05129-0455-4de3-8fa4-eb68ddfc17ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-8ae251-42tx2\" (UID: \"fbd05129-0455-4de3-8fa4-eb68ddfc17ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8ae251-42tx2"
Jul 21 04:46:54.128361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:54.128337    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd05129-0455-4de3-8fa4-eb68ddfc17ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-8ae251-42tx2\" (UID: \"fbd05129-0455-4de3-8fa4-eb68ddfc17ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8ae251-42tx2"
Jul 21 04:46:54.280120 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:54.280036    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8ae251-42tx2"
Jul 21 04:46:54.418406 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:54.418377    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8ae251-42tx2"]
Jul 21 04:46:54.420230 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:46:54.420187    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd05129_0455_4de3_8fa4_eb68ddfc17ae.slice/crio-4369e504ccdbc52394c0d8649664911333490fbdaaca3165122bb1401f998ca1 WatchSource:0}: Error finding container 4369e504ccdbc52394c0d8649664911333490fbdaaca3165122bb1401f998ca1: Status 404 returned error can't find the container with id 4369e504ccdbc52394c0d8649664911333490fbdaaca3165122bb1401f998ca1
Jul 21 04:46:54.496507 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:54.496476    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8ae251-42tx2" event={"ID":"fbd05129-0455-4de3-8fa4-eb68ddfc17ae","Type":"ContainerStarted","Data":"4369e504ccdbc52394c0d8649664911333490fbdaaca3165122bb1401f998ca1"}
Jul 21 04:46:55.503009 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:55.502914    2576 generic.go:356] "Generic (PLEG): container finished" podID="fbd05129-0455-4de3-8fa4-eb68ddfc17ae" containerID="3310d6a7e938f585d2218bf6c90f05072e98bc32b5fc624f615e75ed52f86541" exitCode=0
Jul 21 04:46:55.503009 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:55.502965    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8ae251-42tx2" event={"ID":"fbd05129-0455-4de3-8fa4-eb68ddfc17ae","Type":"ContainerDied","Data":"3310d6a7e938f585d2218bf6c90f05072e98bc32b5fc624f615e75ed52f86541"}
Jul 21 04:46:56.635493 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:56.635471    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8ae251-42tx2"
Jul 21 04:46:56.649106 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:56.649078    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd05129-0455-4de3-8fa4-eb68ddfc17ae-maas-api-service-ca\") pod \"fbd05129-0455-4de3-8fa4-eb68ddfc17ae\" (UID: \"fbd05129-0455-4de3-8fa4-eb68ddfc17ae\") "
Jul 21 04:46:56.649385 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:56.649364    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbd05129-0455-4de3-8fa4-eb68ddfc17ae-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fbd05129-0455-4de3-8fa4-eb68ddfc17ae" (UID: "fbd05129-0455-4de3-8fa4-eb68ddfc17ae"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:46:56.750026 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:56.749990    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd05129-0455-4de3-8fa4-eb68ddfc17ae-maas-api-service-ca\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:46:57.515057 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:57.515025    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8ae251-42tx2" event={"ID":"fbd05129-0455-4de3-8fa4-eb68ddfc17ae","Type":"ContainerDied","Data":"4369e504ccdbc52394c0d8649664911333490fbdaaca3165122bb1401f998ca1"}
Jul 21 04:46:57.515225 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:57.515073    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4369e504ccdbc52394c0d8649664911333490fbdaaca3165122bb1401f998ca1"
Jul 21 04:46:57.515225 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:46:57.515035    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8ae251-42tx2"
Jul 21 04:47:10.940005 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:10.939968    2576 scope.go:117] "RemoveContainer" containerID="b0ea807e7240fa4853cc4f3778a9eef488568ca6e643beab04710e769091b910"
Jul 21 04:47:14.043661 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:14.043606    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8ae251-42tx2"]
Jul 21 04:47:14.045769 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:14.045742    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8ae251-42tx2"]
Jul 21 04:47:14.150312 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:14.150275    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:47:14.664079 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:14.664045    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbd05129-0455-4de3-8fa4-eb68ddfc17ae" path="/var/lib/kubelet/pods/fbd05129-0455-4de3-8fa4-eb68ddfc17ae/volumes"
Jul 21 04:47:20.979165 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:20.979130    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr"]
Jul 21 04:47:20.979517 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:20.979475    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbd05129-0455-4de3-8fa4-eb68ddfc17ae" containerName="revoke-keys"
Jul 21 04:47:20.979517 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:20.979487    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbd05129-0455-4de3-8fa4-eb68ddfc17ae" containerName="revoke-keys"
Jul 21 04:47:20.979628 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:20.979541    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbd05129-0455-4de3-8fa4-eb68ddfc17ae" containerName="revoke-keys"
Jul 21 04:47:20.982535 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:20.982521    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr"
Jul 21 04:47:20.984897 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:20.984877    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 04:47:20.985026 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:20.984935    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k4z5s\""
Jul 21 04:47:20.990179 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:20.990155    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr"]
Jul 21 04:47:21.049384 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:21.049347    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f759cdab-3baf-4125-9bac-48468b01a182-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr\" (UID: \"f759cdab-3baf-4125-9bac-48468b01a182\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr"
Jul 21 04:47:21.150852 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:21.150826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f759cdab-3baf-4125-9bac-48468b01a182-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr\" (UID: \"f759cdab-3baf-4125-9bac-48468b01a182\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr"
Jul 21 04:47:21.151462 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:21.151443    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f759cdab-3baf-4125-9bac-48468b01a182-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr\" (UID: \"f759cdab-3baf-4125-9bac-48468b01a182\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr"
Jul 21 04:47:21.294662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:21.294583    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr"
Jul 21 04:47:21.431087 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:21.431062    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr"]
Jul 21 04:47:21.433355 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:47:21.433325    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf759cdab_3baf_4125_9bac_48468b01a182.slice/crio-ab331c6ba2a1814963cc096bebe98049274f32211f78723a21f2a3f6601090f5 WatchSource:0}: Error finding container ab331c6ba2a1814963cc096bebe98049274f32211f78723a21f2a3f6601090f5: Status 404 returned error can't find the container with id ab331c6ba2a1814963cc096bebe98049274f32211f78723a21f2a3f6601090f5
Jul 21 04:47:21.645041 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:21.645014    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr" event={"ID":"f759cdab-3baf-4125-9bac-48468b01a182","Type":"ContainerStarted","Data":"dcc4e4e1fe9ca1bdf8aa3df9696632c0068c6dd5e7d96332c3aaf16b22de8af2"}
Jul 21 04:47:21.645153 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:21.645063    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr" event={"ID":"f759cdab-3baf-4125-9bac-48468b01a182","Type":"ContainerStarted","Data":"ab331c6ba2a1814963cc096bebe98049274f32211f78723a21f2a3f6601090f5"}
Jul 21 04:47:21.666874 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:21.666835    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr" podStartSLOduration=1.666821651 podStartE2EDuration="1.666821651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:47:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:47:21.665214046 +0000 UTC m=+2591.482780831" watchObservedRunningTime="2026-07-21 04:47:21.666821651 +0000 UTC m=+2591.484388435"
Jul 21 04:47:22.651813 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:22.651773    2576 generic.go:356] "Generic (PLEG): container finished" podID="f759cdab-3baf-4125-9bac-48468b01a182" containerID="dcc4e4e1fe9ca1bdf8aa3df9696632c0068c6dd5e7d96332c3aaf16b22de8af2" exitCode=0
Jul 21 04:47:22.652184 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:22.651862    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr" event={"ID":"f759cdab-3baf-4125-9bac-48468b01a182","Type":"ContainerDied","Data":"dcc4e4e1fe9ca1bdf8aa3df9696632c0068c6dd5e7d96332c3aaf16b22de8af2"}
Jul 21 04:47:23.790618 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:23.790597    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr"
Jul 21 04:47:23.875577 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:23.875548    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f759cdab-3baf-4125-9bac-48468b01a182-maas-api-service-ca\") pod \"f759cdab-3baf-4125-9bac-48468b01a182\" (UID: \"f759cdab-3baf-4125-9bac-48468b01a182\") "
Jul 21 04:47:23.875935 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:23.875914    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f759cdab-3baf-4125-9bac-48468b01a182-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f759cdab-3baf-4125-9bac-48468b01a182" (UID: "f759cdab-3baf-4125-9bac-48468b01a182"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:47:23.976996 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:23.976935    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f759cdab-3baf-4125-9bac-48468b01a182-maas-api-service-ca\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:47:24.664442 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:24.664410    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr"
Jul 21 04:47:24.664654 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:24.664527    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr" event={"ID":"f759cdab-3baf-4125-9bac-48468b01a182","Type":"ContainerDied","Data":"ab331c6ba2a1814963cc096bebe98049274f32211f78723a21f2a3f6601090f5"}
Jul 21 04:47:24.664654 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:24.664568    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab331c6ba2a1814963cc096bebe98049274f32211f78723a21f2a3f6601090f5"
Jul 21 04:47:41.058049 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:41.057942    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr"]
Jul 21 04:47:41.061471 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:41.061446    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bccec9-k9bjr"]
Jul 21 04:47:41.538733 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:41.538698    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:47:42.664866 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:42.664835    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f759cdab-3baf-4125-9bac-48468b01a182" path="/var/lib/kubelet/pods/f759cdab-3baf-4125-9bac-48468b01a182/volumes"
Jul 21 04:47:56.238320 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:47:56.238290    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:48:05.343541 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:05.343497    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:48:17.564741 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.564709    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"]
Jul 21 04:48:17.565156 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.565092    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f759cdab-3baf-4125-9bac-48468b01a182" containerName="revoke-keys"
Jul 21 04:48:17.565156 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.565106    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f759cdab-3baf-4125-9bac-48468b01a182" containerName="revoke-keys"
Jul 21 04:48:17.565234 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.565179    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f759cdab-3baf-4125-9bac-48468b01a182" containerName="revoke-keys"
Jul 21 04:48:17.568176 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.568157    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.570912 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.570858    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e19fee\"/\"openshift-service-ca.crt\""
Jul 21 04:48:17.571011 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.570993    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e19fee\"/\"default-dockercfg-m4gqb\""
Jul 21 04:48:17.571769 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.571753    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e19fee\"/\"kube-root-ca.crt\""
Jul 21 04:48:17.571865 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.571756    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e19fee\"/\"auth-test-model-e19fee-kserve-self-signed-certs\""
Jul 21 04:48:17.576733 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.576710    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"]
Jul 21 04:48:17.674934 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.674900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-model-cache\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.675128 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.674949    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40bbd31e-6652-4102-865b-d7b5f2f0132f-tls-certs\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.675128 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.675014    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkzwx\" (UniqueName: \"kubernetes.io/projected/40bbd31e-6652-4102-865b-d7b5f2f0132f-kube-api-access-xkzwx\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.675128 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.675055    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-home\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.675128 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.675078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-dshm\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.675128 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.675101    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-tmp-dir\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.776393 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.776357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-dshm\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.776570 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.776402    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-tmp-dir\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.776570 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.776433    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-model-cache\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.776570 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.776455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40bbd31e-6652-4102-865b-d7b5f2f0132f-tls-certs\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.776570 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.776489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkzwx\" (UniqueName: \"kubernetes.io/projected/40bbd31e-6652-4102-865b-d7b5f2f0132f-kube-api-access-xkzwx\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.776570 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.776540    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-home\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.776935 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.776911    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-tmp-dir\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.776935 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.776929    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-home\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.777068 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.776979    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-model-cache\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.778883 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.778863    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-dshm\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.779161 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.779142    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40bbd31e-6652-4102-865b-d7b5f2f0132f-tls-certs\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.785451 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.785426    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkzwx\" (UniqueName: \"kubernetes.io/projected/40bbd31e-6652-4102-865b-d7b5f2f0132f-kube-api-access-xkzwx\") pod \"auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") " pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:17.877703 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:17.877670    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:18.016098 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:18.016071    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"]
Jul 21 04:48:18.017823 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:48:18.017795    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40bbd31e_6652_4102_865b_d7b5f2f0132f.slice/crio-6b55ab739757b4dbeb8e73bd2f8f3261684dd01fb292f923bf5e454e2903bff4 WatchSource:0}: Error finding container 6b55ab739757b4dbeb8e73bd2f8f3261684dd01fb292f923bf5e454e2903bff4: Status 404 returned error can't find the container with id 6b55ab739757b4dbeb8e73bd2f8f3261684dd01fb292f923bf5e454e2903bff4
Jul 21 04:48:18.957403 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:18.957367    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46" event={"ID":"40bbd31e-6652-4102-865b-d7b5f2f0132f","Type":"ContainerStarted","Data":"5b1a685bf0e60d482a3a0498f1cf9858488e7c2623ce0ed917d049a5e66b79b6"}
Jul 21 04:48:18.957827 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:18.957412    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46" event={"ID":"40bbd31e-6652-4102-865b-d7b5f2f0132f","Type":"ContainerStarted","Data":"6b55ab739757b4dbeb8e73bd2f8f3261684dd01fb292f923bf5e454e2903bff4"}
Jul 21 04:48:18.975300 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:18.975255    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46" podStartSLOduration=1.9752398150000001 podStartE2EDuration="1.975239815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:48:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:48:18.97431579 +0000 UTC m=+2648.791882611" watchObservedRunningTime="2026-07-21 04:48:18.975239815 +0000 UTC m=+2648.792806597"
Jul 21 04:48:21.763550 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:21.763513    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:48:27.878461 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:27.878421    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:27.878923 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:27.878485    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:27.890888 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:27.890863    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:28.016317 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:28.016287    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:48:36.792031 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.791995    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"]
Jul 21 04:48:36.795555 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.795540    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.803255 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.803236    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cfd2ba\"/\"openshift-service-ca.crt\""
Jul 21 04:48:36.803339 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.803296    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cfd2ba\"/\"default-dockercfg-sj4r6\""
Jul 21 04:48:36.804190 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.804172    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cfd2ba\"/\"kube-root-ca.crt\""
Jul 21 04:48:36.806862 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.806844    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cfd2ba\"/\"auth-test-model-cfd2ba-kserve-self-signed-certs\""
Jul 21 04:48:36.824431 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.824407    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"]
Jul 21 04:48:36.848830 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.848810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-model-cache\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.848915 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.848842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wndh4\" (UniqueName: \"kubernetes.io/projected/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-kube-api-access-wndh4\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.848915 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.848867    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-tls-certs\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.848915 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.848893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-dshm\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.849019 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.848959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-home\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.849019 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.848999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-tmp-dir\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.950080 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.950058    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-tmp-dir\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.950202 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.950104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-model-cache\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.950202 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.950123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wndh4\" (UniqueName: \"kubernetes.io/projected/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-kube-api-access-wndh4\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.950303 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.950236    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-tls-certs\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.950303 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.950292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-dshm\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.950404 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.950327    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-home\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.950507 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.950489    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-model-cache\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.950571 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.950547    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-tmp-dir\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.950697 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.950631    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-home\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.952590 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.952570    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-dshm\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.952896 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.952881    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-tls-certs\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:36.959970 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:36.959949    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wndh4\" (UniqueName: \"kubernetes.io/projected/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-kube-api-access-wndh4\") pod \"auth-test-model-cfd2ba-kserve-77957575c9-6kk4n\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") " pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:37.105430 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:37.105405    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:37.268202 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:37.268076    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"]
Jul 21 04:48:37.270762 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:48:37.270736    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4fe1bfb_a03e_452b_b37e_690e62ea5a04.slice/crio-94487a966453612606a86371fdebfc465bdd9b81e64f0b1f228ccc89cf1d9cde WatchSource:0}: Error finding container 94487a966453612606a86371fdebfc465bdd9b81e64f0b1f228ccc89cf1d9cde: Status 404 returned error can't find the container with id 94487a966453612606a86371fdebfc465bdd9b81e64f0b1f228ccc89cf1d9cde
Jul 21 04:48:38.065192 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:38.065155    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n" event={"ID":"c4fe1bfb-a03e-452b-b37e-690e62ea5a04","Type":"ContainerStarted","Data":"2ce4b46872c269a2174a03648e56085fae38b23c850bb529489f1d2136803f48"}
Jul 21 04:48:38.065192 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:38.065202    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n" event={"ID":"c4fe1bfb-a03e-452b-b37e-690e62ea5a04","Type":"ContainerStarted","Data":"94487a966453612606a86371fdebfc465bdd9b81e64f0b1f228ccc89cf1d9cde"}
Jul 21 04:48:38.083180 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:38.083136    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n" podStartSLOduration=2.08312182 podStartE2EDuration="2.08312182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:48:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:48:38.081745548 +0000 UTC m=+2667.899312331" watchObservedRunningTime="2026-07-21 04:48:38.08312182 +0000 UTC m=+2667.900688602"
Jul 21 04:48:40.746077 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:40.746047    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:48:47.106405 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:47.106372    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:47.106912 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:47.106427    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:47.119552 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:47.119530    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:48.128511 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:48.128479    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:48:55.852021 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:48:55.851987    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:49:08.050318 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:49:08.050272    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:49:12.499511 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:49:12.499401    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:49:12.509255 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:49:12.509234    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:49:25.742580 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:49:25.742545    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:49:46.940863 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:49:46.940825    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:50:02.848299 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:02.848241    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:50:17.946331 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:17.946296    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:50:33.147416 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:33.147323    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:50:37.440029 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:37.439992    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"]
Jul 21 04:50:38.449692 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:38.449661    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"]
Jul 21 04:50:49.151000 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:49.150963    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:50:52.045505 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.045472    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"]
Jul 21 04:50:52.048548 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.048533    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.051117 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.051093    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e19fee\"/\"sub-test-model-e19fee-kserve-self-signed-certs\""
Jul 21 04:50:52.059599 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.059579    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"]
Jul 21 04:50:52.114695 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.114668    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-model-cache\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.114801 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.114718    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-home\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.114801 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.114735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-tmp-dir\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.114801 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.114787    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11f62be5-c850-4f90-bccf-2930a7a9c42a-tls-certs\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.114910 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.114820    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-dshm\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.114910 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.114846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99nkt\" (UniqueName: \"kubernetes.io/projected/11f62be5-c850-4f90-bccf-2930a7a9c42a-kube-api-access-99nkt\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.218440 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.216350    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-home\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.218440 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.216468    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-tmp-dir\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.218440 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.216525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11f62be5-c850-4f90-bccf-2930a7a9c42a-tls-certs\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.218440 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.216592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-dshm\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.218440 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.216630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99nkt\" (UniqueName: \"kubernetes.io/projected/11f62be5-c850-4f90-bccf-2930a7a9c42a-kube-api-access-99nkt\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.218440 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.216744    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-model-cache\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.218440 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.216783    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-home\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.219779 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.219746    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-dshm\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.220043 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.220022    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-tmp-dir\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.220176 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.220150    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11f62be5-c850-4f90-bccf-2930a7a9c42a-tls-certs\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.220318 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.220297    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-model-cache\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.229202 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.229178    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99nkt\" (UniqueName: \"kubernetes.io/projected/11f62be5-c850-4f90-bccf-2930a7a9c42a-kube-api-access-99nkt\") pod \"sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") " pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.358736 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.358707    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:50:52.460396 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.460352    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46" podUID="40bbd31e-6652-4102-865b-d7b5f2f0132f" containerName="main" containerID="cri-o://5b1a685bf0e60d482a3a0498f1cf9858488e7c2623ce0ed917d049a5e66b79b6" gracePeriod=45
Jul 21 04:50:52.496655 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.496609    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"]
Jul 21 04:50:52.518658 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:50:52.518607    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11f62be5_c850_4f90_bccf_2930a7a9c42a.slice/crio-e28db0ca162b480e0d50dc777dd0b5b03fcb36abd08ec9d4fabd263a9516f1ac WatchSource:0}: Error finding container e28db0ca162b480e0d50dc777dd0b5b03fcb36abd08ec9d4fabd263a9516f1ac: Status 404 returned error can't find the container with id e28db0ca162b480e0d50dc777dd0b5b03fcb36abd08ec9d4fabd263a9516f1ac
Jul 21 04:50:52.708655 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.708621    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:50:52.722398 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.722372    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-model-cache\") pod \"40bbd31e-6652-4102-865b-d7b5f2f0132f\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") "
Jul 21 04:50:52.722490 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.722420    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-dshm\") pod \"40bbd31e-6652-4102-865b-d7b5f2f0132f\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") "
Jul 21 04:50:52.722490 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.722457    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkzwx\" (UniqueName: \"kubernetes.io/projected/40bbd31e-6652-4102-865b-d7b5f2f0132f-kube-api-access-xkzwx\") pod \"40bbd31e-6652-4102-865b-d7b5f2f0132f\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") "
Jul 21 04:50:52.722490 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.722478    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-home\") pod \"40bbd31e-6652-4102-865b-d7b5f2f0132f\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") "
Jul 21 04:50:52.722609 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.722507    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40bbd31e-6652-4102-865b-d7b5f2f0132f-tls-certs\") pod \"40bbd31e-6652-4102-865b-d7b5f2f0132f\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") "
Jul 21 04:50:52.722609 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.722533    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-tmp-dir\") pod \"40bbd31e-6652-4102-865b-d7b5f2f0132f\" (UID: \"40bbd31e-6652-4102-865b-d7b5f2f0132f\") "
Jul 21 04:50:52.722740 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.722610    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-model-cache" (OuterVolumeSpecName: "model-cache") pod "40bbd31e-6652-4102-865b-d7b5f2f0132f" (UID: "40bbd31e-6652-4102-865b-d7b5f2f0132f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:50:52.722867 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.722839    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-home" (OuterVolumeSpecName: "home") pod "40bbd31e-6652-4102-865b-d7b5f2f0132f" (UID: "40bbd31e-6652-4102-865b-d7b5f2f0132f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:50:52.722965 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.722865    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "40bbd31e-6652-4102-865b-d7b5f2f0132f" (UID: "40bbd31e-6652-4102-865b-d7b5f2f0132f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:50:52.722965 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.722855    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-model-cache\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:50:52.724849 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.724823    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-dshm" (OuterVolumeSpecName: "dshm") pod "40bbd31e-6652-4102-865b-d7b5f2f0132f" (UID: "40bbd31e-6652-4102-865b-d7b5f2f0132f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:50:52.724849 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.724821    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40bbd31e-6652-4102-865b-d7b5f2f0132f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "40bbd31e-6652-4102-865b-d7b5f2f0132f" (UID: "40bbd31e-6652-4102-865b-d7b5f2f0132f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:50:52.724849 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.724842    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40bbd31e-6652-4102-865b-d7b5f2f0132f-kube-api-access-xkzwx" (OuterVolumeSpecName: "kube-api-access-xkzwx") pod "40bbd31e-6652-4102-865b-d7b5f2f0132f" (UID: "40bbd31e-6652-4102-865b-d7b5f2f0132f"). InnerVolumeSpecName "kube-api-access-xkzwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:50:52.823987 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.823962    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkzwx\" (UniqueName: \"kubernetes.io/projected/40bbd31e-6652-4102-865b-d7b5f2f0132f-kube-api-access-xkzwx\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:50:52.823987 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.823986    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-home\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:50:52.823987 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.823996    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40bbd31e-6652-4102-865b-d7b5f2f0132f-tls-certs\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:50:52.823987 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.824003    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-tmp-dir\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:50:52.824236 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.824010    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40bbd31e-6652-4102-865b-d7b5f2f0132f-dshm\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:50:52.827876 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.827848    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf" event={"ID":"11f62be5-c850-4f90-bccf-2930a7a9c42a","Type":"ContainerStarted","Data":"7b88aa3daa73675ba4a84c8b40ed73a307e3176cb80320d18d2c6e85fa2d9e53"}
Jul 21 04:50:52.828011 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.827892    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf" event={"ID":"11f62be5-c850-4f90-bccf-2930a7a9c42a","Type":"ContainerStarted","Data":"e28db0ca162b480e0d50dc777dd0b5b03fcb36abd08ec9d4fabd263a9516f1ac"}
Jul 21 04:50:52.829113 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.829093    2576 generic.go:356] "Generic (PLEG): container finished" podID="40bbd31e-6652-4102-865b-d7b5f2f0132f" containerID="5b1a685bf0e60d482a3a0498f1cf9858488e7c2623ce0ed917d049a5e66b79b6" exitCode=0
Jul 21 04:50:52.829170 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.829120    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46" event={"ID":"40bbd31e-6652-4102-865b-d7b5f2f0132f","Type":"ContainerDied","Data":"5b1a685bf0e60d482a3a0498f1cf9858488e7c2623ce0ed917d049a5e66b79b6"}
Jul 21 04:50:52.829170 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.829158    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46" event={"ID":"40bbd31e-6652-4102-865b-d7b5f2f0132f","Type":"ContainerDied","Data":"6b55ab739757b4dbeb8e73bd2f8f3261684dd01fb292f923bf5e454e2903bff4"}
Jul 21 04:50:52.829170 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.829129    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"
Jul 21 04:50:52.829263 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.829176    2576 scope.go:117] "RemoveContainer" containerID="5b1a685bf0e60d482a3a0498f1cf9858488e7c2623ce0ed917d049a5e66b79b6"
Jul 21 04:50:52.838452 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.838436    2576 scope.go:117] "RemoveContainer" containerID="5b1a685bf0e60d482a3a0498f1cf9858488e7c2623ce0ed917d049a5e66b79b6"
Jul 21 04:50:52.838704 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:50:52.838688    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b1a685bf0e60d482a3a0498f1cf9858488e7c2623ce0ed917d049a5e66b79b6\": container with ID starting with 5b1a685bf0e60d482a3a0498f1cf9858488e7c2623ce0ed917d049a5e66b79b6 not found: ID does not exist" containerID="5b1a685bf0e60d482a3a0498f1cf9858488e7c2623ce0ed917d049a5e66b79b6"
Jul 21 04:50:52.838778 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.838712    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b1a685bf0e60d482a3a0498f1cf9858488e7c2623ce0ed917d049a5e66b79b6"} err="failed to get container status \"5b1a685bf0e60d482a3a0498f1cf9858488e7c2623ce0ed917d049a5e66b79b6\": rpc error: code = NotFound desc = could not find container \"5b1a685bf0e60d482a3a0498f1cf9858488e7c2623ce0ed917d049a5e66b79b6\": container with ID starting with 5b1a685bf0e60d482a3a0498f1cf9858488e7c2623ce0ed917d049a5e66b79b6 not found: ID does not exist"
Jul 21 04:50:52.846531 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.846493    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf" podStartSLOduration=0.846481391 podStartE2EDuration="846.481391ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:50:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:50:52.844079246 +0000 UTC m=+2802.661646042" watchObservedRunningTime="2026-07-21 04:50:52.846481391 +0000 UTC m=+2802.664048207"
Jul 21 04:50:52.857465 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.857443    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"]
Jul 21 04:50:52.859548 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:52.859528    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/auth-test-model-e19fee-kserve-5f79ffcdc5-nvv46"]
Jul 21 04:50:53.470287 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.470243    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n" podUID="c4fe1bfb-a03e-452b-b37e-690e62ea5a04" containerName="main" containerID="cri-o://2ce4b46872c269a2174a03648e56085fae38b23c850bb529489f1d2136803f48" gracePeriod=45
Jul 21 04:50:53.716707 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.716684    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:50:53.733383 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.733358    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-tmp-dir\") pod \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") "
Jul 21 04:50:53.733515 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.733420    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-model-cache\") pod \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") "
Jul 21 04:50:53.733515 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.733439    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-tls-certs\") pod \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") "
Jul 21 04:50:53.733515 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.733501    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-home\") pod \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") "
Jul 21 04:50:53.733703 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.733519    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wndh4\" (UniqueName: \"kubernetes.io/projected/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-kube-api-access-wndh4\") pod \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") "
Jul 21 04:50:53.733703 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.733543    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-dshm\") pod \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\" (UID: \"c4fe1bfb-a03e-452b-b37e-690e62ea5a04\") "
Jul 21 04:50:53.733703 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.733608    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c4fe1bfb-a03e-452b-b37e-690e62ea5a04" (UID: "c4fe1bfb-a03e-452b-b37e-690e62ea5a04"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:50:53.733828 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.733720    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-model-cache" (OuterVolumeSpecName: "model-cache") pod "c4fe1bfb-a03e-452b-b37e-690e62ea5a04" (UID: "c4fe1bfb-a03e-452b-b37e-690e62ea5a04"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:50:53.733828 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.733736    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-home" (OuterVolumeSpecName: "home") pod "c4fe1bfb-a03e-452b-b37e-690e62ea5a04" (UID: "c4fe1bfb-a03e-452b-b37e-690e62ea5a04"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:50:53.733907 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.733848    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-home\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:50:53.733907 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.733867    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-tmp-dir\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:50:53.733907 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.733883    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-model-cache\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:50:53.737681 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.737602    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-dshm" (OuterVolumeSpecName: "dshm") pod "c4fe1bfb-a03e-452b-b37e-690e62ea5a04" (UID: "c4fe1bfb-a03e-452b-b37e-690e62ea5a04"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:50:53.737788 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.737719    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c4fe1bfb-a03e-452b-b37e-690e62ea5a04" (UID: "c4fe1bfb-a03e-452b-b37e-690e62ea5a04"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:50:53.738256 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.738217    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-kube-api-access-wndh4" (OuterVolumeSpecName: "kube-api-access-wndh4") pod "c4fe1bfb-a03e-452b-b37e-690e62ea5a04" (UID: "c4fe1bfb-a03e-452b-b37e-690e62ea5a04"). InnerVolumeSpecName "kube-api-access-wndh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:50:53.834258 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.834231    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-tls-certs\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:50:53.834258 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.834256    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wndh4\" (UniqueName: \"kubernetes.io/projected/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-kube-api-access-wndh4\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:50:53.834426 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.834266    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1bfb-a03e-452b-b37e-690e62ea5a04-dshm\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:50:53.836484 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.836454    2576 generic.go:356] "Generic (PLEG): container finished" podID="c4fe1bfb-a03e-452b-b37e-690e62ea5a04" containerID="2ce4b46872c269a2174a03648e56085fae38b23c850bb529489f1d2136803f48" exitCode=0
Jul 21 04:50:53.836605 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.836494    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"
Jul 21 04:50:53.836605 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.836539    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n" event={"ID":"c4fe1bfb-a03e-452b-b37e-690e62ea5a04","Type":"ContainerDied","Data":"2ce4b46872c269a2174a03648e56085fae38b23c850bb529489f1d2136803f48"}
Jul 21 04:50:53.836605 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.836588    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n" event={"ID":"c4fe1bfb-a03e-452b-b37e-690e62ea5a04","Type":"ContainerDied","Data":"94487a966453612606a86371fdebfc465bdd9b81e64f0b1f228ccc89cf1d9cde"}
Jul 21 04:50:53.836776 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.836613    2576 scope.go:117] "RemoveContainer" containerID="2ce4b46872c269a2174a03648e56085fae38b23c850bb529489f1d2136803f48"
Jul 21 04:50:53.846167 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.846154    2576 scope.go:117] "RemoveContainer" containerID="2ce4b46872c269a2174a03648e56085fae38b23c850bb529489f1d2136803f48"
Jul 21 04:50:53.846401 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:50:53.846385    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ce4b46872c269a2174a03648e56085fae38b23c850bb529489f1d2136803f48\": container with ID starting with 2ce4b46872c269a2174a03648e56085fae38b23c850bb529489f1d2136803f48 not found: ID does not exist" containerID="2ce4b46872c269a2174a03648e56085fae38b23c850bb529489f1d2136803f48"
Jul 21 04:50:53.846444 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.846410    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ce4b46872c269a2174a03648e56085fae38b23c850bb529489f1d2136803f48"} err="failed to get container status \"2ce4b46872c269a2174a03648e56085fae38b23c850bb529489f1d2136803f48\": rpc error: code = NotFound desc = could not find container \"2ce4b46872c269a2174a03648e56085fae38b23c850bb529489f1d2136803f48\": container with ID starting with 2ce4b46872c269a2174a03648e56085fae38b23c850bb529489f1d2136803f48 not found: ID does not exist"
Jul 21 04:50:53.858446 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.858409    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"]
Jul 21 04:50:53.860467 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:53.860447    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/auth-test-model-cfd2ba-kserve-77957575c9-6kk4n"]
Jul 21 04:50:54.666140 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:54.666111    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40bbd31e-6652-4102-865b-d7b5f2f0132f" path="/var/lib/kubelet/pods/40bbd31e-6652-4102-865b-d7b5f2f0132f/volumes"
Jul 21 04:50:54.666492 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:54.666467    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4fe1bfb-a03e-452b-b37e-690e62ea5a04" path="/var/lib/kubelet/pods/c4fe1bfb-a03e-452b-b37e-690e62ea5a04/volumes"
Jul 21 04:50:56.848949 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:50:56.848914    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:51:02.359902 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:02.359867    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:51:02.360277 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:02.359915    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:51:02.371928 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:02.371896    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:51:02.895496 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:02.895470    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:51:10.990559 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:10.990525    2576 scope.go:117] "RemoveContainer" containerID="6518698382d52f61b95ed8a71b4537b6f033042b109859241ff99346f9f26053"
Jul 21 04:51:10.999117 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:10.999099    2576 scope.go:117] "RemoveContainer" containerID="363f4c94868d8843125ae0e77641e58a128e3f72b4d6f50687be414ae49a74fe"
Jul 21 04:51:27.147336 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.147304    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"]
Jul 21 04:51:27.147735 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.147666    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40bbd31e-6652-4102-865b-d7b5f2f0132f" containerName="main"
Jul 21 04:51:27.147735 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.147677    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="40bbd31e-6652-4102-865b-d7b5f2f0132f" containerName="main"
Jul 21 04:51:27.147735 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.147690    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4fe1bfb-a03e-452b-b37e-690e62ea5a04" containerName="main"
Jul 21 04:51:27.147735 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.147695    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4fe1bfb-a03e-452b-b37e-690e62ea5a04" containerName="main"
Jul 21 04:51:27.147870 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.147762    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4fe1bfb-a03e-452b-b37e-690e62ea5a04" containerName="main"
Jul 21 04:51:27.147870 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.147771    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="40bbd31e-6652-4102-865b-d7b5f2f0132f" containerName="main"
Jul 21 04:51:27.150842 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.150824    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.154300 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.154279    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cfd2ba\"/\"sub-test-model-cfd2ba-kserve-self-signed-certs\""
Jul 21 04:51:27.155092 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.155049    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cfd2ba\"/\"kube-root-ca.crt\""
Jul 21 04:51:27.155190 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.155054    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cfd2ba\"/\"openshift-service-ca.crt\""
Jul 21 04:51:27.155345 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.155323    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cfd2ba\"/\"default-dockercfg-sj4r6\""
Jul 21 04:51:27.173368 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.173342    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"]
Jul 21 04:51:27.307040 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.307000    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzpz4\" (UniqueName: \"kubernetes.io/projected/8fdc5f89-3956-43bd-af56-b0e88acaafad-kube-api-access-mzpz4\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.307248 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.307061    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdc5f89-3956-43bd-af56-b0e88acaafad-tls-certs\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.307248 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.307163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-dshm\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.307248 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.307201    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-model-cache\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.307413 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.307270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-home\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.307413 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.307314    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-tmp-dir\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.408822 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.408730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdc5f89-3956-43bd-af56-b0e88acaafad-tls-certs\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.408822 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.408775    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-dshm\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.408822 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.408790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-model-cache\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.408822 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.408824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-home\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.409152 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.408850    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-tmp-dir\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.409152 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.408877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzpz4\" (UniqueName: \"kubernetes.io/projected/8fdc5f89-3956-43bd-af56-b0e88acaafad-kube-api-access-mzpz4\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.409276 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.409255    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-model-cache\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.409331 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.409279    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-tmp-dir\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.409392 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.409332    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-home\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.411136 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.411113    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-dshm\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.411535 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.411516    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdc5f89-3956-43bd-af56-b0e88acaafad-tls-certs\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.417122 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.417101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzpz4\" (UniqueName: \"kubernetes.io/projected/8fdc5f89-3956-43bd-af56-b0e88acaafad-kube-api-access-mzpz4\") pod \"sub-test-model-cfd2ba-kserve-7969f69499-swclv\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") " pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.460609 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.460576    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:27.598184 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:27.598158    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"]
Jul 21 04:51:27.599834 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:51:27.599803    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fdc5f89_3956_43bd_af56_b0e88acaafad.slice/crio-65f82a7d8a8c1a44c9e1fb0e2b4d056f964d3301c706b8d821f588570948356a WatchSource:0}: Error finding container 65f82a7d8a8c1a44c9e1fb0e2b4d056f964d3301c706b8d821f588570948356a: Status 404 returned error can't find the container with id 65f82a7d8a8c1a44c9e1fb0e2b4d056f964d3301c706b8d821f588570948356a
Jul 21 04:51:28.018601 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:28.018558    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv" event={"ID":"8fdc5f89-3956-43bd-af56-b0e88acaafad","Type":"ContainerStarted","Data":"cf42e14e6778cbe030db1a953f2aa1753743b4f42eaf1fd1c21176265ddee1d1"}
Jul 21 04:51:28.018601 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:28.018603    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv" event={"ID":"8fdc5f89-3956-43bd-af56-b0e88acaafad","Type":"ContainerStarted","Data":"65f82a7d8a8c1a44c9e1fb0e2b4d056f964d3301c706b8d821f588570948356a"}
Jul 21 04:51:28.036188 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:28.036135    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv" podStartSLOduration=1.036115191 podStartE2EDuration="1.036115191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:51:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:51:28.035067924 +0000 UTC m=+2837.852634708" watchObservedRunningTime="2026-07-21 04:51:28.036115191 +0000 UTC m=+2837.853681975"
Jul 21 04:51:31.246176 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:31.246135    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:51:37.460865 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:37.460835    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:37.460865 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:37.460883    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:37.473517 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:37.473495    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:38.081876 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:38.081844    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:51:52.546089 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:51:52.546058    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:52:07.919450 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:07.919373    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"]
Jul 21 04:52:08.876383 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:08.876340    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"]
Jul 21 04:52:12.639925 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:12.639881    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:52:19.149182 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.149148    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"]
Jul 21 04:52:19.152512 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.152496    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.155526 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.155506    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e19fee\"/\"rate-test-model-e19fee-kserve-self-signed-certs\""
Jul 21 04:52:19.163534 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.163510    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"]
Jul 21 04:52:19.247495 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.247469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96ghq\" (UniqueName: \"kubernetes.io/projected/2838b60b-a07a-4337-bcfe-799c37544c04-kube-api-access-96ghq\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.247633 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.247504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-tmp-dir\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.247633 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.247542    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2838b60b-a07a-4337-bcfe-799c37544c04-tls-certs\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.247633 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.247615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-model-cache\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.247838 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.247683    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-dshm\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.247838 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.247745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-home\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.348925 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.348900    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2838b60b-a07a-4337-bcfe-799c37544c04-tls-certs\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.349026 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.348933    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-model-cache\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.349026 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.348954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-dshm\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.349026 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.348981    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-home\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.349026 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.349017    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96ghq\" (UniqueName: \"kubernetes.io/projected/2838b60b-a07a-4337-bcfe-799c37544c04-kube-api-access-96ghq\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.349181 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.349040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-tmp-dir\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.349363 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.349338    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-model-cache\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.349439 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.349421    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-tmp-dir\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.349494 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.349469    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-home\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.351382 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.351367    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-dshm\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.351799 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.351778    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2838b60b-a07a-4337-bcfe-799c37544c04-tls-certs\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.357618 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.357598    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96ghq\" (UniqueName: \"kubernetes.io/projected/2838b60b-a07a-4337-bcfe-799c37544c04-kube-api-access-96ghq\") pod \"rate-test-model-e19fee-kserve-5fffc88cdc-rvchk\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") " pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.461733 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.461677    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:19.594374 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:19.594350    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"]
Jul 21 04:52:19.595657 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:52:19.595607    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2838b60b_a07a_4337_bcfe_799c37544c04.slice/crio-a5530cc9c6dc35fbe93f6c313c1f9f7a6b8566239f624253af08d3325a6c4cd9 WatchSource:0}: Error finding container a5530cc9c6dc35fbe93f6c313c1f9f7a6b8566239f624253af08d3325a6c4cd9: Status 404 returned error can't find the container with id a5530cc9c6dc35fbe93f6c313c1f9f7a6b8566239f624253af08d3325a6c4cd9
Jul 21 04:52:20.296563 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:20.296518    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk" event={"ID":"2838b60b-a07a-4337-bcfe-799c37544c04","Type":"ContainerStarted","Data":"a7713cb3de408f8feae28c9504edb7a32cb58f131ec02ea4457b023a143d014f"}
Jul 21 04:52:20.296957 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:20.296570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk" event={"ID":"2838b60b-a07a-4337-bcfe-799c37544c04","Type":"ContainerStarted","Data":"a5530cc9c6dc35fbe93f6c313c1f9f7a6b8566239f624253af08d3325a6c4cd9"}
Jul 21 04:52:20.313176 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:20.313125    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk" podStartSLOduration=1.313110627 podStartE2EDuration="1.313110627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:52:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:52:20.312070746 +0000 UTC m=+2890.129637532" watchObservedRunningTime="2026-07-21 04:52:20.313110627 +0000 UTC m=+2890.130677410"
Jul 21 04:52:22.939662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:22.939607    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf" podUID="11f62be5-c850-4f90-bccf-2930a7a9c42a" containerName="main" containerID="cri-o://7b88aa3daa73675ba4a84c8b40ed73a307e3176cb80320d18d2c6e85fa2d9e53" gracePeriod=45
Jul 21 04:52:23.057142 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.057118    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:52:23.196159 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.196105    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:52:23.285861 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.285829    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-home\") pod \"11f62be5-c850-4f90-bccf-2930a7a9c42a\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") "
Jul 21 04:52:23.286022 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.285869    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99nkt\" (UniqueName: \"kubernetes.io/projected/11f62be5-c850-4f90-bccf-2930a7a9c42a-kube-api-access-99nkt\") pod \"11f62be5-c850-4f90-bccf-2930a7a9c42a\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") "
Jul 21 04:52:23.286022 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.285898    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-dshm\") pod \"11f62be5-c850-4f90-bccf-2930a7a9c42a\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") "
Jul 21 04:52:23.286022 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.285964    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-model-cache\") pod \"11f62be5-c850-4f90-bccf-2930a7a9c42a\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") "
Jul 21 04:52:23.286022 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.286004    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-tmp-dir\") pod \"11f62be5-c850-4f90-bccf-2930a7a9c42a\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") "
Jul 21 04:52:23.286184 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.286075    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11f62be5-c850-4f90-bccf-2930a7a9c42a-tls-certs\") pod \"11f62be5-c850-4f90-bccf-2930a7a9c42a\" (UID: \"11f62be5-c850-4f90-bccf-2930a7a9c42a\") "
Jul 21 04:52:23.286184 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.286145    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-home" (OuterVolumeSpecName: "home") pod "11f62be5-c850-4f90-bccf-2930a7a9c42a" (UID: "11f62be5-c850-4f90-bccf-2930a7a9c42a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:52:23.286331 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.286298    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-model-cache" (OuterVolumeSpecName: "model-cache") pod "11f62be5-c850-4f90-bccf-2930a7a9c42a" (UID: "11f62be5-c850-4f90-bccf-2930a7a9c42a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:52:23.286331 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.286295    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "11f62be5-c850-4f90-bccf-2930a7a9c42a" (UID: "11f62be5-c850-4f90-bccf-2930a7a9c42a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:52:23.286516 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.286412    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-home\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:52:23.286516 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.286427    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-model-cache\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:52:23.286516 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.286436    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-tmp-dir\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:52:23.288240 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.288210    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f62be5-c850-4f90-bccf-2930a7a9c42a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "11f62be5-c850-4f90-bccf-2930a7a9c42a" (UID: "11f62be5-c850-4f90-bccf-2930a7a9c42a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:52:23.288349 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.288259    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-dshm" (OuterVolumeSpecName: "dshm") pod "11f62be5-c850-4f90-bccf-2930a7a9c42a" (UID: "11f62be5-c850-4f90-bccf-2930a7a9c42a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:52:23.288349 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.288301    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11f62be5-c850-4f90-bccf-2930a7a9c42a-kube-api-access-99nkt" (OuterVolumeSpecName: "kube-api-access-99nkt") pod "11f62be5-c850-4f90-bccf-2930a7a9c42a" (UID: "11f62be5-c850-4f90-bccf-2930a7a9c42a"). InnerVolumeSpecName "kube-api-access-99nkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:52:23.313013 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.312988    2576 generic.go:356] "Generic (PLEG): container finished" podID="11f62be5-c850-4f90-bccf-2930a7a9c42a" containerID="7b88aa3daa73675ba4a84c8b40ed73a307e3176cb80320d18d2c6e85fa2d9e53" exitCode=0
Jul 21 04:52:23.313100 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.313025    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"
Jul 21 04:52:23.313100 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.313068    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf" event={"ID":"11f62be5-c850-4f90-bccf-2930a7a9c42a","Type":"ContainerDied","Data":"7b88aa3daa73675ba4a84c8b40ed73a307e3176cb80320d18d2c6e85fa2d9e53"}
Jul 21 04:52:23.313180 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.313110    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf" event={"ID":"11f62be5-c850-4f90-bccf-2930a7a9c42a","Type":"ContainerDied","Data":"e28db0ca162b480e0d50dc777dd0b5b03fcb36abd08ec9d4fabd263a9516f1ac"}
Jul 21 04:52:23.313180 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.313126    2576 scope.go:117] "RemoveContainer" containerID="7b88aa3daa73675ba4a84c8b40ed73a307e3176cb80320d18d2c6e85fa2d9e53"
Jul 21 04:52:23.322952 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.322938    2576 scope.go:117] "RemoveContainer" containerID="7b88aa3daa73675ba4a84c8b40ed73a307e3176cb80320d18d2c6e85fa2d9e53"
Jul 21 04:52:23.323178 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:52:23.323161    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b88aa3daa73675ba4a84c8b40ed73a307e3176cb80320d18d2c6e85fa2d9e53\": container with ID starting with 7b88aa3daa73675ba4a84c8b40ed73a307e3176cb80320d18d2c6e85fa2d9e53 not found: ID does not exist" containerID="7b88aa3daa73675ba4a84c8b40ed73a307e3176cb80320d18d2c6e85fa2d9e53"
Jul 21 04:52:23.323226 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.323185    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b88aa3daa73675ba4a84c8b40ed73a307e3176cb80320d18d2c6e85fa2d9e53"} err="failed to get container status \"7b88aa3daa73675ba4a84c8b40ed73a307e3176cb80320d18d2c6e85fa2d9e53\": rpc error: code = NotFound desc = could not find container \"7b88aa3daa73675ba4a84c8b40ed73a307e3176cb80320d18d2c6e85fa2d9e53\": container with ID starting with 7b88aa3daa73675ba4a84c8b40ed73a307e3176cb80320d18d2c6e85fa2d9e53 not found: ID does not exist"
Jul 21 04:52:23.335287 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.335266    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"]
Jul 21 04:52:23.339366 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.339345    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/sub-test-model-e19fee-kserve-7b8ddcd769-p8hxf"]
Jul 21 04:52:23.387568 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.387545    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11f62be5-c850-4f90-bccf-2930a7a9c42a-tls-certs\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:52:23.387568 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.387567    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99nkt\" (UniqueName: \"kubernetes.io/projected/11f62be5-c850-4f90-bccf-2930a7a9c42a-kube-api-access-99nkt\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:52:23.387726 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.387578    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11f62be5-c850-4f90-bccf-2930a7a9c42a-dshm\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:52:23.897389 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:23.897350    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv" podUID="8fdc5f89-3956-43bd-af56-b0e88acaafad" containerName="main" containerID="cri-o://cf42e14e6778cbe030db1a953f2aa1753743b4f42eaf1fd1c21176265ddee1d1" gracePeriod=45
Jul 21 04:52:24.151933 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.151879    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:52:24.295447 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.295413    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzpz4\" (UniqueName: \"kubernetes.io/projected/8fdc5f89-3956-43bd-af56-b0e88acaafad-kube-api-access-mzpz4\") pod \"8fdc5f89-3956-43bd-af56-b0e88acaafad\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") "
Jul 21 04:52:24.295619 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.295461    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-model-cache\") pod \"8fdc5f89-3956-43bd-af56-b0e88acaafad\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") "
Jul 21 04:52:24.295619 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.295479    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-dshm\") pod \"8fdc5f89-3956-43bd-af56-b0e88acaafad\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") "
Jul 21 04:52:24.295619 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.295531    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-tmp-dir\") pod \"8fdc5f89-3956-43bd-af56-b0e88acaafad\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") "
Jul 21 04:52:24.295619 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.295573    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdc5f89-3956-43bd-af56-b0e88acaafad-tls-certs\") pod \"8fdc5f89-3956-43bd-af56-b0e88acaafad\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") "
Jul 21 04:52:24.295619 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.295592    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-home\") pod \"8fdc5f89-3956-43bd-af56-b0e88acaafad\" (UID: \"8fdc5f89-3956-43bd-af56-b0e88acaafad\") "
Jul 21 04:52:24.295948 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.295756    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-model-cache" (OuterVolumeSpecName: "model-cache") pod "8fdc5f89-3956-43bd-af56-b0e88acaafad" (UID: "8fdc5f89-3956-43bd-af56-b0e88acaafad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:52:24.295948 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.295815    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8fdc5f89-3956-43bd-af56-b0e88acaafad" (UID: "8fdc5f89-3956-43bd-af56-b0e88acaafad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:52:24.296059 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.295952    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-home" (OuterVolumeSpecName: "home") pod "8fdc5f89-3956-43bd-af56-b0e88acaafad" (UID: "8fdc5f89-3956-43bd-af56-b0e88acaafad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:52:24.296059 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.295962    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-model-cache\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:52:24.296059 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.295981    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-tmp-dir\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:52:24.297888 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.297858    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-dshm" (OuterVolumeSpecName: "dshm") pod "8fdc5f89-3956-43bd-af56-b0e88acaafad" (UID: "8fdc5f89-3956-43bd-af56-b0e88acaafad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:52:24.297888 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.297874    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fdc5f89-3956-43bd-af56-b0e88acaafad-kube-api-access-mzpz4" (OuterVolumeSpecName: "kube-api-access-mzpz4") pod "8fdc5f89-3956-43bd-af56-b0e88acaafad" (UID: "8fdc5f89-3956-43bd-af56-b0e88acaafad"). InnerVolumeSpecName "kube-api-access-mzpz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:52:24.297888 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.297858    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fdc5f89-3956-43bd-af56-b0e88acaafad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8fdc5f89-3956-43bd-af56-b0e88acaafad" (UID: "8fdc5f89-3956-43bd-af56-b0e88acaafad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:52:24.320621 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.320596    2576 generic.go:356] "Generic (PLEG): container finished" podID="8fdc5f89-3956-43bd-af56-b0e88acaafad" containerID="cf42e14e6778cbe030db1a953f2aa1753743b4f42eaf1fd1c21176265ddee1d1" exitCode=0
Jul 21 04:52:24.320760 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.320659    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"
Jul 21 04:52:24.320760 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.320691    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv" event={"ID":"8fdc5f89-3956-43bd-af56-b0e88acaafad","Type":"ContainerDied","Data":"cf42e14e6778cbe030db1a953f2aa1753743b4f42eaf1fd1c21176265ddee1d1"}
Jul 21 04:52:24.320760 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.320733    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv" event={"ID":"8fdc5f89-3956-43bd-af56-b0e88acaafad","Type":"ContainerDied","Data":"65f82a7d8a8c1a44c9e1fb0e2b4d056f964d3301c706b8d821f588570948356a"}
Jul 21 04:52:24.320760 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.320750    2576 scope.go:117] "RemoveContainer" containerID="cf42e14e6778cbe030db1a953f2aa1753743b4f42eaf1fd1c21176265ddee1d1"
Jul 21 04:52:24.329611 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.329592    2576 scope.go:117] "RemoveContainer" containerID="cf42e14e6778cbe030db1a953f2aa1753743b4f42eaf1fd1c21176265ddee1d1"
Jul 21 04:52:24.329903 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:52:24.329883    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf42e14e6778cbe030db1a953f2aa1753743b4f42eaf1fd1c21176265ddee1d1\": container with ID starting with cf42e14e6778cbe030db1a953f2aa1753743b4f42eaf1fd1c21176265ddee1d1 not found: ID does not exist" containerID="cf42e14e6778cbe030db1a953f2aa1753743b4f42eaf1fd1c21176265ddee1d1"
Jul 21 04:52:24.329962 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.329911    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf42e14e6778cbe030db1a953f2aa1753743b4f42eaf1fd1c21176265ddee1d1"} err="failed to get container status \"cf42e14e6778cbe030db1a953f2aa1753743b4f42eaf1fd1c21176265ddee1d1\": rpc error: code = NotFound desc = could not find container \"cf42e14e6778cbe030db1a953f2aa1753743b4f42eaf1fd1c21176265ddee1d1\": container with ID starting with cf42e14e6778cbe030db1a953f2aa1753743b4f42eaf1fd1c21176265ddee1d1 not found: ID does not exist"
Jul 21 04:52:24.341998 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.341974    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"]
Jul 21 04:52:24.345956 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.345933    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/sub-test-model-cfd2ba-kserve-7969f69499-swclv"]
Jul 21 04:52:24.396800 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.396767    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdc5f89-3956-43bd-af56-b0e88acaafad-tls-certs\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:52:24.396800 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.396795    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-home\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:52:24.396800 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.396805    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzpz4\" (UniqueName: \"kubernetes.io/projected/8fdc5f89-3956-43bd-af56-b0e88acaafad-kube-api-access-mzpz4\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:52:24.396999 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.396814    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fdc5f89-3956-43bd-af56-b0e88acaafad-dshm\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:52:24.664395 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.664358    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11f62be5-c850-4f90-bccf-2930a7a9c42a" path="/var/lib/kubelet/pods/11f62be5-c850-4f90-bccf-2930a7a9c42a/volumes"
Jul 21 04:52:24.664789 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:24.664775    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fdc5f89-3956-43bd-af56-b0e88acaafad" path="/var/lib/kubelet/pods/8fdc5f89-3956-43bd-af56-b0e88acaafad/volumes"
Jul 21 04:52:29.461898 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:29.461864    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:29.462269 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:29.461910    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:29.474032 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:29.474003    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:30.362873 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:30.362844    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:52:49.241676 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.241631    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"]
Jul 21 04:52:49.242078 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.242023    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f62be5-c850-4f90-bccf-2930a7a9c42a" containerName="main"
Jul 21 04:52:49.242078 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.242035    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f62be5-c850-4f90-bccf-2930a7a9c42a" containerName="main"
Jul 21 04:52:49.242078 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.242057    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fdc5f89-3956-43bd-af56-b0e88acaafad" containerName="main"
Jul 21 04:52:49.242078 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.242062    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fdc5f89-3956-43bd-af56-b0e88acaafad" containerName="main"
Jul 21 04:52:49.242220 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.242130    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fdc5f89-3956-43bd-af56-b0e88acaafad" containerName="main"
Jul 21 04:52:49.242220 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.242138    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="11f62be5-c850-4f90-bccf-2930a7a9c42a" containerName="main"
Jul 21 04:52:49.245038 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.245020    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.249000 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.248974    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cfd2ba\"/\"kube-root-ca.crt\""
Jul 21 04:52:49.249144 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.249122    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cfd2ba\"/\"default-dockercfg-sj4r6\""
Jul 21 04:52:49.249211 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.249123    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cfd2ba\"/\"openshift-service-ca.crt\""
Jul 21 04:52:49.249211 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.249170    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cfd2ba\"/\"rate-test-model-cfd2ba-kserve-self-signed-certs\""
Jul 21 04:52:49.255815 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.255793    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"]
Jul 21 04:52:49.298353 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.298320    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-model-cache\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.298487 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.298364    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4jj7\" (UniqueName: \"kubernetes.io/projected/1882b838-a7cf-4cb9-b428-b14f347eaac7-kube-api-access-p4jj7\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.298487 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.298457    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-home\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.298559 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.298488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1882b838-a7cf-4cb9-b428-b14f347eaac7-tls-certs\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.298559 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.298504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-dshm\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.298559 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.298520    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-tmp-dir\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.399807 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.399777    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4jj7\" (UniqueName: \"kubernetes.io/projected/1882b838-a7cf-4cb9-b428-b14f347eaac7-kube-api-access-p4jj7\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.399964 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.399861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-home\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.399964 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.399880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1882b838-a7cf-4cb9-b428-b14f347eaac7-tls-certs\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.399964 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.399896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-dshm\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.399964 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.399911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-tmp-dir\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.399964 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.399938    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-model-cache\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.400253 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.400236    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-home\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.400294 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.400283    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-model-cache\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.400362 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.400347    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-tmp-dir\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.402364 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.402334    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-dshm\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.402599 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.402582    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1882b838-a7cf-4cb9-b428-b14f347eaac7-tls-certs\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.407722 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.407698    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4jj7\" (UniqueName: \"kubernetes.io/projected/1882b838-a7cf-4cb9-b428-b14f347eaac7-kube-api-access-p4jj7\") pod \"rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") " pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.555158 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.555062    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:49.692023 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:49.691990    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"]
Jul 21 04:52:49.693123 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:52:49.693094    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1882b838_a7cf_4cb9_b428_b14f347eaac7.slice/crio-30693db41012c9b1c176e027feb0c6212b192fea64aadfae2109527d1de649ff WatchSource:0}: Error finding container 30693db41012c9b1c176e027feb0c6212b192fea64aadfae2109527d1de649ff: Status 404 returned error can't find the container with id 30693db41012c9b1c176e027feb0c6212b192fea64aadfae2109527d1de649ff
Jul 21 04:52:50.463107 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:50.463072    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k" event={"ID":"1882b838-a7cf-4cb9-b428-b14f347eaac7","Type":"ContainerStarted","Data":"5782df2df921e4a69758f3847f3044d9404b191fdeb081ed9ea61265975f3111"}
Jul 21 04:52:50.463107 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:50.463114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k" event={"ID":"1882b838-a7cf-4cb9-b428-b14f347eaac7","Type":"ContainerStarted","Data":"30693db41012c9b1c176e027feb0c6212b192fea64aadfae2109527d1de649ff"}
Jul 21 04:52:50.481909 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:50.481859    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k" podStartSLOduration=1.481843768 podStartE2EDuration="1.481843768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:52:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:52:50.479903856 +0000 UTC m=+2920.297470641" watchObservedRunningTime="2026-07-21 04:52:50.481843768 +0000 UTC m=+2920.299410551"
Jul 21 04:52:52.845283 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:52.845245    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:52:59.555553 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:59.555519    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:59.556154 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:59.555570    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:52:59.567886 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:52:59.567863    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:53:00.530171 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:00.530142    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:53:07.048151 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:07.048110    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:53:11.042875 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:11.042843    2576 scope.go:117] "RemoveContainer" containerID="3310d6a7e938f585d2218bf6c90f05072e98bc32b5fc624f615e75ed52f86541"
Jul 21 04:53:22.139293 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:22.139256    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:53:28.164984 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:28.164954    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"]
Jul 21 04:53:29.162420 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:29.162386    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"]
Jul 21 04:53:30.159559 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:30.159528    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7815-140211182265648"]
Jul 21 04:53:30.163065 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:30.163047    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182265648"
Jul 21 04:53:30.165352 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:30.165323    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-djb5m\""
Jul 21 04:53:30.169332 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:30.169301    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7815-140211182265648"]
Jul 21 04:53:30.269545 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:30.269523    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn8mv\" (UniqueName: \"kubernetes.io/projected/cdafe576-800e-45cb-b6d1-9fc90e46143d-kube-api-access-gn8mv\") pod \"test-curl-7815-140211182265648\" (UID: \"cdafe576-800e-45cb-b6d1-9fc90e46143d\") " pod="opendatahub/test-curl-7815-140211182265648"
Jul 21 04:53:30.370956 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:30.370933    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn8mv\" (UniqueName: \"kubernetes.io/projected/cdafe576-800e-45cb-b6d1-9fc90e46143d-kube-api-access-gn8mv\") pod \"test-curl-7815-140211182265648\" (UID: \"cdafe576-800e-45cb-b6d1-9fc90e46143d\") " pod="opendatahub/test-curl-7815-140211182265648"
Jul 21 04:53:30.380810 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:30.380777    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn8mv\" (UniqueName: \"kubernetes.io/projected/cdafe576-800e-45cb-b6d1-9fc90e46143d-kube-api-access-gn8mv\") pod \"test-curl-7815-140211182265648\" (UID: \"cdafe576-800e-45cb-b6d1-9fc90e46143d\") " pod="opendatahub/test-curl-7815-140211182265648"
Jul 21 04:53:30.473783 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:30.473732    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182265648"
Jul 21 04:53:30.607967 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:30.607941    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7815-140211182265648"]
Jul 21 04:53:30.609837 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:53:30.609809    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcdafe576_800e_45cb_b6d1_9fc90e46143d.slice/crio-45865aad65744a991edd16886ff40da6e2d48c24d067acd72a7d61c973738b11 WatchSource:0}: Error finding container 45865aad65744a991edd16886ff40da6e2d48c24d067acd72a7d61c973738b11: Status 404 returned error can't find the container with id 45865aad65744a991edd16886ff40da6e2d48c24d067acd72a7d61c973738b11
Jul 21 04:53:30.611519 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:30.611499    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:53:30.680940 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:30.680911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7815-140211182265648" event={"ID":"cdafe576-800e-45cb-b6d1-9fc90e46143d","Type":"ContainerStarted","Data":"45865aad65744a991edd16886ff40da6e2d48c24d067acd72a7d61c973738b11"}
Jul 21 04:53:31.687416 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:31.687389    2576 generic.go:356] "Generic (PLEG): container finished" podID="cdafe576-800e-45cb-b6d1-9fc90e46143d" containerID="17f54bfc58c597b49427c430f36fd5ab1e605c1f0be14467d4c104f208e98d89" exitCode=0
Jul 21 04:53:31.687827 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:31.687452    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7815-140211182265648" event={"ID":"cdafe576-800e-45cb-b6d1-9fc90e46143d","Type":"ContainerDied","Data":"17f54bfc58c597b49427c430f36fd5ab1e605c1f0be14467d4c104f208e98d89"}
Jul 21 04:53:32.822035 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:32.822005    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182265648"
Jul 21 04:53:32.859257 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:32.859219    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7815-140211182265648_cdafe576-800e-45cb-b6d1-9fc90e46143d/test-curl-7815-140211182265648/0.log"
Jul 21 04:53:32.885859 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:32.885834    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7815-140211182265648"]
Jul 21 04:53:32.889896 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:32.889876    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7815-140211182265648"]
Jul 21 04:53:32.895053 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:32.895036    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn8mv\" (UniqueName: \"kubernetes.io/projected/cdafe576-800e-45cb-b6d1-9fc90e46143d-kube-api-access-gn8mv\") pod \"cdafe576-800e-45cb-b6d1-9fc90e46143d\" (UID: \"cdafe576-800e-45cb-b6d1-9fc90e46143d\") "
Jul 21 04:53:32.897339 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:32.897316    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdafe576-800e-45cb-b6d1-9fc90e46143d-kube-api-access-gn8mv" (OuterVolumeSpecName: "kube-api-access-gn8mv") pod "cdafe576-800e-45cb-b6d1-9fc90e46143d" (UID: "cdafe576-800e-45cb-b6d1-9fc90e46143d"). InnerVolumeSpecName "kube-api-access-gn8mv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:53:32.996447 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:32.996389    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn8mv\" (UniqueName: \"kubernetes.io/projected/cdafe576-800e-45cb-b6d1-9fc90e46143d-kube-api-access-gn8mv\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:33.020571 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:33.020545    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7815-140211182342448"]
Jul 21 04:53:33.020941 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:33.020928    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdafe576-800e-45cb-b6d1-9fc90e46143d" containerName="test-curl-7815-140211182265648"
Jul 21 04:53:33.020986 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:33.020943    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdafe576-800e-45cb-b6d1-9fc90e46143d" containerName="test-curl-7815-140211182265648"
Jul 21 04:53:33.021020 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:33.021010    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdafe576-800e-45cb-b6d1-9fc90e46143d" containerName="test-curl-7815-140211182265648"
Jul 21 04:53:33.024011 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:33.023997    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182342448"
Jul 21 04:53:33.027461 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:33.027440    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7815-140211182342448"]
Jul 21 04:53:33.096966 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:33.096940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2sr6\" (UniqueName: \"kubernetes.io/projected/f2ac86d0-a708-47d4-aaa5-7ff981578219-kube-api-access-g2sr6\") pod \"test-curl-7815-140211182342448\" (UID: \"f2ac86d0-a708-47d4-aaa5-7ff981578219\") " pod="opendatahub/test-curl-7815-140211182342448"
Jul 21 04:53:33.198185 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:33.198161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2sr6\" (UniqueName: \"kubernetes.io/projected/f2ac86d0-a708-47d4-aaa5-7ff981578219-kube-api-access-g2sr6\") pod \"test-curl-7815-140211182342448\" (UID: \"f2ac86d0-a708-47d4-aaa5-7ff981578219\") " pod="opendatahub/test-curl-7815-140211182342448"
Jul 21 04:53:33.206742 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:33.206721    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2sr6\" (UniqueName: \"kubernetes.io/projected/f2ac86d0-a708-47d4-aaa5-7ff981578219-kube-api-access-g2sr6\") pod \"test-curl-7815-140211182342448\" (UID: \"f2ac86d0-a708-47d4-aaa5-7ff981578219\") " pod="opendatahub/test-curl-7815-140211182342448"
Jul 21 04:53:33.334417 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:33.334399    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182342448"
Jul 21 04:53:33.464767 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:33.464718    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7815-140211182342448"]
Jul 21 04:53:33.467513 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:53:33.467489    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2ac86d0_a708_47d4_aaa5_7ff981578219.slice/crio-4d2485bfb2aaa8c5cb2087333df46b73481737d6d2bb9c04f37bf0abd079e3bc WatchSource:0}: Error finding container 4d2485bfb2aaa8c5cb2087333df46b73481737d6d2bb9c04f37bf0abd079e3bc: Status 404 returned error can't find the container with id 4d2485bfb2aaa8c5cb2087333df46b73481737d6d2bb9c04f37bf0abd079e3bc
Jul 21 04:53:33.698740 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:33.698660    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7815-140211182342448" event={"ID":"f2ac86d0-a708-47d4-aaa5-7ff981578219","Type":"ContainerStarted","Data":"4d2485bfb2aaa8c5cb2087333df46b73481737d6d2bb9c04f37bf0abd079e3bc"}
Jul 21 04:53:33.699975 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:33.699956    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45865aad65744a991edd16886ff40da6e2d48c24d067acd72a7d61c973738b11"
Jul 21 04:53:33.700083 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:33.699982    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182265648"
Jul 21 04:53:33.710819 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:53:33.710792    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7815-140211182265648\" is forbidden: User \"system:node:ip-10-0-130-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-0.ec2.internal' and this object" podUID="cdafe576-800e-45cb-b6d1-9fc90e46143d" pod="opendatahub/test-curl-7815-140211182265648"
Jul 21 04:53:34.665150 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:34.665115    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdafe576-800e-45cb-b6d1-9fc90e46143d" path="/var/lib/kubelet/pods/cdafe576-800e-45cb-b6d1-9fc90e46143d/volumes"
Jul 21 04:53:34.706779 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:34.706751    2576 generic.go:356] "Generic (PLEG): container finished" podID="f2ac86d0-a708-47d4-aaa5-7ff981578219" containerID="74acef11c71eec21aafac0ff8936863b1ec92175f7ea799100c29bdc5b7d515a" exitCode=0
Jul 21 04:53:34.706907 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:34.706838    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7815-140211182342448" event={"ID":"f2ac86d0-a708-47d4-aaa5-7ff981578219","Type":"ContainerDied","Data":"74acef11c71eec21aafac0ff8936863b1ec92175f7ea799100c29bdc5b7d515a"}
Jul 21 04:53:35.841343 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:35.841322    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182342448"
Jul 21 04:53:35.861311 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:35.861285    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7815-140211182342448_f2ac86d0-a708-47d4-aaa5-7ff981578219/test-curl-7815-140211182342448/0.log"
Jul 21 04:53:35.885169 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:35.885092    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7815-140211182342448"]
Jul 21 04:53:35.887284 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:35.887260    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7815-140211182342448"]
Jul 21 04:53:35.919367 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:35.919343    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2sr6\" (UniqueName: \"kubernetes.io/projected/f2ac86d0-a708-47d4-aaa5-7ff981578219-kube-api-access-g2sr6\") pod \"f2ac86d0-a708-47d4-aaa5-7ff981578219\" (UID: \"f2ac86d0-a708-47d4-aaa5-7ff981578219\") "
Jul 21 04:53:35.921542 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:35.921522    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2ac86d0-a708-47d4-aaa5-7ff981578219-kube-api-access-g2sr6" (OuterVolumeSpecName: "kube-api-access-g2sr6") pod "f2ac86d0-a708-47d4-aaa5-7ff981578219" (UID: "f2ac86d0-a708-47d4-aaa5-7ff981578219"). InnerVolumeSpecName "kube-api-access-g2sr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:53:36.020067 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:36.019998    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2sr6\" (UniqueName: \"kubernetes.io/projected/f2ac86d0-a708-47d4-aaa5-7ff981578219-kube-api-access-g2sr6\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:36.050709 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:36.050679    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7815-140211182125680"]
Jul 21 04:53:36.051036 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:36.051022    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2ac86d0-a708-47d4-aaa5-7ff981578219" containerName="test-curl-7815-140211182342448"
Jul 21 04:53:36.051036 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:36.051036    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2ac86d0-a708-47d4-aaa5-7ff981578219" containerName="test-curl-7815-140211182342448"
Jul 21 04:53:36.051124 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:36.051112    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2ac86d0-a708-47d4-aaa5-7ff981578219" containerName="test-curl-7815-140211182342448"
Jul 21 04:53:36.054242 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:36.054227    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182125680"
Jul 21 04:53:36.060492 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:36.060470    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7815-140211182125680"]
Jul 21 04:53:36.121035 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:36.121009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czh5l\" (UniqueName: \"kubernetes.io/projected/605c3720-d0cc-4440-a59b-6cd06f9aa45f-kube-api-access-czh5l\") pod \"test-curl-7815-140211182125680\" (UID: \"605c3720-d0cc-4440-a59b-6cd06f9aa45f\") " pod="opendatahub/test-curl-7815-140211182125680"
Jul 21 04:53:36.221938 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:36.221907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czh5l\" (UniqueName: \"kubernetes.io/projected/605c3720-d0cc-4440-a59b-6cd06f9aa45f-kube-api-access-czh5l\") pod \"test-curl-7815-140211182125680\" (UID: \"605c3720-d0cc-4440-a59b-6cd06f9aa45f\") " pod="opendatahub/test-curl-7815-140211182125680"
Jul 21 04:53:36.230587 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:36.230559    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czh5l\" (UniqueName: \"kubernetes.io/projected/605c3720-d0cc-4440-a59b-6cd06f9aa45f-kube-api-access-czh5l\") pod \"test-curl-7815-140211182125680\" (UID: \"605c3720-d0cc-4440-a59b-6cd06f9aa45f\") " pod="opendatahub/test-curl-7815-140211182125680"
Jul 21 04:53:36.365073 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:36.365039    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182125680"
Jul 21 04:53:36.495997 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:36.495969    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7815-140211182125680"]
Jul 21 04:53:36.498006 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:53:36.497984    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod605c3720_d0cc_4440_a59b_6cd06f9aa45f.slice/crio-120bf49f25d16f562cf2dc12540956ed4286523d43ebece9e1ac5c99a11c4ea8 WatchSource:0}: Error finding container 120bf49f25d16f562cf2dc12540956ed4286523d43ebece9e1ac5c99a11c4ea8: Status 404 returned error can't find the container with id 120bf49f25d16f562cf2dc12540956ed4286523d43ebece9e1ac5c99a11c4ea8
Jul 21 04:53:36.664782 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:36.664706    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2ac86d0-a708-47d4-aaa5-7ff981578219" path="/var/lib/kubelet/pods/f2ac86d0-a708-47d4-aaa5-7ff981578219/volumes"
Jul 21 04:53:36.718095 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:36.718071    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7815-140211182125680" event={"ID":"605c3720-d0cc-4440-a59b-6cd06f9aa45f","Type":"ContainerStarted","Data":"120bf49f25d16f562cf2dc12540956ed4286523d43ebece9e1ac5c99a11c4ea8"}
Jul 21 04:53:36.719344 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:36.719327    2576 scope.go:117] "RemoveContainer" containerID="74acef11c71eec21aafac0ff8936863b1ec92175f7ea799100c29bdc5b7d515a"
Jul 21 04:53:36.719415 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:36.719351    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182342448"
Jul 21 04:53:37.726706 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:37.726666    2576 generic.go:356] "Generic (PLEG): container finished" podID="605c3720-d0cc-4440-a59b-6cd06f9aa45f" containerID="0d99dd44f8bece387a3d4ffc90ede79c791c8c655f8c96b134332626751ed6cc" exitCode=0
Jul 21 04:53:37.727067 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:37.726736    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7815-140211182125680" event={"ID":"605c3720-d0cc-4440-a59b-6cd06f9aa45f","Type":"ContainerDied","Data":"0d99dd44f8bece387a3d4ffc90ede79c791c8c655f8c96b134332626751ed6cc"}
Jul 21 04:53:38.866426 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:38.866399    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182125680"
Jul 21 04:53:38.886600 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:38.886571    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7815-140211182125680_605c3720-d0cc-4440-a59b-6cd06f9aa45f/test-curl-7815-140211182125680/0.log"
Jul 21 04:53:38.910860 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:38.910837    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7815-140211182125680"]
Jul 21 04:53:38.914551 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:38.914530    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7815-140211182125680"]
Jul 21 04:53:38.946325 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:38.946301    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czh5l\" (UniqueName: \"kubernetes.io/projected/605c3720-d0cc-4440-a59b-6cd06f9aa45f-kube-api-access-czh5l\") pod \"605c3720-d0cc-4440-a59b-6cd06f9aa45f\" (UID: \"605c3720-d0cc-4440-a59b-6cd06f9aa45f\") "
Jul 21 04:53:38.948437 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:38.948410    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/605c3720-d0cc-4440-a59b-6cd06f9aa45f-kube-api-access-czh5l" (OuterVolumeSpecName: "kube-api-access-czh5l") pod "605c3720-d0cc-4440-a59b-6cd06f9aa45f" (UID: "605c3720-d0cc-4440-a59b-6cd06f9aa45f"). InnerVolumeSpecName "kube-api-access-czh5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:53:39.044099 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.044039    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7815-140211182125680"]
Jul 21 04:53:39.044372 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.044359    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="605c3720-d0cc-4440-a59b-6cd06f9aa45f" containerName="test-curl-7815-140211182125680"
Jul 21 04:53:39.044414 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.044374    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="605c3720-d0cc-4440-a59b-6cd06f9aa45f" containerName="test-curl-7815-140211182125680"
Jul 21 04:53:39.044461 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.044452    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="605c3720-d0cc-4440-a59b-6cd06f9aa45f" containerName="test-curl-7815-140211182125680"
Jul 21 04:53:39.047061 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.047042    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czh5l\" (UniqueName: \"kubernetes.io/projected/605c3720-d0cc-4440-a59b-6cd06f9aa45f-kube-api-access-czh5l\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:39.047417 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.047403    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182125680"
Jul 21 04:53:39.054795 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.054774    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7815-140211182125680"]
Jul 21 04:53:39.147903 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.147877    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7z99\" (UniqueName: \"kubernetes.io/projected/ec62c700-eeac-4c96-9599-a7708d0ee1f8-kube-api-access-b7z99\") pod \"test-curl-7815-140211182125680\" (UID: \"ec62c700-eeac-4c96-9599-a7708d0ee1f8\") " pod="opendatahub/test-curl-7815-140211182125680"
Jul 21 04:53:39.248958 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.248932    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7z99\" (UniqueName: \"kubernetes.io/projected/ec62c700-eeac-4c96-9599-a7708d0ee1f8-kube-api-access-b7z99\") pod \"test-curl-7815-140211182125680\" (UID: \"ec62c700-eeac-4c96-9599-a7708d0ee1f8\") " pod="opendatahub/test-curl-7815-140211182125680"
Jul 21 04:53:39.257076 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.257054    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7z99\" (UniqueName: \"kubernetes.io/projected/ec62c700-eeac-4c96-9599-a7708d0ee1f8-kube-api-access-b7z99\") pod \"test-curl-7815-140211182125680\" (UID: \"ec62c700-eeac-4c96-9599-a7708d0ee1f8\") " pod="opendatahub/test-curl-7815-140211182125680"
Jul 21 04:53:39.346266 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.346232    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:53:39.356841 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.356823    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182125680"
Jul 21 04:53:39.487544 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.487522    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7815-140211182125680"]
Jul 21 04:53:39.489304 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:53:39.489278    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec62c700_eeac_4c96_9599_a7708d0ee1f8.slice/crio-335a8d60f45a0e250383d0d8bc033119e9899a6ece9f2bd207d9d93e32466adc WatchSource:0}: Error finding container 335a8d60f45a0e250383d0d8bc033119e9899a6ece9f2bd207d9d93e32466adc: Status 404 returned error can't find the container with id 335a8d60f45a0e250383d0d8bc033119e9899a6ece9f2bd207d9d93e32466adc
Jul 21 04:53:39.738856 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.738788    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182125680"
Jul 21 04:53:39.738856 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.738821    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="120bf49f25d16f562cf2dc12540956ed4286523d43ebece9e1ac5c99a11c4ea8"
Jul 21 04:53:39.740067 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.740041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7815-140211182125680" event={"ID":"ec62c700-eeac-4c96-9599-a7708d0ee1f8","Type":"ContainerStarted","Data":"335a8d60f45a0e250383d0d8bc033119e9899a6ece9f2bd207d9d93e32466adc"}
Jul 21 04:53:39.750131 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:39.750094    2576 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7815-140211182125680" oldPodUID="605c3720-d0cc-4440-a59b-6cd06f9aa45f" podUID="ec62c700-eeac-4c96-9599-a7708d0ee1f8"
Jul 21 04:53:40.666340 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:40.666310    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="605c3720-d0cc-4440-a59b-6cd06f9aa45f" path="/var/lib/kubelet/pods/605c3720-d0cc-4440-a59b-6cd06f9aa45f/volumes"
Jul 21 04:53:40.746701 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:40.746665    2576 generic.go:356] "Generic (PLEG): container finished" podID="ec62c700-eeac-4c96-9599-a7708d0ee1f8" containerID="30dd678cb007b2c3b71a6ee0a8302aaa24c8b37a6647d05fb65ee64a3325a3d1" exitCode=0
Jul 21 04:53:40.746849 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:40.746718    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7815-140211182125680" event={"ID":"ec62c700-eeac-4c96-9599-a7708d0ee1f8","Type":"ContainerDied","Data":"30dd678cb007b2c3b71a6ee0a8302aaa24c8b37a6647d05fb65ee64a3325a3d1"}
Jul 21 04:53:41.885547 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:41.885526    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182125680"
Jul 21 04:53:41.906229 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:41.906207    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7815-140211182125680_ec62c700-eeac-4c96-9599-a7708d0ee1f8/test-curl-7815-140211182125680/0.log"
Jul 21 04:53:41.931277 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:41.931251    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7815-140211182125680"]
Jul 21 04:53:41.935776 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:41.935755    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7815-140211182125680"]
Jul 21 04:53:41.974024 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:41.973997    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7z99\" (UniqueName: \"kubernetes.io/projected/ec62c700-eeac-4c96-9599-a7708d0ee1f8-kube-api-access-b7z99\") pod \"ec62c700-eeac-4c96-9599-a7708d0ee1f8\" (UID: \"ec62c700-eeac-4c96-9599-a7708d0ee1f8\") "
Jul 21 04:53:41.976142 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:41.976114    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec62c700-eeac-4c96-9599-a7708d0ee1f8-kube-api-access-b7z99" (OuterVolumeSpecName: "kube-api-access-b7z99") pod "ec62c700-eeac-4c96-9599-a7708d0ee1f8" (UID: "ec62c700-eeac-4c96-9599-a7708d0ee1f8"). InnerVolumeSpecName "kube-api-access-b7z99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:53:42.062202 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:42.062147    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7815-140211182126688"]
Jul 21 04:53:42.062499 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:42.062486    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec62c700-eeac-4c96-9599-a7708d0ee1f8" containerName="test-curl-7815-140211182125680"
Jul 21 04:53:42.062547 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:42.062501    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec62c700-eeac-4c96-9599-a7708d0ee1f8" containerName="test-curl-7815-140211182125680"
Jul 21 04:53:42.062582 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:42.062559    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec62c700-eeac-4c96-9599-a7708d0ee1f8" containerName="test-curl-7815-140211182125680"
Jul 21 04:53:42.065561 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:42.065547    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182126688"
Jul 21 04:53:42.070502 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:42.070475    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7815-140211182126688"]
Jul 21 04:53:42.074946 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:42.074925    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7z99\" (UniqueName: \"kubernetes.io/projected/ec62c700-eeac-4c96-9599-a7708d0ee1f8-kube-api-access-b7z99\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:42.176402 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:42.176367    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nd4g\" (UniqueName: \"kubernetes.io/projected/e740da6f-4c4e-4bac-a2ad-db9ad38d8692-kube-api-access-2nd4g\") pod \"test-curl-7815-140211182126688\" (UID: \"e740da6f-4c4e-4bac-a2ad-db9ad38d8692\") " pod="opendatahub/test-curl-7815-140211182126688"
Jul 21 04:53:42.277448 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:42.277408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nd4g\" (UniqueName: \"kubernetes.io/projected/e740da6f-4c4e-4bac-a2ad-db9ad38d8692-kube-api-access-2nd4g\") pod \"test-curl-7815-140211182126688\" (UID: \"e740da6f-4c4e-4bac-a2ad-db9ad38d8692\") " pod="opendatahub/test-curl-7815-140211182126688"
Jul 21 04:53:42.285533 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:42.285501    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nd4g\" (UniqueName: \"kubernetes.io/projected/e740da6f-4c4e-4bac-a2ad-db9ad38d8692-kube-api-access-2nd4g\") pod \"test-curl-7815-140211182126688\" (UID: \"e740da6f-4c4e-4bac-a2ad-db9ad38d8692\") " pod="opendatahub/test-curl-7815-140211182126688"
Jul 21 04:53:42.375708 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:42.375684    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182126688"
Jul 21 04:53:42.664974 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:42.664896    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec62c700-eeac-4c96-9599-a7708d0ee1f8" path="/var/lib/kubelet/pods/ec62c700-eeac-4c96-9599-a7708d0ee1f8/volumes"
Jul 21 04:53:42.710710 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:42.710688    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7815-140211182126688"]
Jul 21 04:53:42.712534 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:53:42.712505    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode740da6f_4c4e_4bac_a2ad_db9ad38d8692.slice/crio-4996dc33ac6fdfd5328ef2ba390aab727b1c36d8cac9d127784616de16e05157 WatchSource:0}: Error finding container 4996dc33ac6fdfd5328ef2ba390aab727b1c36d8cac9d127784616de16e05157: Status 404 returned error can't find the container with id 4996dc33ac6fdfd5328ef2ba390aab727b1c36d8cac9d127784616de16e05157
Jul 21 04:53:42.757835 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:42.757810    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7815-140211182126688" event={"ID":"e740da6f-4c4e-4bac-a2ad-db9ad38d8692","Type":"ContainerStarted","Data":"4996dc33ac6fdfd5328ef2ba390aab727b1c36d8cac9d127784616de16e05157"}
Jul 21 04:53:42.758958 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:42.758913    2576 scope.go:117] "RemoveContainer" containerID="30dd678cb007b2c3b71a6ee0a8302aaa24c8b37a6647d05fb65ee64a3325a3d1"
Jul 21 04:53:42.759038 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:42.758940    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182125680"
Jul 21 04:53:43.185159 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.185122    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk" podUID="2838b60b-a07a-4337-bcfe-799c37544c04" containerName="main" containerID="cri-o://a7713cb3de408f8feae28c9504edb7a32cb58f131ec02ea4457b023a143d014f" gracePeriod=45
Jul 21 04:53:43.434995 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.434971    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:53:43.489109 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.489079    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-dshm\") pod \"2838b60b-a07a-4337-bcfe-799c37544c04\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") "
Jul 21 04:53:43.489235 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.489124    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2838b60b-a07a-4337-bcfe-799c37544c04-tls-certs\") pod \"2838b60b-a07a-4337-bcfe-799c37544c04\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") "
Jul 21 04:53:43.489235 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.489193    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96ghq\" (UniqueName: \"kubernetes.io/projected/2838b60b-a07a-4337-bcfe-799c37544c04-kube-api-access-96ghq\") pod \"2838b60b-a07a-4337-bcfe-799c37544c04\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") "
Jul 21 04:53:43.489235 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.489208    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-tmp-dir\") pod \"2838b60b-a07a-4337-bcfe-799c37544c04\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") "
Jul 21 04:53:43.489355 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.489235    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-model-cache\") pod \"2838b60b-a07a-4337-bcfe-799c37544c04\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") "
Jul 21 04:53:43.489355 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.489323    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-home\") pod \"2838b60b-a07a-4337-bcfe-799c37544c04\" (UID: \"2838b60b-a07a-4337-bcfe-799c37544c04\") "
Jul 21 04:53:43.489544 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.489471    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2838b60b-a07a-4337-bcfe-799c37544c04" (UID: "2838b60b-a07a-4337-bcfe-799c37544c04"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:53:43.489544 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.489483    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-model-cache" (OuterVolumeSpecName: "model-cache") pod "2838b60b-a07a-4337-bcfe-799c37544c04" (UID: "2838b60b-a07a-4337-bcfe-799c37544c04"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:53:43.489783 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.489652    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-home" (OuterVolumeSpecName: "home") pod "2838b60b-a07a-4337-bcfe-799c37544c04" (UID: "2838b60b-a07a-4337-bcfe-799c37544c04"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:53:43.489783 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.489748    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-tmp-dir\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:43.489783 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.489769    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-model-cache\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:43.489783 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.489783    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-home\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:43.491349 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.491326    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-dshm" (OuterVolumeSpecName: "dshm") pod "2838b60b-a07a-4337-bcfe-799c37544c04" (UID: "2838b60b-a07a-4337-bcfe-799c37544c04"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:53:43.491446 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.491413    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2838b60b-a07a-4337-bcfe-799c37544c04-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2838b60b-a07a-4337-bcfe-799c37544c04" (UID: "2838b60b-a07a-4337-bcfe-799c37544c04"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:53:43.491488 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.491449    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2838b60b-a07a-4337-bcfe-799c37544c04-kube-api-access-96ghq" (OuterVolumeSpecName: "kube-api-access-96ghq") pod "2838b60b-a07a-4337-bcfe-799c37544c04" (UID: "2838b60b-a07a-4337-bcfe-799c37544c04"). InnerVolumeSpecName "kube-api-access-96ghq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:53:43.590857 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.590829    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2838b60b-a07a-4337-bcfe-799c37544c04-dshm\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:43.590857 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.590854    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2838b60b-a07a-4337-bcfe-799c37544c04-tls-certs\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:43.591018 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.590863    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96ghq\" (UniqueName: \"kubernetes.io/projected/2838b60b-a07a-4337-bcfe-799c37544c04-kube-api-access-96ghq\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:43.765656 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.765612    2576 generic.go:356] "Generic (PLEG): container finished" podID="e740da6f-4c4e-4bac-a2ad-db9ad38d8692" containerID="f330fd80f9bd8c96023ab00bd854b3bc0fd83e4d7f9b460e3cdb2338d266a70e" exitCode=0
Jul 21 04:53:43.765825 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.765678    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7815-140211182126688" event={"ID":"e740da6f-4c4e-4bac-a2ad-db9ad38d8692","Type":"ContainerDied","Data":"f330fd80f9bd8c96023ab00bd854b3bc0fd83e4d7f9b460e3cdb2338d266a70e"}
Jul 21 04:53:43.767741 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.767720    2576 generic.go:356] "Generic (PLEG): container finished" podID="2838b60b-a07a-4337-bcfe-799c37544c04" containerID="a7713cb3de408f8feae28c9504edb7a32cb58f131ec02ea4457b023a143d014f" exitCode=0
Jul 21 04:53:43.767872 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.767756    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"
Jul 21 04:53:43.767872 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.767799    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk" event={"ID":"2838b60b-a07a-4337-bcfe-799c37544c04","Type":"ContainerDied","Data":"a7713cb3de408f8feae28c9504edb7a32cb58f131ec02ea4457b023a143d014f"}
Jul 21 04:53:43.767872 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.767830    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk" event={"ID":"2838b60b-a07a-4337-bcfe-799c37544c04","Type":"ContainerDied","Data":"a5530cc9c6dc35fbe93f6c313c1f9f7a6b8566239f624253af08d3325a6c4cd9"}
Jul 21 04:53:43.767872 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.767848    2576 scope.go:117] "RemoveContainer" containerID="a7713cb3de408f8feae28c9504edb7a32cb58f131ec02ea4457b023a143d014f"
Jul 21 04:53:43.777359 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.777343    2576 scope.go:117] "RemoveContainer" containerID="a7713cb3de408f8feae28c9504edb7a32cb58f131ec02ea4457b023a143d014f"
Jul 21 04:53:43.777647 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:53:43.777618    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7713cb3de408f8feae28c9504edb7a32cb58f131ec02ea4457b023a143d014f\": container with ID starting with a7713cb3de408f8feae28c9504edb7a32cb58f131ec02ea4457b023a143d014f not found: ID does not exist" containerID="a7713cb3de408f8feae28c9504edb7a32cb58f131ec02ea4457b023a143d014f"
Jul 21 04:53:43.777705 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.777668    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7713cb3de408f8feae28c9504edb7a32cb58f131ec02ea4457b023a143d014f"} err="failed to get container status \"a7713cb3de408f8feae28c9504edb7a32cb58f131ec02ea4457b023a143d014f\": rpc error: code = NotFound desc = could not find container \"a7713cb3de408f8feae28c9504edb7a32cb58f131ec02ea4457b023a143d014f\": container with ID starting with a7713cb3de408f8feae28c9504edb7a32cb58f131ec02ea4457b023a143d014f not found: ID does not exist"
Jul 21 04:53:43.793057 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.793029    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"]
Jul 21 04:53:43.796839 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:43.796819    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e19fee/rate-test-model-e19fee-kserve-5fffc88cdc-rvchk"]
Jul 21 04:53:44.183192 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.183086    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k" podUID="1882b838-a7cf-4cb9-b428-b14f347eaac7" containerName="main" containerID="cri-o://5782df2df921e4a69758f3847f3044d9404b191fdeb081ed9ea61265975f3111" gracePeriod=45
Jul 21 04:53:44.441792 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.441738    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:53:44.498598 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.498571    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1882b838-a7cf-4cb9-b428-b14f347eaac7-tls-certs\") pod \"1882b838-a7cf-4cb9-b428-b14f347eaac7\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") "
Jul 21 04:53:44.498776 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.498610    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-home\") pod \"1882b838-a7cf-4cb9-b428-b14f347eaac7\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") "
Jul 21 04:53:44.498776 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.498726    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4jj7\" (UniqueName: \"kubernetes.io/projected/1882b838-a7cf-4cb9-b428-b14f347eaac7-kube-api-access-p4jj7\") pod \"1882b838-a7cf-4cb9-b428-b14f347eaac7\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") "
Jul 21 04:53:44.498776 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.498745    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-dshm\") pod \"1882b838-a7cf-4cb9-b428-b14f347eaac7\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") "
Jul 21 04:53:44.498943 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.498794    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-model-cache\") pod \"1882b838-a7cf-4cb9-b428-b14f347eaac7\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") "
Jul 21 04:53:44.498943 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.498835    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-tmp-dir\") pod \"1882b838-a7cf-4cb9-b428-b14f347eaac7\" (UID: \"1882b838-a7cf-4cb9-b428-b14f347eaac7\") "
Jul 21 04:53:44.498943 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.498916    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-home" (OuterVolumeSpecName: "home") pod "1882b838-a7cf-4cb9-b428-b14f347eaac7" (UID: "1882b838-a7cf-4cb9-b428-b14f347eaac7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:53:44.499155 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.499130    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-model-cache" (OuterVolumeSpecName: "model-cache") pod "1882b838-a7cf-4cb9-b428-b14f347eaac7" (UID: "1882b838-a7cf-4cb9-b428-b14f347eaac7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:53:44.499155 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.499141    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1882b838-a7cf-4cb9-b428-b14f347eaac7" (UID: "1882b838-a7cf-4cb9-b428-b14f347eaac7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:53:44.499406 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.499167    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-home\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:44.500849 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.500829    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-dshm" (OuterVolumeSpecName: "dshm") pod "1882b838-a7cf-4cb9-b428-b14f347eaac7" (UID: "1882b838-a7cf-4cb9-b428-b14f347eaac7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:53:44.500955 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.500926    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1882b838-a7cf-4cb9-b428-b14f347eaac7-kube-api-access-p4jj7" (OuterVolumeSpecName: "kube-api-access-p4jj7") pod "1882b838-a7cf-4cb9-b428-b14f347eaac7" (UID: "1882b838-a7cf-4cb9-b428-b14f347eaac7"). InnerVolumeSpecName "kube-api-access-p4jj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:53:44.500995 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.500974    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1882b838-a7cf-4cb9-b428-b14f347eaac7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1882b838-a7cf-4cb9-b428-b14f347eaac7" (UID: "1882b838-a7cf-4cb9-b428-b14f347eaac7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:53:44.600395 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.600370    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-tmp-dir\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:44.600395 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.600390    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1882b838-a7cf-4cb9-b428-b14f347eaac7-tls-certs\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:44.600527 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.600399    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4jj7\" (UniqueName: \"kubernetes.io/projected/1882b838-a7cf-4cb9-b428-b14f347eaac7-kube-api-access-p4jj7\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:44.600527 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.600407    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-dshm\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:44.600527 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.600417    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1882b838-a7cf-4cb9-b428-b14f347eaac7-model-cache\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:44.664323 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.664292    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2838b60b-a07a-4337-bcfe-799c37544c04" path="/var/lib/kubelet/pods/2838b60b-a07a-4337-bcfe-799c37544c04/volumes"
Jul 21 04:53:44.774455 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.774395    2576 generic.go:356] "Generic (PLEG): container finished" podID="1882b838-a7cf-4cb9-b428-b14f347eaac7" containerID="5782df2df921e4a69758f3847f3044d9404b191fdeb081ed9ea61265975f3111" exitCode=0
Jul 21 04:53:44.774455 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.774438    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"
Jul 21 04:53:44.774601 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.774431    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k" event={"ID":"1882b838-a7cf-4cb9-b428-b14f347eaac7","Type":"ContainerDied","Data":"5782df2df921e4a69758f3847f3044d9404b191fdeb081ed9ea61265975f3111"}
Jul 21 04:53:44.774601 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.774542    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k" event={"ID":"1882b838-a7cf-4cb9-b428-b14f347eaac7","Type":"ContainerDied","Data":"30693db41012c9b1c176e027feb0c6212b192fea64aadfae2109527d1de649ff"}
Jul 21 04:53:44.774601 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.774564    2576 scope.go:117] "RemoveContainer" containerID="5782df2df921e4a69758f3847f3044d9404b191fdeb081ed9ea61265975f3111"
Jul 21 04:53:44.783793 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.783770    2576 scope.go:117] "RemoveContainer" containerID="5782df2df921e4a69758f3847f3044d9404b191fdeb081ed9ea61265975f3111"
Jul 21 04:53:44.784041 ip-10-0-130-0 kubenswrapper[2576]: E0721 04:53:44.784022    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5782df2df921e4a69758f3847f3044d9404b191fdeb081ed9ea61265975f3111\": container with ID starting with 5782df2df921e4a69758f3847f3044d9404b191fdeb081ed9ea61265975f3111 not found: ID does not exist" containerID="5782df2df921e4a69758f3847f3044d9404b191fdeb081ed9ea61265975f3111"
Jul 21 04:53:44.784117 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.784051    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5782df2df921e4a69758f3847f3044d9404b191fdeb081ed9ea61265975f3111"} err="failed to get container status \"5782df2df921e4a69758f3847f3044d9404b191fdeb081ed9ea61265975f3111\": rpc error: code = NotFound desc = could not find container \"5782df2df921e4a69758f3847f3044d9404b191fdeb081ed9ea61265975f3111\": container with ID starting with 5782df2df921e4a69758f3847f3044d9404b191fdeb081ed9ea61265975f3111 not found: ID does not exist"
Jul 21 04:53:44.790926 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.790903    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"]
Jul 21 04:53:44.795132 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.795111    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-cfd2ba/rate-test-model-cfd2ba-kserve-7df9fb9c87-s8q7k"]
Jul 21 04:53:44.917027 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.917007    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182126688"
Jul 21 04:53:44.936026 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.936004    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7815-140211182126688_e740da6f-4c4e-4bac-a2ad-db9ad38d8692/test-curl-7815-140211182126688/0.log"
Jul 21 04:53:44.960792 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.960768    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7815-140211182126688"]
Jul 21 04:53:44.964175 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:44.964154    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7815-140211182126688"]
Jul 21 04:53:45.003098 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.003072    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nd4g\" (UniqueName: \"kubernetes.io/projected/e740da6f-4c4e-4bac-a2ad-db9ad38d8692-kube-api-access-2nd4g\") pod \"e740da6f-4c4e-4bac-a2ad-db9ad38d8692\" (UID: \"e740da6f-4c4e-4bac-a2ad-db9ad38d8692\") "
Jul 21 04:53:45.005230 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.005208    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e740da6f-4c4e-4bac-a2ad-db9ad38d8692-kube-api-access-2nd4g" (OuterVolumeSpecName: "kube-api-access-2nd4g") pod "e740da6f-4c4e-4bac-a2ad-db9ad38d8692" (UID: "e740da6f-4c4e-4bac-a2ad-db9ad38d8692"). InnerVolumeSpecName "kube-api-access-2nd4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:53:45.086291 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.086260    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7815-140211182126688"]
Jul 21 04:53:45.086675 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.086653    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e740da6f-4c4e-4bac-a2ad-db9ad38d8692" containerName="test-curl-7815-140211182126688"
Jul 21 04:53:45.086675 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.086675    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e740da6f-4c4e-4bac-a2ad-db9ad38d8692" containerName="test-curl-7815-140211182126688"
Jul 21 04:53:45.086817 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.086716    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1882b838-a7cf-4cb9-b428-b14f347eaac7" containerName="main"
Jul 21 04:53:45.086817 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.086727    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1882b838-a7cf-4cb9-b428-b14f347eaac7" containerName="main"
Jul 21 04:53:45.086817 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.086744    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2838b60b-a07a-4337-bcfe-799c37544c04" containerName="main"
Jul 21 04:53:45.086817 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.086752    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2838b60b-a07a-4337-bcfe-799c37544c04" containerName="main"
Jul 21 04:53:45.087006 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.086841    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2838b60b-a07a-4337-bcfe-799c37544c04" containerName="main"
Jul 21 04:53:45.087006 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.086852    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1882b838-a7cf-4cb9-b428-b14f347eaac7" containerName="main"
Jul 21 04:53:45.087006 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.086866    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e740da6f-4c4e-4bac-a2ad-db9ad38d8692" containerName="test-curl-7815-140211182126688"
Jul 21 04:53:45.089935 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.089917    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182126688"
Jul 21 04:53:45.095086 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.095063    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7815-140211182126688"]
Jul 21 04:53:45.103997 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.103975    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nd4g\" (UniqueName: \"kubernetes.io/projected/e740da6f-4c4e-4bac-a2ad-db9ad38d8692-kube-api-access-2nd4g\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:45.204995 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.204971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h962\" (UniqueName: \"kubernetes.io/projected/baef8a74-74ef-4c6b-917c-b1947571d184-kube-api-access-8h962\") pod \"test-curl-7815-140211182126688\" (UID: \"baef8a74-74ef-4c6b-917c-b1947571d184\") " pod="opendatahub/test-curl-7815-140211182126688"
Jul 21 04:53:45.305835 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.305801    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h962\" (UniqueName: \"kubernetes.io/projected/baef8a74-74ef-4c6b-917c-b1947571d184-kube-api-access-8h962\") pod \"test-curl-7815-140211182126688\" (UID: \"baef8a74-74ef-4c6b-917c-b1947571d184\") " pod="opendatahub/test-curl-7815-140211182126688"
Jul 21 04:53:45.313747 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.313725    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h962\" (UniqueName: \"kubernetes.io/projected/baef8a74-74ef-4c6b-917c-b1947571d184-kube-api-access-8h962\") pod \"test-curl-7815-140211182126688\" (UID: \"baef8a74-74ef-4c6b-917c-b1947571d184\") " pod="opendatahub/test-curl-7815-140211182126688"
Jul 21 04:53:45.400080 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.400012    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182126688"
Jul 21 04:53:45.738229 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.738203    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7815-140211182126688"]
Jul 21 04:53:45.739758 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:53:45.739724    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbaef8a74_74ef_4c6b_917c_b1947571d184.slice/crio-e5e18f97f730a106c75897c9d0f486c2e75b933fd8b423303feb973b33bae451 WatchSource:0}: Error finding container e5e18f97f730a106c75897c9d0f486c2e75b933fd8b423303feb973b33bae451: Status 404 returned error can't find the container with id e5e18f97f730a106c75897c9d0f486c2e75b933fd8b423303feb973b33bae451
Jul 21 04:53:45.782700 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.782675    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4996dc33ac6fdfd5328ef2ba390aab727b1c36d8cac9d127784616de16e05157"
Jul 21 04:53:45.782700 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.782692    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182126688"
Jul 21 04:53:45.783854 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.783831    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7815-140211182126688" event={"ID":"baef8a74-74ef-4c6b-917c-b1947571d184","Type":"ContainerStarted","Data":"e5e18f97f730a106c75897c9d0f486c2e75b933fd8b423303feb973b33bae451"}
Jul 21 04:53:45.793732 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:45.793710    2576 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7815-140211182126688" oldPodUID="e740da6f-4c4e-4bac-a2ad-db9ad38d8692" podUID="baef8a74-74ef-4c6b-917c-b1947571d184"
Jul 21 04:53:46.664072 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:46.664039    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1882b838-a7cf-4cb9-b428-b14f347eaac7" path="/var/lib/kubelet/pods/1882b838-a7cf-4cb9-b428-b14f347eaac7/volumes"
Jul 21 04:53:46.664380 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:46.664366    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e740da6f-4c4e-4bac-a2ad-db9ad38d8692" path="/var/lib/kubelet/pods/e740da6f-4c4e-4bac-a2ad-db9ad38d8692/volumes"
Jul 21 04:53:46.790257 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:46.790224    2576 generic.go:356] "Generic (PLEG): container finished" podID="baef8a74-74ef-4c6b-917c-b1947571d184" containerID="3b8556eb400c2288fb64c271888b8f7d619aa320a255bd276085c6960dcc9753" exitCode=0
Jul 21 04:53:46.790574 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:46.790274    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7815-140211182126688" event={"ID":"baef8a74-74ef-4c6b-917c-b1947571d184","Type":"ContainerDied","Data":"3b8556eb400c2288fb64c271888b8f7d619aa320a255bd276085c6960dcc9753"}
Jul 21 04:53:47.926901 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:47.926876    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182126688"
Jul 21 04:53:47.947501 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:47.947477    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7815-140211182126688_baef8a74-74ef-4c6b-917c-b1947571d184/test-curl-7815-140211182126688/0.log"
Jul 21 04:53:47.976096 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:47.976074    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7815-140211182126688"]
Jul 21 04:53:47.979482 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:47.979461    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7815-140211182126688"]
Jul 21 04:53:48.028564 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.028542    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8h962\" (UniqueName: \"kubernetes.io/projected/baef8a74-74ef-4c6b-917c-b1947571d184-kube-api-access-8h962\") pod \"baef8a74-74ef-4c6b-917c-b1947571d184\" (UID: \"baef8a74-74ef-4c6b-917c-b1947571d184\") "
Jul 21 04:53:48.030742 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.030715    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baef8a74-74ef-4c6b-917c-b1947571d184-kube-api-access-8h962" (OuterVolumeSpecName: "kube-api-access-8h962") pod "baef8a74-74ef-4c6b-917c-b1947571d184" (UID: "baef8a74-74ef-4c6b-917c-b1947571d184"). InnerVolumeSpecName "kube-api-access-8h962". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:53:48.129949 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.129921    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8h962\" (UniqueName: \"kubernetes.io/projected/baef8a74-74ef-4c6b-917c-b1947571d184-kube-api-access-8h962\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:48.166776 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.166747    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp"]
Jul 21 04:53:48.167093 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.167081    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baef8a74-74ef-4c6b-917c-b1947571d184" containerName="test-curl-7815-140211182126688"
Jul 21 04:53:48.167137 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.167095    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="baef8a74-74ef-4c6b-917c-b1947571d184" containerName="test-curl-7815-140211182126688"
Jul 21 04:53:48.167172 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.167161    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="baef8a74-74ef-4c6b-917c-b1947571d184" containerName="test-curl-7815-140211182126688"
Jul 21 04:53:48.170336 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.170320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp"
Jul 21 04:53:48.172780 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.172760    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 04:53:48.172884 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.172869    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k4z5s\""
Jul 21 04:53:48.178562 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.178541    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp"]
Jul 21 04:53:48.230538 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.230513    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c664680-b928-46ce-858d-71f135310cd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp\" (UID: \"7c664680-b928-46ce-858d-71f135310cd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp"
Jul 21 04:53:48.331117 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.331090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c664680-b928-46ce-858d-71f135310cd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp\" (UID: \"7c664680-b928-46ce-858d-71f135310cd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp"
Jul 21 04:53:48.331683 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.331666    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c664680-b928-46ce-858d-71f135310cd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp\" (UID: \"7c664680-b928-46ce-858d-71f135310cd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp"
Jul 21 04:53:48.481288 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.481216    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp"
Jul 21 04:53:48.619977 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.619949    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp"]
Jul 21 04:53:48.621555 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:53:48.621528    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c664680_b928_46ce_858d_71f135310cd6.slice/crio-661b09148bfc271ba4f560ebfc4c71fa4d8d612ef8d46402dec4a4ea5dec9291 WatchSource:0}: Error finding container 661b09148bfc271ba4f560ebfc4c71fa4d8d612ef8d46402dec4a4ea5dec9291: Status 404 returned error can't find the container with id 661b09148bfc271ba4f560ebfc4c71fa4d8d612ef8d46402dec4a4ea5dec9291
Jul 21 04:53:48.665169 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.665142    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baef8a74-74ef-4c6b-917c-b1947571d184" path="/var/lib/kubelet/pods/baef8a74-74ef-4c6b-917c-b1947571d184/volumes"
Jul 21 04:53:48.802841 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.802818    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7815-140211182126688"
Jul 21 04:53:48.802841 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.802831    2576 scope.go:117] "RemoveContainer" containerID="3b8556eb400c2288fb64c271888b8f7d619aa320a255bd276085c6960dcc9753"
Jul 21 04:53:48.804255 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:48.804229    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp" event={"ID":"7c664680-b928-46ce-858d-71f135310cd6","Type":"ContainerStarted","Data":"661b09148bfc271ba4f560ebfc4c71fa4d8d612ef8d46402dec4a4ea5dec9291"}
Jul 21 04:53:49.811998 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:49.811904    2576 generic.go:356] "Generic (PLEG): container finished" podID="7c664680-b928-46ce-858d-71f135310cd6" containerID="cf9bedfa3f3e5988c34f030f2c45c3846e5dbae592dc84f9c2e1e8bb5b54c2e3" exitCode=0
Jul 21 04:53:49.812356 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:49.811993    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp" event={"ID":"7c664680-b928-46ce-858d-71f135310cd6","Type":"ContainerDied","Data":"cf9bedfa3f3e5988c34f030f2c45c3846e5dbae592dc84f9c2e1e8bb5b54c2e3"}
Jul 21 04:53:50.957061 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:50.957036    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp"
Jul 21 04:53:51.054568 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:51.054534    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c664680-b928-46ce-858d-71f135310cd6-maas-api-service-ca\") pod \"7c664680-b928-46ce-858d-71f135310cd6\" (UID: \"7c664680-b928-46ce-858d-71f135310cd6\") "
Jul 21 04:53:51.054924 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:51.054899    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c664680-b928-46ce-858d-71f135310cd6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7c664680-b928-46ce-858d-71f135310cd6" (UID: "7c664680-b928-46ce-858d-71f135310cd6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:53:51.155717 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:51.155683    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c664680-b928-46ce-858d-71f135310cd6-maas-api-service-ca\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:53:51.824088 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:51.824051    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp"
Jul 21 04:53:51.824088 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:51.824079    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp" event={"ID":"7c664680-b928-46ce-858d-71f135310cd6","Type":"ContainerDied","Data":"661b09148bfc271ba4f560ebfc4c71fa4d8d612ef8d46402dec4a4ea5dec9291"}
Jul 21 04:53:51.824355 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:53:51.824129    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="661b09148bfc271ba4f560ebfc4c71fa4d8d612ef8d46402dec4a4ea5dec9291"
Jul 21 04:54:01.368386 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:01.368353    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:54:03.265453 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:03.265418    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp"]
Jul 21 04:54:03.268264 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:03.268238    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e19fee-88rlp"]
Jul 21 04:54:04.664610 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:04.664566    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c664680-b928-46ce-858d-71f135310cd6" path="/var/lib/kubelet/pods/7c664680-b928-46ce-858d-71f135310cd6/volumes"
Jul 21 04:54:10.166255 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:10.166213    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24"]
Jul 21 04:54:10.166631 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:10.166582    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c664680-b928-46ce-858d-71f135310cd6" containerName="revoke-keys"
Jul 21 04:54:10.166631 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:10.166593    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c664680-b928-46ce-858d-71f135310cd6" containerName="revoke-keys"
Jul 21 04:54:10.166730 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:10.166679    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c664680-b928-46ce-858d-71f135310cd6" containerName="revoke-keys"
Jul 21 04:54:10.171483 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:10.171465    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24"
Jul 21 04:54:10.174965 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:10.174944    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k4z5s\""
Jul 21 04:54:10.175119 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:10.174942    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 04:54:10.176186 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:10.176152    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24"]
Jul 21 04:54:10.219666 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:10.219603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d810f55-25c5-44dc-b164-274acb2cc7ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24\" (UID: \"1d810f55-25c5-44dc-b164-274acb2cc7ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24"
Jul 21 04:54:10.320812 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:10.320776    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d810f55-25c5-44dc-b164-274acb2cc7ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24\" (UID: \"1d810f55-25c5-44dc-b164-274acb2cc7ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24"
Jul 21 04:54:10.321382 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:10.321362    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d810f55-25c5-44dc-b164-274acb2cc7ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24\" (UID: \"1d810f55-25c5-44dc-b164-274acb2cc7ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24"
Jul 21 04:54:10.483932 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:10.483856    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24"
Jul 21 04:54:10.620203 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:10.620168    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24"]
Jul 21 04:54:10.622033 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:54:10.622004    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d810f55_25c5_44dc_b164_274acb2cc7ce.slice/crio-325ca33132a66addd73f44fee7af91cb977e014b0a3882971b1baaf6da88f6f2 WatchSource:0}: Error finding container 325ca33132a66addd73f44fee7af91cb977e014b0a3882971b1baaf6da88f6f2: Status 404 returned error can't find the container with id 325ca33132a66addd73f44fee7af91cb977e014b0a3882971b1baaf6da88f6f2
Jul 21 04:54:10.932153 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:10.932114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24" event={"ID":"1d810f55-25c5-44dc-b164-274acb2cc7ce","Type":"ContainerStarted","Data":"f762fb853470f3d41c8b3b1cb97c0788362efceacd945555c4233b22532230f6"}
Jul 21 04:54:10.932351 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:10.932165    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24" event={"ID":"1d810f55-25c5-44dc-b164-274acb2cc7ce","Type":"ContainerStarted","Data":"325ca33132a66addd73f44fee7af91cb977e014b0a3882971b1baaf6da88f6f2"}
Jul 21 04:54:10.949432 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:10.949387    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24" podStartSLOduration=0.949372753 podStartE2EDuration="949.372753ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:54:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:54:10.947050897 +0000 UTC m=+3000.764617679" watchObservedRunningTime="2026-07-21 04:54:10.949372753 +0000 UTC m=+3000.766939536"
Jul 21 04:54:11.072055 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:11.072028    2576 scope.go:117] "RemoveContainer" containerID="dcc4e4e1fe9ca1bdf8aa3df9696632c0068c6dd5e7d96332c3aaf16b22de8af2"
Jul 21 04:54:11.939879 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:11.939842    2576 generic.go:356] "Generic (PLEG): container finished" podID="1d810f55-25c5-44dc-b164-274acb2cc7ce" containerID="f762fb853470f3d41c8b3b1cb97c0788362efceacd945555c4233b22532230f6" exitCode=0
Jul 21 04:54:11.940235 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:11.939932    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24" event={"ID":"1d810f55-25c5-44dc-b164-274acb2cc7ce","Type":"ContainerDied","Data":"f762fb853470f3d41c8b3b1cb97c0788362efceacd945555c4233b22532230f6"}
Jul 21 04:54:12.539124 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:12.539004    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:54:12.563522 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:12.548057    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whzmq_62b33fd8-dca9-4044-af2f-c5b95fa52da7/ovn-acl-logging/0.log"
Jul 21 04:54:13.078464 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:13.078443    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24"
Jul 21 04:54:13.142448 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:13.142415    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d810f55-25c5-44dc-b164-274acb2cc7ce-maas-api-service-ca\") pod \"1d810f55-25c5-44dc-b164-274acb2cc7ce\" (UID: \"1d810f55-25c5-44dc-b164-274acb2cc7ce\") "
Jul 21 04:54:13.142766 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:13.142745    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d810f55-25c5-44dc-b164-274acb2cc7ce-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1d810f55-25c5-44dc-b164-274acb2cc7ce" (UID: "1d810f55-25c5-44dc-b164-274acb2cc7ce"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:54:13.243921 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:13.243837    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d810f55-25c5-44dc-b164-274acb2cc7ce-maas-api-service-ca\") on node \"ip-10-0-130-0.ec2.internal\" DevicePath \"\""
Jul 21 04:54:13.951580 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:13.951553    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24"
Jul 21 04:54:13.951783 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:13.951585    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24" event={"ID":"1d810f55-25c5-44dc-b164-274acb2cc7ce","Type":"ContainerDied","Data":"325ca33132a66addd73f44fee7af91cb977e014b0a3882971b1baaf6da88f6f2"}
Jul 21 04:54:13.951783 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:13.951659    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="325ca33132a66addd73f44fee7af91cb977e014b0a3882971b1baaf6da88f6f2"
Jul 21 04:54:23.341857 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:23.341823    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f6qm5"]
Jul 21 04:54:25.261247 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:25.261205    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24"]
Jul 21 04:54:25.262956 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:25.262929    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfd2ba-5tq24"]
Jul 21 04:54:26.664576 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:26.664528    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d810f55-25c5-44dc-b164-274acb2cc7ce" path="/var/lib/kubelet/pods/1d810f55-25c5-44dc-b164-274acb2cc7ce/volumes"
Jul 21 04:54:32.690869 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:32.690832    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59b45c9589-fwxm2_74d05fa2-78ec-46d7-a2a7-7f777db24707/authorino/0.log"
Jul 21 04:54:39.190778 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:39.190744    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6b969ff8-k6hpc_55298097-791a-4abc-a613-772bfe062fd1/copy-manifests/0.log"
Jul 21 04:54:39.203752 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:39.203723    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6b969ff8-k6hpc_55298097-791a-4abc-a613-772bfe062fd1/manager/0.log"
Jul 21 04:54:40.890896 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:40.890860    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2_4faa6cb7-4b22-439b-93ae-039240a2a0b3/util/0.log"
Jul 21 04:54:40.898206 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:40.898180    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2_4faa6cb7-4b22-439b-93ae-039240a2a0b3/pull/0.log"
Jul 21 04:54:40.904874 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:40.904848    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2_4faa6cb7-4b22-439b-93ae-039240a2a0b3/extract/0.log"
Jul 21 04:54:41.022654 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:41.022604    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79_aa87908f-90f8-4b92-a36a-b7d3a8d9d61f/extract/0.log"
Jul 21 04:54:41.028380 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:41.028356    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79_aa87908f-90f8-4b92-a36a-b7d3a8d9d61f/util/0.log"
Jul 21 04:54:41.034738 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:41.034710    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79_aa87908f-90f8-4b92-a36a-b7d3a8d9d61f/pull/0.log"
Jul 21 04:54:41.151199 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:41.151109    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6_aa3c90b2-f620-4684-a98a-980103e72439/util/0.log"
Jul 21 04:54:41.157924 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:41.157897    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6_aa3c90b2-f620-4684-a98a-980103e72439/pull/0.log"
Jul 21 04:54:41.164482 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:41.164458    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6_aa3c90b2-f620-4684-a98a-980103e72439/extract/0.log"
Jul 21 04:54:41.286998 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:41.286966    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2_81ff9cc4-0e01-481a-a618-a0513c758a06/util/0.log"
Jul 21 04:54:41.294179 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:41.294150    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2_81ff9cc4-0e01-481a-a618-a0513c758a06/pull/0.log"
Jul 21 04:54:41.300368 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:41.300338    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2_81ff9cc4-0e01-481a-a618-a0513c758a06/extract/0.log"
Jul 21 04:54:41.435292 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:41.435212    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59b45c9589-fwxm2_74d05fa2-78ec-46d7-a2a7-7f777db24707/authorino/0.log"
Jul 21 04:54:41.801116 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:41.801041    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-tj8bj_2e56ce89-8709-4d29-b0be-9ab34d43cef1/kuadrant-console-plugin/0.log"
Jul 21 04:54:42.180972 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:42.180948    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-f6qm5_f953cbc0-3538-4c0d-b541-a7901ad98610/limitador/0.log"
Jul 21 04:54:43.050478 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:43.050449    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd7c746b6-xdgdg_a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393/kube-auth-proxy/0.log"
Jul 21 04:54:43.553387 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:43.553353    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67ff98b5c4-fp7md_436cc13a-cd45-44db-9a69-54a1e68cfbce/router/0.log"
Jul 21 04:54:44.533367 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:44.533338    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-krfwg_eec1b510-2853-44a2-a946-44ced3bb3506/main/0.log"
Jul 21 04:54:49.920707 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:49.920674    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mhpnj/must-gather-mtfh2"]
Jul 21 04:54:49.921062 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:49.921021    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d810f55-25c5-44dc-b164-274acb2cc7ce" containerName="revoke-keys"
Jul 21 04:54:49.921062 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:49.921032    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d810f55-25c5-44dc-b164-274acb2cc7ce" containerName="revoke-keys"
Jul 21 04:54:49.921135 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:49.921091    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d810f55-25c5-44dc-b164-274acb2cc7ce" containerName="revoke-keys"
Jul 21 04:54:49.925472 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:49.925453    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mhpnj/must-gather-mtfh2"
Jul 21 04:54:49.928115 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:49.928097    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mhpnj\"/\"default-dockercfg-xbcnv\""
Jul 21 04:54:49.928201 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:49.928098    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mhpnj\"/\"openshift-service-ca.crt\""
Jul 21 04:54:49.928993 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:49.928977    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mhpnj\"/\"kube-root-ca.crt\""
Jul 21 04:54:49.933702 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:49.933683    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mhpnj/must-gather-mtfh2"]
Jul 21 04:54:50.070062 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:50.070028    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f60f786f-bdaf-4f92-93a3-10a2b25a8dab-must-gather-output\") pod \"must-gather-mtfh2\" (UID: \"f60f786f-bdaf-4f92-93a3-10a2b25a8dab\") " pod="openshift-must-gather-mhpnj/must-gather-mtfh2"
Jul 21 04:54:50.070228 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:50.070070    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2pvb\" (UniqueName: \"kubernetes.io/projected/f60f786f-bdaf-4f92-93a3-10a2b25a8dab-kube-api-access-q2pvb\") pod \"must-gather-mtfh2\" (UID: \"f60f786f-bdaf-4f92-93a3-10a2b25a8dab\") " pod="openshift-must-gather-mhpnj/must-gather-mtfh2"
Jul 21 04:54:50.170762 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:50.170684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f60f786f-bdaf-4f92-93a3-10a2b25a8dab-must-gather-output\") pod \"must-gather-mtfh2\" (UID: \"f60f786f-bdaf-4f92-93a3-10a2b25a8dab\") " pod="openshift-must-gather-mhpnj/must-gather-mtfh2"
Jul 21 04:54:50.170762 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:50.170725    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2pvb\" (UniqueName: \"kubernetes.io/projected/f60f786f-bdaf-4f92-93a3-10a2b25a8dab-kube-api-access-q2pvb\") pod \"must-gather-mtfh2\" (UID: \"f60f786f-bdaf-4f92-93a3-10a2b25a8dab\") " pod="openshift-must-gather-mhpnj/must-gather-mtfh2"
Jul 21 04:54:50.171035 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:50.171017    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f60f786f-bdaf-4f92-93a3-10a2b25a8dab-must-gather-output\") pod \"must-gather-mtfh2\" (UID: \"f60f786f-bdaf-4f92-93a3-10a2b25a8dab\") " pod="openshift-must-gather-mhpnj/must-gather-mtfh2"
Jul 21 04:54:50.178864 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:50.178846    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2pvb\" (UniqueName: \"kubernetes.io/projected/f60f786f-bdaf-4f92-93a3-10a2b25a8dab-kube-api-access-q2pvb\") pod \"must-gather-mtfh2\" (UID: \"f60f786f-bdaf-4f92-93a3-10a2b25a8dab\") " pod="openshift-must-gather-mhpnj/must-gather-mtfh2"
Jul 21 04:54:50.235185 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:50.235161    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mhpnj/must-gather-mtfh2"
Jul 21 04:54:50.368357 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:50.368334    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mhpnj/must-gather-mtfh2"]
Jul 21 04:54:50.370590 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:54:50.370548    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf60f786f_bdaf_4f92_93a3_10a2b25a8dab.slice/crio-1b771dd489b0f5726dcbfa5dd09cfa1d1a63f2e7da75c27f9ba14479cbea0c4e WatchSource:0}: Error finding container 1b771dd489b0f5726dcbfa5dd09cfa1d1a63f2e7da75c27f9ba14479cbea0c4e: Status 404 returned error can't find the container with id 1b771dd489b0f5726dcbfa5dd09cfa1d1a63f2e7da75c27f9ba14479cbea0c4e
Jul 21 04:54:51.149088 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:51.149047    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mhpnj/must-gather-mtfh2" event={"ID":"f60f786f-bdaf-4f92-93a3-10a2b25a8dab","Type":"ContainerStarted","Data":"1b771dd489b0f5726dcbfa5dd09cfa1d1a63f2e7da75c27f9ba14479cbea0c4e"}
Jul 21 04:54:52.162826 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:52.162786    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mhpnj/must-gather-mtfh2" event={"ID":"f60f786f-bdaf-4f92-93a3-10a2b25a8dab","Type":"ContainerStarted","Data":"50de7447012d7bc72ce390f4ad72fdeaf96f9bb7cd9b666c996d5d8aa8a78654"}
Jul 21 04:54:52.163292 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:52.162841    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mhpnj/must-gather-mtfh2" event={"ID":"f60f786f-bdaf-4f92-93a3-10a2b25a8dab","Type":"ContainerStarted","Data":"a4465aac595929b225462af1c88032822bdedd9e45fc6a1eee8aea47cb9fd5c6"}
Jul 21 04:54:52.181554 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:52.181507    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mhpnj/must-gather-mtfh2" podStartSLOduration=2.13966514 podStartE2EDuration="3.18149122s" totalImagesPullingTime="1.04182608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:54:52.179132341 +0000 UTC m=+3041.996699126" watchObservedRunningTime="2026-07-21 04:54:52.18149122 +0000 UTC m=+3041.999058004"
Jul 21 04:54:52.994087 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:52.994053    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ksnr2_f6567b22-8a1e-4d92-a2ee-6eedb17d3679/global-pull-secret-syncer/0.log"
Jul 21 04:54:53.131674 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:53.131607    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t5crf_59ceecb0-f7c0-4130-b056-ffd1e11e2757/konnectivity-agent/0.log"
Jul 21 04:54:53.156250 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:53.156221    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-0.ec2.internal_20a6a41a7a65b6e98b711844aad515ac/haproxy/0.log"
Jul 21 04:54:57.709081 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:57.709000    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2_4faa6cb7-4b22-439b-93ae-039240a2a0b3/extract/0.log"
Jul 21 04:54:57.759765 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:57.759724    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2_4faa6cb7-4b22-439b-93ae-039240a2a0b3/util/0.log"
Jul 21 04:54:57.780295 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:57.780258    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nhpr2_4faa6cb7-4b22-439b-93ae-039240a2a0b3/pull/0.log"
Jul 21 04:54:57.807153 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:57.807109    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79_aa87908f-90f8-4b92-a36a-b7d3a8d9d61f/extract/0.log"
Jul 21 04:54:57.838581 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:57.838547    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79_aa87908f-90f8-4b92-a36a-b7d3a8d9d61f/util/0.log"
Jul 21 04:54:57.877435 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:57.877152    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zpk79_aa87908f-90f8-4b92-a36a-b7d3a8d9d61f/pull/0.log"
Jul 21 04:54:57.919662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:57.919273    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6_aa3c90b2-f620-4684-a98a-980103e72439/extract/0.log"
Jul 21 04:54:57.951715 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:57.951683    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6_aa3c90b2-f620-4684-a98a-980103e72439/util/0.log"
Jul 21 04:54:57.975863 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:57.975773    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7392gz6_aa3c90b2-f620-4684-a98a-980103e72439/pull/0.log"
Jul 21 04:54:58.004267 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:58.004234    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2_81ff9cc4-0e01-481a-a618-a0513c758a06/extract/0.log"
Jul 21 04:54:58.025847 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:58.025816    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2_81ff9cc4-0e01-481a-a618-a0513c758a06/util/0.log"
Jul 21 04:54:58.047601 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:58.047572    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxtw2_81ff9cc4-0e01-481a-a618-a0513c758a06/pull/0.log"
Jul 21 04:54:58.592671 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:58.592054    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59b45c9589-fwxm2_74d05fa2-78ec-46d7-a2a7-7f777db24707/authorino/0.log"
Jul 21 04:54:58.719662 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:58.719211    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-tj8bj_2e56ce89-8709-4d29-b0be-9ab34d43cef1/kuadrant-console-plugin/0.log"
Jul 21 04:54:59.020344 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:54:59.020262    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-f6qm5_f953cbc0-3538-4c0d-b541-a7901ad98610/limitador/0.log"
Jul 21 04:55:00.954093 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:00.954054    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-xxpf8_8fe26493-927f-4aa5-b956-80abeab6c3c0/cluster-monitoring-operator/0.log"
Jul 21 04:55:00.992860 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:00.992803    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-rzh6f_21edf1ff-3354-4aaa-923a-cf865fc7ce89/kube-state-metrics/0.log"
Jul 21 04:55:01.012825 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:01.012789    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-rzh6f_21edf1ff-3354-4aaa-923a-cf865fc7ce89/kube-rbac-proxy-main/0.log"
Jul 21 04:55:01.036241 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:01.036194    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-rzh6f_21edf1ff-3354-4aaa-923a-cf865fc7ce89/kube-rbac-proxy-self/0.log"
Jul 21 04:55:01.261533 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:01.261444    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v67p5_0e2140b6-737b-4cd0-b976-702af090dcd7/node-exporter/0.log"
Jul 21 04:55:01.283826 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:01.283776    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v67p5_0e2140b6-737b-4cd0-b976-702af090dcd7/kube-rbac-proxy/0.log"
Jul 21 04:55:01.306014 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:01.305988    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v67p5_0e2140b6-737b-4cd0-b976-702af090dcd7/init-textfile/0.log"
Jul 21 04:55:01.334003 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:01.333962    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-nfz8l_3690b647-36d6-4ab1-820b-11cbe736a1bf/kube-rbac-proxy-main/0.log"
Jul 21 04:55:01.357350 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:01.357317    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-nfz8l_3690b647-36d6-4ab1-820b-11cbe736a1bf/kube-rbac-proxy-self/0.log"
Jul 21 04:55:01.381538 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:01.381509    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-nfz8l_3690b647-36d6-4ab1-820b-11cbe736a1bf/openshift-state-metrics/0.log"
Jul 21 04:55:01.571984 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:01.571957    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-x8kkr_1b7356d6-a4e6-4448-bbaa-ec3941a108e7/prometheus-operator/0.log"
Jul 21 04:55:01.594744 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:01.594710    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-x8kkr_1b7356d6-a4e6-4448-bbaa-ec3941a108e7/kube-rbac-proxy/0.log"
Jul 21 04:55:01.719102 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:01.719062    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69bb564d6b-frwst_bddb741b-8e3d-4c85-b8bb-8ca4b05f5030/thanos-query/0.log"
Jul 21 04:55:01.741975 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:01.741921    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69bb564d6b-frwst_bddb741b-8e3d-4c85-b8bb-8ca4b05f5030/kube-rbac-proxy-web/0.log"
Jul 21 04:55:01.765623 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:01.765588    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69bb564d6b-frwst_bddb741b-8e3d-4c85-b8bb-8ca4b05f5030/kube-rbac-proxy/0.log"
Jul 21 04:55:01.801834 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:01.801803    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69bb564d6b-frwst_bddb741b-8e3d-4c85-b8bb-8ca4b05f5030/prom-label-proxy/0.log"
Jul 21 04:55:01.827344 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:01.827250    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69bb564d6b-frwst_bddb741b-8e3d-4c85-b8bb-8ca4b05f5030/kube-rbac-proxy-rules/0.log"
Jul 21 04:55:01.853196 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:01.853164    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69bb564d6b-frwst_bddb741b-8e3d-4c85-b8bb-8ca4b05f5030/kube-rbac-proxy-metrics/0.log"
Jul 21 04:55:03.051189 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.051154    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-4jb8p_f9e49fac-2682-4dc3-af73-b1f03c04d4f7/networking-console-plugin/0.log"
Jul 21 04:55:03.280203 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.280173    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"]
Jul 21 04:55:03.285524 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.285499    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.300294 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.300264    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"]
Jul 21 04:55:03.317817 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.317727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/486e936d-0690-4618-b91f-3dc98c8ff049-proc\") pod \"perf-node-gather-daemonset-hzg5t\" (UID: \"486e936d-0690-4618-b91f-3dc98c8ff049\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.317817 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.317776    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28ktd\" (UniqueName: \"kubernetes.io/projected/486e936d-0690-4618-b91f-3dc98c8ff049-kube-api-access-28ktd\") pod \"perf-node-gather-daemonset-hzg5t\" (UID: \"486e936d-0690-4618-b91f-3dc98c8ff049\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.318029 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.317818    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/486e936d-0690-4618-b91f-3dc98c8ff049-podres\") pod \"perf-node-gather-daemonset-hzg5t\" (UID: \"486e936d-0690-4618-b91f-3dc98c8ff049\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.318029 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.317895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/486e936d-0690-4618-b91f-3dc98c8ff049-sys\") pod \"perf-node-gather-daemonset-hzg5t\" (UID: \"486e936d-0690-4618-b91f-3dc98c8ff049\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.318029 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.317938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/486e936d-0690-4618-b91f-3dc98c8ff049-lib-modules\") pod \"perf-node-gather-daemonset-hzg5t\" (UID: \"486e936d-0690-4618-b91f-3dc98c8ff049\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.418687 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.418650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28ktd\" (UniqueName: \"kubernetes.io/projected/486e936d-0690-4618-b91f-3dc98c8ff049-kube-api-access-28ktd\") pod \"perf-node-gather-daemonset-hzg5t\" (UID: \"486e936d-0690-4618-b91f-3dc98c8ff049\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.418881 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.418716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/486e936d-0690-4618-b91f-3dc98c8ff049-podres\") pod \"perf-node-gather-daemonset-hzg5t\" (UID: \"486e936d-0690-4618-b91f-3dc98c8ff049\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.418881 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.418736    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/486e936d-0690-4618-b91f-3dc98c8ff049-sys\") pod \"perf-node-gather-daemonset-hzg5t\" (UID: \"486e936d-0690-4618-b91f-3dc98c8ff049\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.418881 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.418757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/486e936d-0690-4618-b91f-3dc98c8ff049-lib-modules\") pod \"perf-node-gather-daemonset-hzg5t\" (UID: \"486e936d-0690-4618-b91f-3dc98c8ff049\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.418881 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.418822    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/486e936d-0690-4618-b91f-3dc98c8ff049-proc\") pod \"perf-node-gather-daemonset-hzg5t\" (UID: \"486e936d-0690-4618-b91f-3dc98c8ff049\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.418881 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.418862    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/486e936d-0690-4618-b91f-3dc98c8ff049-sys\") pod \"perf-node-gather-daemonset-hzg5t\" (UID: \"486e936d-0690-4618-b91f-3dc98c8ff049\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.419109 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.418896    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/486e936d-0690-4618-b91f-3dc98c8ff049-podres\") pod \"perf-node-gather-daemonset-hzg5t\" (UID: \"486e936d-0690-4618-b91f-3dc98c8ff049\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.419109 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.418911    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/486e936d-0690-4618-b91f-3dc98c8ff049-proc\") pod \"perf-node-gather-daemonset-hzg5t\" (UID: \"486e936d-0690-4618-b91f-3dc98c8ff049\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.419109 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.418936    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/486e936d-0690-4618-b91f-3dc98c8ff049-lib-modules\") pod \"perf-node-gather-daemonset-hzg5t\" (UID: \"486e936d-0690-4618-b91f-3dc98c8ff049\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.428077 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.428052    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28ktd\" (UniqueName: \"kubernetes.io/projected/486e936d-0690-4618-b91f-3dc98c8ff049-kube-api-access-28ktd\") pod \"perf-node-gather-daemonset-hzg5t\" (UID: \"486e936d-0690-4618-b91f-3dc98c8ff049\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.599384 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.599349    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:03.797346 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:03.796767    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"]
Jul 21 04:55:03.798102 ip-10-0-130-0 kubenswrapper[2576]: W0721 04:55:03.798072    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod486e936d_0690_4618_b91f_3dc98c8ff049.slice/crio-9b74a15c9d24e9ffb3df7b4e2d8b1cd02681fcf1c6c2000392c0506df065499a WatchSource:0}: Error finding container 9b74a15c9d24e9ffb3df7b4e2d8b1cd02681fcf1c6c2000392c0506df065499a: Status 404 returned error can't find the container with id 9b74a15c9d24e9ffb3df7b4e2d8b1cd02681fcf1c6c2000392c0506df065499a
Jul 21 04:55:04.260216 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:04.259504    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t" event={"ID":"486e936d-0690-4618-b91f-3dc98c8ff049","Type":"ContainerStarted","Data":"c10cd38a380c2f4c5fd362a17fb1b0fd133e6564a857e375bb3b2cfcdeeb52d9"}
Jul 21 04:55:04.260216 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:04.259569    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t" event={"ID":"486e936d-0690-4618-b91f-3dc98c8ff049","Type":"ContainerStarted","Data":"9b74a15c9d24e9ffb3df7b4e2d8b1cd02681fcf1c6c2000392c0506df065499a"}
Jul 21 04:55:04.260216 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:04.260080    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:04.279822 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:04.279765    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t" podStartSLOduration=1.279719501 podStartE2EDuration="1.279719501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:55:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:55:04.279377174 +0000 UTC m=+3054.096943959" watchObservedRunningTime="2026-07-21 04:55:04.279719501 +0000 UTC m=+3054.097286286"
Jul 21 04:55:04.316954 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:04.316919    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bc847f449-7dv27_7c4c2311-4d7e-45e6-9d9e-a05b90586ff1/console/0.log"
Jul 21 04:55:04.934880 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:04.934846    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-cfp86_027f6098-1f1e-419c-b295-70e9707e53fc/volume-data-source-validator/0.log"
Jul 21 04:55:06.058943 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:06.058912    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pjlxp_3fd3f5fb-f69c-4621-b16d-223d27a121bd/dns/0.log"
Jul 21 04:55:06.080678 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:06.080653    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pjlxp_3fd3f5fb-f69c-4621-b16d-223d27a121bd/kube-rbac-proxy/0.log"
Jul 21 04:55:06.149681 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:06.149624    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7dwjx_44ddbc6a-4723-445d-a5b9-6882cb587ba1/dns-node-resolver/0.log"
Jul 21 04:55:06.767387 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:06.767350    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b8j9r_de4cd546-b39a-405f-a0d0-91a5d42434ba/node-ca/0.log"
Jul 21 04:55:07.999429 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:07.999394    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd7c746b6-xdgdg_a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393/kube-auth-proxy/0.log"
Jul 21 04:55:08.184546 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:08.184495    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67ff98b5c4-fp7md_436cc13a-cd45-44db-9a69-54a1e68cfbce/router/0.log"
Jul 21 04:55:08.898241 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:08.898202    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g4cns_d0bea2dd-fbfb-4d2e-9457-9fa6f6b5608d/serve-healthcheck-canary/0.log"
Jul 21 04:55:09.410557 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:09.410520    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-mv7hd_67b08428-7730-43a8-8d66-28faefc2897d/insights-operator/0.log"
Jul 21 04:55:09.414030 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:09.414005    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-mv7hd_67b08428-7730-43a8-8d66-28faefc2897d/insights-operator/1.log"
Jul 21 04:55:09.500958 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:09.500930    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbmsp_2d645950-68ef-4f41-a8f7-a06ff94bc3cb/kube-rbac-proxy/0.log"
Jul 21 04:55:09.521376 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:09.521346    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbmsp_2d645950-68ef-4f41-a8f7-a06ff94bc3cb/exporter/0.log"
Jul 21 04:55:09.544709 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:09.544670    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbmsp_2d645950-68ef-4f41-a8f7-a06ff94bc3cb/extractor/0.log"
Jul 21 04:55:10.277276 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:10.277246    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-hzg5t"
Jul 21 04:55:12.523868 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:12.523729    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6b969ff8-k6hpc_55298097-791a-4abc-a613-772bfe062fd1/manager/0.log"
Jul 21 04:55:12.552203 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:12.552175    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6b969ff8-k6hpc_55298097-791a-4abc-a613-772bfe062fd1/copy-manifests/0.log"
Jul 21 04:55:13.752877 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:13.752791    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd7c746b6-xdgdg_a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393/kube-auth-proxy/0.log"
Jul 21 04:55:13.903915 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:13.903886    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67ff98b5c4-fp7md_436cc13a-cd45-44db-9a69-54a1e68cfbce/router/0.log"
Jul 21 04:55:13.970361 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:13.970327    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-595b8bf6d6-f7hjt_347b4c96-398e-4a77-9b39-04e4882fcfd6/manager/0.log"
Jul 21 04:55:15.355144 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:15.355106    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd7c746b6-xdgdg_a3ad5ab1-4e9b-4d9c-a6be-cfd6e22a1393/kube-auth-proxy/0.log"
Jul 21 04:55:15.509372 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:15.509296    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67ff98b5c4-fp7md_436cc13a-cd45-44db-9a69-54a1e68cfbce/router/0.log"
Jul 21 04:55:19.228796 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:19.228762    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-7527g_3d93cf6b-302c-4d96-804a-407807242d91/kube-storage-version-migrator-operator/1.log"
Jul 21 04:55:19.230591 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:19.230565    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-7527g_3d93cf6b-302c-4d96-804a-407807242d91/kube-storage-version-migrator-operator/0.log"
Jul 21 04:55:20.217742 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:20.217720    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hbcl2_7400550c-210d-4e1b-ba64-51235944a675/kube-multus-additional-cni-plugins/0.log"
Jul 21 04:55:20.237957 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:20.237928    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hbcl2_7400550c-210d-4e1b-ba64-51235944a675/egress-router-binary-copy/0.log"
Jul 21 04:55:20.257347 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:20.257322    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hbcl2_7400550c-210d-4e1b-ba64-51235944a675/cni-plugins/0.log"
Jul 21 04:55:20.277155 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:20.277130    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hbcl2_7400550c-210d-4e1b-ba64-51235944a675/bond-cni-plugin/0.log"
Jul 21 04:55:20.297059 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:20.296996    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hbcl2_7400550c-210d-4e1b-ba64-51235944a675/routeoverride-cni/0.log"
Jul 21 04:55:20.316716 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:20.316692    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hbcl2_7400550c-210d-4e1b-ba64-51235944a675/whereabouts-cni-bincopy/0.log"
Jul 21 04:55:20.335717 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:20.335691    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hbcl2_7400550c-210d-4e1b-ba64-51235944a675/whereabouts-cni/0.log"
Jul 21 04:55:20.728461 ip-10-0-130-0 kubenswrapper[2576]: I0721 04:55:20.728433    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-x6d78_f7064679-0f8e-4ec6-9f79-d057bf54717f/kube-multus/0.log"