Jun 14 03:12:37.108395 ip-10-0-141-194 systemd[1]: Starting Kubernetes Kubelet...
Jun 14 03:12:37.501020 ip-10-0-141-194 kubenswrapper[2516]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 14 03:12:37.501020 ip-10-0-141-194 kubenswrapper[2516]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 14 03:12:37.501020 ip-10-0-141-194 kubenswrapper[2516]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 14 03:12:37.501020 ip-10-0-141-194 kubenswrapper[2516]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 14 03:12:37.501020 ip-10-0-141-194 kubenswrapper[2516]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 14 03:12:37.502296 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.501787    2516 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 14 03:12:37.507560 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507538    2516 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 14 03:12:37.507560 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507555    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 14 03:12:37.507560 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507560    2516 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 14 03:12:37.507560 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507564    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 14 03:12:37.507560 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507568    2516 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507573    2516 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507578    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507582    2516 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507588    2516 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507592    2516 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507596    2516 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507599    2516 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507603    2516 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507607    2516 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507611    2516 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507616    2516 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507619    2516 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507623    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507627    2516 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507630    2516 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507634    2516 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507638    2516 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507642    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 14 03:12:37.507841 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507646    2516 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507650    2516 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507655    2516 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507659    2516 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507662    2516 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507666    2516 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507670    2516 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507674    2516 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507678    2516 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507684    2516 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507691    2516 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507696    2516 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507701    2516 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507705    2516 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507709    2516 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507714    2516 feature_gate.go:328] unrecognized feature gate: Example
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507719    2516 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507723    2516 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507728    2516 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507732    2516 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 14 03:12:37.508638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507736    2516 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507741    2516 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507745    2516 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507749    2516 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507754    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507758    2516 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507762    2516 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507766    2516 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507770    2516 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507774    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507780    2516 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507784    2516 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507789    2516 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507793    2516 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507797    2516 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507801    2516 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507807    2516 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507814    2516 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507819    2516 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 14 03:12:37.509539 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507824    2516 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507828    2516 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507833    2516 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507838    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507843    2516 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507847    2516 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507852    2516 feature_gate.go:328] unrecognized feature gate: Example2
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507856    2516 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507862    2516 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507867    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507871    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507875    2516 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507880    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507884    2516 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507889    2516 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507893    2516 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507897    2516 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507901    2516 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507905    2516 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507909    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 14 03:12:37.510352 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507913    2516 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507920    2516 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507924    2516 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507929    2516 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507933    2516 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507937    2516 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507942    2516 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507945    2516 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507949    2516 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507953    2516 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507958    2516 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507964    2516 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507969    2516 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507974    2516 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507978    2516 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507983    2516 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.507987    2516 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509179    2516 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509190    2516 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509195    2516 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 14 03:12:37.511221 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509201    2516 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509206    2516 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509211    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509216    2516 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509220    2516 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509224    2516 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509229    2516 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509233    2516 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509237    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509241    2516 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509246    2516 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509250    2516 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509254    2516 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509258    2516 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509262    2516 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509266    2516 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509273    2516 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509279    2516 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509284    2516 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509289    2516 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 14 03:12:37.512094 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509294    2516 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509298    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509302    2516 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509307    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509311    2516 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509315    2516 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509319    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509323    2516 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509328    2516 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509332    2516 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509335    2516 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509339    2516 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509344    2516 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509348    2516 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509353    2516 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509358    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509364    2516 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509369    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509374    2516 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509379    2516 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 14 03:12:37.512676 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509384    2516 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509389    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509393    2516 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509397    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509401    2516 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509405    2516 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509410    2516 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509413    2516 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509417    2516 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509422    2516 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509426    2516 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509430    2516 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509434    2516 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509439    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509442    2516 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509447    2516 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509451    2516 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509455    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509459    2516 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509464    2516 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 14 03:12:37.513274 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509469    2516 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509473    2516 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509478    2516 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509482    2516 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509488    2516 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509492    2516 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509496    2516 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509500    2516 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509505    2516 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509509    2516 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509513    2516 feature_gate.go:328] unrecognized feature gate: Example
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509517    2516 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509522    2516 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509529    2516 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509534    2516 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509539    2516 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509543    2516 feature_gate.go:328] unrecognized feature gate: Example2
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509547    2516 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509551    2516 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 14 03:12:37.514010 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509554    2516 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509558    2516 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509563    2516 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509567    2516 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509571    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509575    2516 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509579    2516 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509583    2516 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509588    2516 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509592    2516 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509596    2516 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509603    2516 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509609    2516 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509613    2516 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509618    2516 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509623    2516 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.509628    2516 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510218    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510227    2516 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 14 03:12:37.514509 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510232    2516 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510236    2516 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510242    2516 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510246    2516 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510250    2516 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510254    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510258    2516 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510262    2516 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510266    2516 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510270    2516 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510274    2516 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510279    2516 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510283    2516 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510287    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510291    2516 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510296    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510300    2516 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510308    2516 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510313    2516 feature_gate.go:328] unrecognized feature gate: Example
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510319    2516 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 14 03:12:37.515047 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510325    2516 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510330    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510335    2516 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510340    2516 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510344    2516 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510348    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510352    2516 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510356    2516 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510360    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510364    2516 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510368    2516 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510372    2516 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510376    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510380    2516 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510384    2516 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510389    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510393    2516 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510398    2516 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510402    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510406    2516 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 14 03:12:37.515584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510410    2516 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510415    2516 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510419    2516 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510424    2516 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510428    2516 feature_gate.go:328] unrecognized feature gate: Example2
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510434    2516 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510440    2516 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510445    2516 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510450    2516 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510456    2516 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510460    2516 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510465    2516 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510469    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510473    2516 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510478    2516 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510482    2516 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510487    2516 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510491    2516 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510495    2516 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 14 03:12:37.516069 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510499    2516 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510503    2516 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510507    2516 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510513    2516 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510518    2516 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510522    2516 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510526    2516 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510530    2516 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510534    2516 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510539    2516 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510543    2516 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510547    2516 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510551    2516 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510555    2516 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510560    2516 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510564    2516 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510568    2516 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510572    2516 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510576    2516 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510580    2516 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 14 03:12:37.516546 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510585    2516 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510589    2516 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510595    2516 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510601    2516 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510606    2516 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510611    2516 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510615    2516 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510620    2516 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510624    2516 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510627    2516 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510631    2516 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510636    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510639    2516 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510644    2516 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510647    2516 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510651    2516 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510656    2516 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.510660    2516 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510749    2516 flags.go:64] FLAG: --address="0.0.0.0"
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510759    2516 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 14 03:12:37.517031 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510768    2516 flags.go:64] FLAG: --anonymous-auth="true"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510775    2516 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510782    2516 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510787    2516 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510794    2516 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510800    2516 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510805    2516 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510810    2516 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510815    2516 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510821    2516 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510826    2516 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510831    2516 flags.go:64] FLAG: --cgroup-root=""
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510835    2516 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510840    2516 flags.go:64] FLAG: --client-ca-file=""
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510847    2516 flags.go:64] FLAG: --cloud-provider="external"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510852    2516 flags.go:64] FLAG: --cluster-dns="[]"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510858    2516 flags.go:64] FLAG: --cluster-domain=""
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510863    2516 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510869    2516 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510874    2516 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510880    2516 flags.go:64] FLAG: --container-log-max-files="5"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510887    2516 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510892    2516 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 14 03:12:37.517547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510896    2516 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510902    2516 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510906    2516 flags.go:64] FLAG: --contention-profiling="false"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510911    2516 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510916    2516 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510921    2516 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510925    2516 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510932    2516 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510936    2516 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510941    2516 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510946    2516 flags.go:64] FLAG: --enable-load-reader="false"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510950    2516 flags.go:64] FLAG: --enable-server="true"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510956    2516 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510963    2516 flags.go:64] FLAG: --event-burst="100"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510968    2516 flags.go:64] FLAG: --event-qps="50"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510973    2516 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510977    2516 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510982    2516 flags.go:64] FLAG: --eviction-hard=""
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510988    2516 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.510995    2516 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511000    2516 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511004    2516 flags.go:64] FLAG: --eviction-soft=""
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511009    2516 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511015    2516 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511020    2516 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 14 03:12:37.518193 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511025    2516 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511029    2516 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511034    2516 flags.go:64] FLAG: --fail-swap-on="true"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511039    2516 flags.go:64] FLAG: --feature-gates=""
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511044    2516 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511049    2516 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511054    2516 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511059    2516 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511064    2516 flags.go:64] FLAG: --healthz-port="10248"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511068    2516 flags.go:64] FLAG: --help="false"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511089    2516 flags.go:64] FLAG: --hostname-override="ip-10-0-141-194.ec2.internal"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511095    2516 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511100    2516 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511104    2516 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511110    2516 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511116    2516 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511120    2516 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511125    2516 flags.go:64] FLAG: --image-service-endpoint=""
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511130    2516 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511134    2516 flags.go:64] FLAG: --kube-api-burst="100"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511140    2516 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511146    2516 flags.go:64] FLAG: --kube-api-qps="50"
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511151    2516 flags.go:64] FLAG: --kube-reserved=""
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511156    2516 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 14 03:12:37.518849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511161    2516 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511166    2516 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511173    2516 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511177    2516 flags.go:64] FLAG: --lock-file=""
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511182    2516 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511187    2516 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511193    2516 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511202    2516 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511207    2516 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511211    2516 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511216    2516 flags.go:64] FLAG: --logging-format="text"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511220    2516 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511225    2516 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511229    2516 flags.go:64] FLAG: --manifest-url=""
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511234    2516 flags.go:64] FLAG: --manifest-url-header=""
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511241    2516 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511245    2516 flags.go:64] FLAG: --max-open-files="1000000"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511251    2516 flags.go:64] FLAG: --max-pods="110"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511256    2516 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511261    2516 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511266    2516 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511270    2516 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511275    2516 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511280    2516 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511285    2516 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 14 03:12:37.519455 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511296    2516 flags.go:64] FLAG: --node-status-max-images="50"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511301    2516 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511305    2516 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511310    2516 flags.go:64] FLAG: --pod-cidr=""
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511316    2516 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511324    2516 flags.go:64] FLAG: --pod-manifest-path=""
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511329    2516 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511333    2516 flags.go:64] FLAG: --pods-per-core="0"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511338    2516 flags.go:64] FLAG: --port="10250"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511345    2516 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511350    2516 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c795b2c0625fc79b"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511355    2516 flags.go:64] FLAG: --qos-reserved=""
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511360    2516 flags.go:64] FLAG: --read-only-port="10255"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511365    2516 flags.go:64] FLAG: --register-node="true"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511371    2516 flags.go:64] FLAG: --register-with-taints=""
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511377    2516 flags.go:64] FLAG: --registry-burst="10"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511382    2516 flags.go:64] FLAG: --registry-qps="5"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511387    2516 flags.go:64] FLAG: --reserved-cpus=""
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511391    2516 flags.go:64] FLAG: --reserved-memory=""
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511397    2516 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511402    2516 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511407    2516 flags.go:64] FLAG: --rotate-certificates="false"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511412    2516 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511417    2516 flags.go:64] FLAG: --runonce="false"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511422    2516 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 14 03:12:37.520212 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511427    2516 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511432    2516 flags.go:64] FLAG: --seccomp-default="false"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511437    2516 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511442    2516 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511447    2516 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511452    2516 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511456    2516 flags.go:64] FLAG: --storage-driver-password="root"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511461    2516 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511466    2516 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511470    2516 flags.go:64] FLAG: --storage-driver-user="root"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511475    2516 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511488    2516 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511494    2516 flags.go:64] FLAG: --system-cgroups=""
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511498    2516 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511507    2516 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511511    2516 flags.go:64] FLAG: --tls-cert-file=""
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511517    2516 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511524    2516 flags.go:64] FLAG: --tls-min-version=""
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511528    2516 flags.go:64] FLAG: --tls-private-key-file=""
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511533    2516 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511538    2516 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511544    2516 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511548    2516 flags.go:64] FLAG: --v="2"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511554    2516 flags.go:64] FLAG: --version="false"
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511561    2516 flags.go:64] FLAG: --vmodule=""
Jun 14 03:12:37.520834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511567    2516 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.511572    2516 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511777    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511784    2516 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511791    2516 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511797    2516 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511802    2516 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511807    2516 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511812    2516 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511817    2516 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511821    2516 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511825    2516 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511829    2516 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511834    2516 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511838    2516 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511843    2516 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511847    2516 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511852    2516 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511856    2516 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511861    2516 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 14 03:12:37.521465 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511866    2516 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511870    2516 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511874    2516 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511881    2516 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511885    2516 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511890    2516 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511894    2516 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511898    2516 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511904    2516 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511908    2516 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511912    2516 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511917    2516 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511921    2516 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511926    2516 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511930    2516 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511934    2516 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511938    2516 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511943    2516 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511947    2516 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511951    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 14 03:12:37.521954 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511955    2516 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511959    2516 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511963    2516 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511967    2516 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511972    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511976    2516 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511980    2516 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511984    2516 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511988    2516 feature_gate.go:328] unrecognized feature gate: Example2
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511992    2516 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.511996    2516 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512000    2516 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512005    2516 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512010    2516 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512014    2516 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512020    2516 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512024    2516 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512028    2516 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512032    2516 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512037    2516 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512042    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 14 03:12:37.522496 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512046    2516 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512051    2516 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512055    2516 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512059    2516 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512063    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512067    2516 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512071    2516 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512091    2516 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512095    2516 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512099    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512105    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512109    2516 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512113    2516 feature_gate.go:328] unrecognized feature gate: Example
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512120    2516 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512125    2516 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512130    2516 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512134    2516 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512139    2516 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512144    2516 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 14 03:12:37.523009 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512149    2516 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512153    2516 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512158    2516 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512163    2516 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512167    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512172    2516 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512188    2516 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512194    2516 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512199    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512203    2516 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512207    2516 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512212    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512217    2516 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512222    2516 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512226    2516 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512230    2516 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512235    2516 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512239    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512245    2516 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512252    2516 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 14 03:12:37.523638 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.512256    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 14 03:12:37.524160 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.512755    2516 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 14 03:12:37.524160 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.519111    2516 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 14 03:12:37.524160 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.519124    2516 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 14 03:12:37.524160 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.519144    2516 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 14 03:12:37.524160 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.519149    2516 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 14 03:12:37.524160 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519203    2516 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 14 03:12:37.524160 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519208    2516 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 14 03:12:37.524160 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519211    2516 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 14 03:12:37.524160 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519215    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 14 03:12:37.524160 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519218    2516 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 14 03:12:37.524160 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519223    2516 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 14 03:12:37.524160 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519226    2516 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 14 03:12:37.524160 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519230    2516 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 14 03:12:37.524160 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519232    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519248    2516 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519252    2516 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519256    2516 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519260    2516 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519263    2516 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519266    2516 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519269    2516 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519271    2516 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519274    2516 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519277    2516 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519280    2516 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519283    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519286    2516 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519288    2516 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519291    2516 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519294    2516 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519297    2516 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519300    2516 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519302    2516 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 14 03:12:37.524584 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519305    2516 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519308    2516 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519311    2516 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519314    2516 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519316    2516 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519319    2516 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519322    2516 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519325    2516 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519327    2516 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519330    2516 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519332    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519335    2516 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519337    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519340    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519342    2516 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519345    2516 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519347    2516 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519351    2516 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519353    2516 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519356    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 14 03:12:37.525065 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519359    2516 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519361    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519364    2516 feature_gate.go:328] unrecognized feature gate: Example
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519368    2516 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519371    2516 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519374    2516 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519377    2516 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519381    2516 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519385    2516 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519388    2516 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519391    2516 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519393    2516 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519396    2516 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519399    2516 feature_gate.go:328] unrecognized feature gate: Example2
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519402    2516 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519404    2516 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519407    2516 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519409    2516 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519412    2516 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 14 03:12:37.525691 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519415    2516 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519417    2516 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519420    2516 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519422    2516 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519425    2516 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519427    2516 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519430    2516 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519432    2516 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519435    2516 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519437    2516 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519440    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519443    2516 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519446    2516 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519449    2516 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519451    2516 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519454    2516 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519457    2516 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519459    2516 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519462    2516 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519464    2516 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 14 03:12:37.526204 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519468    2516 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 14 03:12:37.526772 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519471    2516 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 14 03:12:37.526772 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519474    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 14 03:12:37.526772 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519483    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 14 03:12:37.526772 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519487    2516 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 14 03:12:37.526772 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519490    2516 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 14 03:12:37.526772 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519493    2516 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 14 03:12:37.526772 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519495    2516 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 14 03:12:37.526772 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519498    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 14 03:12:37.526772 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519501    2516 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 14 03:12:37.526772 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519503    2516 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 14 03:12:37.526772 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519506    2516 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 14 03:12:37.526772 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.519511    2516 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 14 03:12:37.526772 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519622    2516 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 14 03:12:37.526772 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519626    2516 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 14 03:12:37.526772 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519630    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519633    2516 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519636    2516 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519638    2516 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519641    2516 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519644    2516 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519646    2516 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519649    2516 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519651    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519654    2516 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519657    2516 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519660    2516 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519662    2516 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519664    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519667    2516 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519669    2516 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519672    2516 feature_gate.go:328] unrecognized feature gate: Example
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519674    2516 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519677    2516 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519680    2516 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 14 03:12:37.527377 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519682    2516 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519685    2516 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519688    2516 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519690    2516 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519693    2516 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519695    2516 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519698    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519700    2516 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519703    2516 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519706    2516 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519708    2516 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519712    2516 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519715    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519718    2516 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519721    2516 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519724    2516 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519727    2516 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519730    2516 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519732    2516 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 14 03:12:37.528097 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519735    2516 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519737    2516 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519740    2516 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519743    2516 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519746    2516 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519748    2516 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519751    2516 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519753    2516 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519756    2516 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519758    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519761    2516 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519763    2516 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519766    2516 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519768    2516 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519772    2516 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519775    2516 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519778    2516 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519781    2516 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519783    2516 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 14 03:12:37.528561 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519786    2516 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519789    2516 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519791    2516 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519794    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519797    2516 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519799    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519802    2516 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519805    2516 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519807    2516 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519810    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519812    2516 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519815    2516 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519817    2516 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519819    2516 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519822    2516 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519824    2516 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519827    2516 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519830    2516 feature_gate.go:328] unrecognized feature gate: Example2
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519832    2516 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519835    2516 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 14 03:12:37.529027 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519837    2516 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519840    2516 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519842    2516 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519844    2516 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519847    2516 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519849    2516 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519852    2516 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519856    2516 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519859    2516 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519862    2516 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519865    2516 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519868    2516 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519870    2516 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519873    2516 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519876    2516 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519878    2516 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519880    2516 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519883    2516 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 14 03:12:37.529533 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:37.519885    2516 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 14 03:12:37.529968 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.519890    2516 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 14 03:12:37.529968 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.519978    2516 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 14 03:12:37.529968 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.521899    2516 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 14 03:12:37.529968 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.523236    2516 server.go:1019] "Starting client certificate rotation"
Jun 14 03:12:37.529968 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.523345    2516 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 14 03:12:37.529968 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.523420    2516 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 14 03:12:37.529968 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.525568    2516 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 14 03:12:37.529968 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.528828    2516 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 14 03:12:37.541331 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.541314    2516 log.go:25] "Validated CRI v1 runtime API"
Jun 14 03:12:37.544006 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.543992    2516 log.go:25] "Validated CRI v1 image API"
Jun 14 03:12:37.544799 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.544776    2516 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 14 03:12:37.549678 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.549659    2516 fs.go:135] Filesystem UUIDs: map[464de3df-c201-4987-9887-527a600badb3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a6ac8b9e-a3b1-4fe8-84f9-d7c07b57f5f8:/dev/nvme0n1p4]
Jun 14 03:12:37.549745 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.549677    2516 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 14 03:12:37.554970 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.554869    2516 manager.go:216] Machine: {Timestamp:2026-06-14 03:12:37.55365964 +0000 UTC m=+0.331104454 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093322 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dbf7b8198f381820bb0df28fe42d0 SystemUUID:ec2dbf7b-8198-f381-820b-b0df28fe42d0 BootID:8f15cb53-0cd8-4c7f-b3e6-c0f8822deb77 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:76:ca:a0:9a:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:76:ca:a0:9a:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:c6:e9:0f:cc:e6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 14 03:12:37.554970 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.554967    2516 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 14 03:12:37.555096 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.555036    2516 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 14 03:12:37.558663 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.558642    2516 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 14 03:12:37.558802 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.558666    2516 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-194.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 14 03:12:37.559319 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.559304    2516 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 14 03:12:37.559369 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.559305    2516 topology_manager.go:138] "Creating topology manager with none policy"
Jun 14 03:12:37.559369 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.559335    2516 container_manager_linux.go:309] "Creating device plugin manager"
Jun 14 03:12:37.559369 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.559344    2516 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 14 03:12:37.560187 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.560175    2516 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 14 03:12:37.561373 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.561361    2516 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 14 03:12:37.564348 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.564337    2516 state_mem.go:36] "Initialized new in-memory state store"
Jun 14 03:12:37.564473 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.564463    2516 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 14 03:12:37.564515 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.564493    2516 kubelet.go:486] "Attempting to sync node with API server"
Jun 14 03:12:37.564515 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.564512    2516 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 14 03:12:37.564583 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.564526    2516 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 14 03:12:37.564583 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.564536    2516 kubelet.go:398] "Adding apiserver pod source"
Jun 14 03:12:37.564583 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.564545    2516 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 14 03:12:37.564936 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.564924    2516 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 14 03:12:37.564975 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.564948    2516 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 14 03:12:37.570047 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.570019    2516 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 14 03:12:37.572490 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.572475    2516 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 14 03:12:37.572554 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.572509    2516 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 14 03:12:37.573072 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.573058    2516 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 14 03:12:37.573157 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.573096    2516 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 14 03:12:37.573157 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.573106    2516 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 14 03:12:37.573157 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.573116    2516 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 14 03:12:37.573157 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.573130    2516 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 14 03:12:37.573157 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.573139    2516 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 14 03:12:37.573328 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.573215    2516 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 14 03:12:37.573328 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.573225    2516 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 14 03:12:37.573328 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.573234    2516 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 14 03:12:37.573328 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.573240    2516 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 14 03:12:37.573328 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.573249    2516 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 14 03:12:37.573328 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.573257    2516 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 14 03:12:37.574626 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.574615    2516 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 14 03:12:37.574626 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.574627    2516 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 14 03:12:37.575278 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.575257    2516 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-194.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 14 03:12:37.575348 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.575328    2516 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 14 03:12:37.577715 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.577702    2516 server.go:1268] "Started kubelet"
Jun 14 03:12:37.577809 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.577785    2516 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 14 03:12:37.577861 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.577787    2516 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 14 03:12:37.577905 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.577881    2516 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 14 03:12:37.578674 ip-10-0-141-194 systemd[1]: Started Kubernetes Kubelet.
Jun 14 03:12:37.579383 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.579368    2516 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 14 03:12:37.580173 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.580159    2516 server.go:310] "Adding debug handlers to kubelet server"
Jun 14 03:12:37.583890 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.583876    2516 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 14 03:12:37.583890 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.583881    2516 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 14 03:12:37.584049 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.583983    2516 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found"
Jun 14 03:12:37.584427 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.584410    2516 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 14 03:12:37.584427 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.584428    2516 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 14 03:12:37.584535 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.584477    2516 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 14 03:12:37.584585 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.584555    2516 reconstruct.go:97] "Volume reconstruction finished"
Jun 14 03:12:37.584585 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.584564    2516 reconciler.go:29] "Reconciler: start to sync state"
Jun 14 03:12:37.584851 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.584832    2516 factory.go:55] Registering systemd factory
Jun 14 03:12:37.584851 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.584851    2516 factory.go:223] Registration of the systemd container factory successfully
Jun 14 03:12:37.586555 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.586539    2516 factory.go:153] Registering CRI-O factory
Jun 14 03:12:37.586854 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.586835    2516 factory.go:223] Registration of the crio container factory successfully
Jun 14 03:12:37.586926 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.586919    2516 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 14 03:12:37.586995 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.586943    2516 factory.go:103] Registering Raw factory
Jun 14 03:12:37.586995 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.586978    2516 manager.go:1196] Started watching for new ooms in manager
Jun 14 03:12:37.587136 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.587109    2516 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 14 03:12:37.587229 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.587137    2516 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-194.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 14 03:12:37.587630 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.587606    2516 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-194.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 14 03:12:37.588034 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.588007    2516 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 14 03:12:37.588249 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.588206    2516 manager.go:349] Starting recovery of all containers
Jun 14 03:12:37.588376 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.587244    2516 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-194.ec2.internal.18b8d401f9e5d637  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-194.ec2.internal,UID:ip-10-0-141-194.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-194.ec2.internal,},FirstTimestamp:2026-06-14 03:12:37.577676343 +0000 UTC m=+0.355121156,LastTimestamp:2026-06-14 03:12:37.577676343 +0000 UTC m=+0.355121156,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-194.ec2.internal,}"
Jun 14 03:12:37.600577 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.600452    2516 manager.go:354] Recovery completed
Jun 14 03:12:37.604339 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.604321    2516 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zcxmd"
Jun 14 03:12:37.604810 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.604800    2516 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 14 03:12:37.607310 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.607292    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientMemory"
Jun 14 03:12:37.607384 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.607324    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasNoDiskPressure"
Jun 14 03:12:37.607384 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.607337    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientPID"
Jun 14 03:12:37.607820 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.607807    2516 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 14 03:12:37.607890 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.607824    2516 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 14 03:12:37.607890 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.607848    2516 state_mem.go:36] "Initialized new in-memory state store"
Jun 14 03:12:37.607890 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.607853    2516 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 14 03:12:37.608570 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.608551    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientMemory"
Jun 14 03:12:37.608664 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.608586    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasNoDiskPressure"
Jun 14 03:12:37.608664 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.608602    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientPID"
Jun 14 03:12:37.609211 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.609193    2516 policy_none.go:49] "None policy: Start"
Jun 14 03:12:37.609211 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.609210    2516 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 14 03:12:37.609357 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.609226    2516 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 14 03:12:37.609357 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.609248    2516 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-194.ec2.internal.18b8d401fba9fe3a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-194.ec2.internal,UID:ip-10-0-141-194.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-194.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-194.ec2.internal,},FirstTimestamp:2026-06-14 03:12:37.607308858 +0000 UTC m=+0.384753675,LastTimestamp:2026-06-14 03:12:37.607308858 +0000 UTC m=+0.384753675,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-194.ec2.internal,}"
Jun 14 03:12:37.610256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.610245    2516 policy_none.go:47] "Start"
Jun 14 03:12:37.611899 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.611884    2516 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zcxmd"
Jun 14 03:12:37.649730 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.649702    2516 manager.go:337] "Starting Device Plugin manager"
Jun 14 03:12:37.649730 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.649732    2516 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 14 03:12:37.649730 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.649743    2516 server.go:87] "Starting device plugin registration server"
Jun 14 03:12:37.654534 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.649983    2516 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 14 03:12:37.654534 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.649993    2516 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 14 03:12:37.654534 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.650106    2516 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 14 03:12:37.654534 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.650195    2516 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 14 03:12:37.654534 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.650205    2516 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 14 03:12:37.654534 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.650742    2516 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 14 03:12:37.654534 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.650785    2516 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-194.ec2.internal\" not found"
Jun 14 03:12:37.654534 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.651108    2516 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 14 03:12:37.654534 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.652533    2516 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 14 03:12:37.654534 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.652563    2516 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 14 03:12:37.654534 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.652580    2516 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 14 03:12:37.654534 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.652612    2516 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 14 03:12:37.654888 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.654702    2516 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 14 03:12:37.751208 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.751112    2516 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 14 03:12:37.752371 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.752352    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientMemory"
Jun 14 03:12:37.752465 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.752385    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasNoDiskPressure"
Jun 14 03:12:37.752465 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.752394    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientPID"
Jun 14 03:12:37.752465 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.752421    2516 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-194.ec2.internal"
Jun 14 03:12:37.752654 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.752641    2516 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal"]
Jun 14 03:12:37.752728 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.752692    2516 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 14 03:12:37.753418 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.753398    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientMemory"
Jun 14 03:12:37.753518 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.753427    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasNoDiskPressure"
Jun 14 03:12:37.753518 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.753443    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientPID"
Jun 14 03:12:37.754604 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.754593    2516 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 14 03:12:37.754759 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.754745    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal"
Jun 14 03:12:37.754813 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.754783    2516 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 14 03:12:37.755293 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.755271    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientMemory"
Jun 14 03:12:37.755376 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.755300    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasNoDiskPressure"
Jun 14 03:12:37.755376 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.755309    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientPID"
Jun 14 03:12:37.755376 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.755360    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientMemory"
Jun 14 03:12:37.755520 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.755386    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasNoDiskPressure"
Jun 14 03:12:37.755520 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.755400    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientPID"
Jun 14 03:12:37.756573 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.756558    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal"
Jun 14 03:12:37.756649 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.756582    2516 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 14 03:12:37.757286 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.757271    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientMemory"
Jun 14 03:12:37.757363 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.757297    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasNoDiskPressure"
Jun 14 03:12:37.757363 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.757308    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientPID"
Jun 14 03:12:37.762266 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.762253    2516 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-194.ec2.internal"
Jun 14 03:12:37.762331 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.762272    2516 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-194.ec2.internal\": node \"ip-10-0-141-194.ec2.internal\" not found"
Jun 14 03:12:37.784715 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.784697    2516 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-194.ec2.internal\" not found" node="ip-10-0-141-194.ec2.internal"
Jun 14 03:12:37.785114 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.785098    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6966a3b5ef7b3f02e3b85e0510d36f37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal\" (UID: \"6966a3b5ef7b3f02e3b85e0510d36f37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal"
Jun 14 03:12:37.785166 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.785122    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6966a3b5ef7b3f02e3b85e0510d36f37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal\" (UID: \"6966a3b5ef7b3f02e3b85e0510d36f37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal"
Jun 14 03:12:37.785166 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.785138    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a64a0089d96df9e7686766c7f0343b5c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-194.ec2.internal\" (UID: \"a64a0089d96df9e7686766c7f0343b5c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal"
Jun 14 03:12:37.785394 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.785379    2516 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found"
Jun 14 03:12:37.789130 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.789115    2516 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-194.ec2.internal\" not found" node="ip-10-0-141-194.ec2.internal"
Jun 14 03:12:37.885921 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.885895    2516 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found"
Jun 14 03:12:37.886023 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.885946    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a64a0089d96df9e7686766c7f0343b5c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-194.ec2.internal\" (UID: \"a64a0089d96df9e7686766c7f0343b5c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal"
Jun 14 03:12:37.886023 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.885966    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6966a3b5ef7b3f02e3b85e0510d36f37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal\" (UID: \"6966a3b5ef7b3f02e3b85e0510d36f37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal"
Jun 14 03:12:37.886023 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.885986    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6966a3b5ef7b3f02e3b85e0510d36f37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal\" (UID: \"6966a3b5ef7b3f02e3b85e0510d36f37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal"
Jun 14 03:12:37.886137 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.886020    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6966a3b5ef7b3f02e3b85e0510d36f37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal\" (UID: \"6966a3b5ef7b3f02e3b85e0510d36f37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal"
Jun 14 03:12:37.886137 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.886032    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a64a0089d96df9e7686766c7f0343b5c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-194.ec2.internal\" (UID: \"a64a0089d96df9e7686766c7f0343b5c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal"
Jun 14 03:12:37.886137 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:37.886053    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6966a3b5ef7b3f02e3b85e0510d36f37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal\" (UID: \"6966a3b5ef7b3f02e3b85e0510d36f37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal"
Jun 14 03:12:37.986968 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:37.986932    2516 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found"
Jun 14 03:12:38.087664 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:38.087592    2516 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found"
Jun 14 03:12:38.087664 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.087597    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal"
Jun 14 03:12:38.092116 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.092099    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal"
Jun 14 03:12:38.188647 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:38.188612    2516 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found"
Jun 14 03:12:38.288973 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:38.288951    2516 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found"
Jun 14 03:12:38.389332 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:38.389312    2516 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found"
Jun 14 03:12:38.483240 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.483217    2516 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 14 03:12:38.484154 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.484138    2516 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal"
Jun 14 03:12:38.494759 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.494743    2516 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 14 03:12:38.497550 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.497538    2516 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal"
Jun 14 03:12:38.509515 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.509499    2516 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 14 03:12:38.522695 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.522667    2516 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 14 03:12:38.522828 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.522809    2516 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 14 03:12:38.522879 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.522821    2516 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 14 03:12:38.565015 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.564979    2516 apiserver.go:52] "Watching apiserver"
Jun 14 03:12:38.584343 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.584316    2516 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 14 03:12:38.584491 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.584363    2516 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 14 03:12:38.584741 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.584717    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal","openshift-dns/node-resolver-nvmbb","openshift-image-registry/node-ca-l4567","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal","openshift-multus/multus-additional-cni-plugins-p9cw2","openshift-multus/network-metrics-daemon-c7zzq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r","openshift-cluster-node-tuning-operator/tuned-wf7kf","openshift-multus/multus-fl99x","openshift-network-diagnostics/network-check-target-v662t","openshift-network-operator/iptables-alerter-lzbf4","openshift-ovn-kubernetes/ovnkube-node-cdpjm","kube-system/global-pull-secret-syncer-xqgzv","kube-system/konnectivity-agent-8vprh"]
Jun 14 03:12:38.586786 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.586764    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:38.586902 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:38.586822    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:12:38.588807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.588786    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.590834 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.590813    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l4567"
Jun 14 03:12:38.590991 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.590974    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 14 03:12:38.591120 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.590975    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 14 03:12:38.592154 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.592139    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 14 03:12:38.592244 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.592215    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 14 03:12:38.592303 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.592258    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 14 03:12:38.592303 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.592265    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7wk45\""
Jun 14 03:12:38.592401 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.592269    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 14 03:12:38.592804 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.592784    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8vprh"
Jun 14 03:12:38.593267 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.593253    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 14 03:12:38.593323 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.593254    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t9jm2\""
Jun 14 03:12:38.593323 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.593274    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 14 03:12:38.593460 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.593444    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 14 03:12:38.594882 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.594865    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.595159 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.595016    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 14 03:12:38.595159 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.595026    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-clcd4\""
Jun 14 03:12:38.595298 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.595166    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 14 03:12:38.596857 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.596842    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 14 03:12:38.597158 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.597144    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:38.597242 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.597185    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7t2cz\""
Jun 14 03:12:38.597242 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:38.597194    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:12:38.597329 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.597288    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 14 03:12:38.597478 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.597460    2516 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 14 03:12:38.597534 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.597466    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 14 03:12:38.597601 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.597584    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 14 03:12:38.597691 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.597677    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 14 03:12:38.599514 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.599494    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.601630 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.601613    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 14 03:12:38.601701 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.601687    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.601806 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.601619    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2hqcv\""
Jun 14 03:12:38.603750 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.603732    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kg9b9\""
Jun 14 03:12:38.604461 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.604060    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 14 03:12:38.604461 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.604070    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 14 03:12:38.604633 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.604581    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 14 03:12:38.604812 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.604628    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nvmbb"
Jun 14 03:12:38.607147 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.606907    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 14 03:12:38.607147 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.606934    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-htqj5\""
Jun 14 03:12:38.607147 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.607060    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 14 03:12:38.609062 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.609044    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.611408 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.611391    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 14 03:12:38.611516 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.611451    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:38.611583 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.611512    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hrh6m\""
Jun 14 03:12:38.611583 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:38.611519    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:12:38.611583 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.611538    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 14 03:12:38.613752 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.613736    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lzbf4"
Jun 14 03:12:38.615738 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.615721    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 14 03:12:38.615932 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.615914    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 14 03:12:38.616014 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.615981    2516 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 03:07:37 +0000 UTC" deadline="2027-12-27 04:01:14.580058352 +0000 UTC"
Jun 14 03:12:38.616073 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.616014    2516 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13464h48m35.96404664s"
Jun 14 03:12:38.616161 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.616070    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 14 03:12:38.616253 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.616237    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hbd4f\""
Jun 14 03:12:38.620006 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:38.619983    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6966a3b5ef7b3f02e3b85e0510d36f37.slice/crio-1b2d2ef8ad297b8f25591e8a2cddbe19cec89d0757e0b72cd009f7266b007ce8 WatchSource:0}: Error finding container 1b2d2ef8ad297b8f25591e8a2cddbe19cec89d0757e0b72cd009f7266b007ce8: Status 404 returned error can't find the container with id 1b2d2ef8ad297b8f25591e8a2cddbe19cec89d0757e0b72cd009f7266b007ce8
Jun 14 03:12:38.620688 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.620669    2516 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ncnm5"
Jun 14 03:12:38.626993 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.626305    2516 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ncnm5"
Jun 14 03:12:38.627229 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.627210    2516 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 14 03:12:38.655135 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.655101    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" event={"ID":"6966a3b5ef7b3f02e3b85e0510d36f37","Type":"ContainerStarted","Data":"1b2d2ef8ad297b8f25591e8a2cddbe19cec89d0757e0b72cd009f7266b007ce8"}
Jun 14 03:12:38.686203 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:38.686184    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64a0089d96df9e7686766c7f0343b5c.slice/crio-316a96415e5292d2873658cf9ec4e3552d9ba48f4e1fcc7698787825168dd819 WatchSource:0}: Error finding container 316a96415e5292d2873658cf9ec4e3552d9ba48f4e1fcc7698787825168dd819: Status 404 returned error can't find the container with id 316a96415e5292d2873658cf9ec4e3552d9ba48f4e1fcc7698787825168dd819
Jun 14 03:12:38.686632 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.686615    2516 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 14 03:12:38.691843 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.691816    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz8m6\" (UniqueName: \"kubernetes.io/projected/bf38e71f-f179-4e4d-95be-b9954e1b2605-kube-api-access-bz8m6\") pod \"node-resolver-nvmbb\" (UID: \"bf38e71f-f179-4e4d-95be-b9954e1b2605\") " pod="openshift-dns/node-resolver-nvmbb"
Jun 14 03:12:38.692197 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692180    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-lib-modules\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.692245 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692206    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-var-lib-kubelet\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.692245 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692224    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a47fb2c-2e21-4947-86d3-20cf83361345-ovnkube-script-lib\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.692245 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692238    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkhtf\" (UniqueName: \"kubernetes.io/projected/2a47fb2c-2e21-4947-86d3-20cf83361345-kube-api-access-pkhtf\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.692387 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692254    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv774\" (UniqueName: \"kubernetes.io/projected/0e55a15d-3244-4d6d-a7c0-82b2c0758f6f-kube-api-access-hv774\") pod \"node-ca-l4567\" (UID: \"0e55a15d-3244-4d6d-a7c0-82b2c0758f6f\") " pod="openshift-image-registry/node-ca-l4567"
Jun 14 03:12:38.692387 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692280    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-kubelet\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.692387 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692324    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-node-log\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.692387 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692360    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a47fb2c-2e21-4947-86d3-20cf83361345-ovnkube-config\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.692553 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692386    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-var-lib-cni-bin\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.692553 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692417    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-var-lib-cni-multus\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.692553 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692460    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f9a8e832-4cf1-4469-b58d-3703c0585d9e-multus-daemon-config\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.692553 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692493    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-sysconfig\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.692553 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692519    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-run-multus-certs\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.692765 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692559    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-run-netns\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.692765 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692593    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-run-ovn-kubernetes\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.692765 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692634    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8qr5\" (UniqueName: \"kubernetes.io/projected/f9a8e832-4cf1-4469-b58d-3703c0585d9e-kube-api-access-x8qr5\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.692765 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692656    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf38e71f-f179-4e4d-95be-b9954e1b2605-tmp-dir\") pod \"node-resolver-nvmbb\" (UID: \"bf38e71f-f179-4e4d-95be-b9954e1b2605\") " pod="openshift-dns/node-resolver-nvmbb"
Jun 14 03:12:38.692765 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692677    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-host\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.692765 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692699    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-sys-fs\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.692765 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692722    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-system-cni-dir\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.692765 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692744    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-systemd-units\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.692765 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692766    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-run-systemd\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.693134 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692789    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.693134 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692820    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f9a8e832-4cf1-4469-b58d-3703c0585d9e-cni-binary-copy\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.693134 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692841    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-sysctl-conf\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.693134 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692860    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e55a15d-3244-4d6d-a7c0-82b2c0758f6f-host\") pod \"node-ca-l4567\" (UID: \"0e55a15d-3244-4d6d-a7c0-82b2c0758f6f\") " pod="openshift-image-registry/node-ca-l4567"
Jun 14 03:12:38.693134 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692899    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-etc-openvswitch\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.693134 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692926    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-cnibin\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.693134 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692946    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-multus-cni-dir\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.693134 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692973    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-multus-conf-dir\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.693134 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.692998    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-sys\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.693134 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693016    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-etc-kubernetes\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.693134 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693100    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgrxg\" (UniqueName: \"kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg\") pod \"network-check-target-v662t\" (UID: \"9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d\") " pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:38.693134 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693134    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e55a15d-3244-4d6d-a7c0-82b2c0758f6f-serviceca\") pod \"node-ca-l4567\" (UID: \"0e55a15d-3244-4d6d-a7c0-82b2c0758f6f\") " pod="openshift-image-registry/node-ca-l4567"
Jun 14 03:12:38.693541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693160    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-var-lib-openvswitch\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.693541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693182    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e91468e4-f06a-4102-968e-3f963db5b774-agent-certs\") pod \"konnectivity-agent-8vprh\" (UID: \"e91468e4-f06a-4102-968e-3f963db5b774\") " pod="kube-system/konnectivity-agent-8vprh"
Jun 14 03:12:38.693541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693206    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6425821-be42-40c0-8366-ee901027b5da-iptables-alerter-script\") pod \"iptables-alerter-lzbf4\" (UID: \"d6425821-be42-40c0-8366-ee901027b5da\") " pod="openshift-network-operator/iptables-alerter-lzbf4"
Jun 14 03:12:38.693541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693226    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r44m6\" (UniqueName: \"kubernetes.io/projected/a7812b72-9313-42ca-96cf-cde0c84e41d6-kube-api-access-r44m6\") pod \"network-metrics-daemon-c7zzq\" (UID: \"a7812b72-9313-42ca-96cf-cde0c84e41d6\") " pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:38.693541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693241    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-device-dir\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.693541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693255    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-slash\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.693541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693269    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-cni-bin\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.693541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693284    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.693541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693297    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-tmp\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.693541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693311    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret\") pod \"global-pull-secret-syncer-xqgzv\" (UID: \"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e\") " pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:38.693541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693345    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-run-openvswitch\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.693541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693376    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.693541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693399    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-cnibin\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.693541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693421    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-multus-socket-dir-parent\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.693541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693441    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-run-k8s-cni-cncf-io\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.693541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693461    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-kubernetes\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.694061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693483    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggpv8\" (UniqueName: \"kubernetes.io/projected/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-kube-api-access-ggpv8\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.694061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693505    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a47fb2c-2e21-4947-86d3-20cf83361345-env-overrides\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.694061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693526    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-hostroot\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.694061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693546    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-modprobe-d\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.694061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693566    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6425821-be42-40c0-8366-ee901027b5da-host-slash\") pod \"iptables-alerter-lzbf4\" (UID: \"d6425821-be42-40c0-8366-ee901027b5da\") " pod="openshift-network-operator/iptables-alerter-lzbf4"
Jun 14 03:12:38.694061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693587    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fslxm\" (UniqueName: \"kubernetes.io/projected/d6425821-be42-40c0-8366-ee901027b5da-kube-api-access-fslxm\") pod \"iptables-alerter-lzbf4\" (UID: \"d6425821-be42-40c0-8366-ee901027b5da\") " pod="openshift-network-operator/iptables-alerter-lzbf4"
Jun 14 03:12:38.694061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693611    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-socket-dir\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.694061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693633    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-cni-netd\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.694061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693654    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.694061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693679    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-var-lib-kubelet\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.694061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693700    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.694061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693723    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t72k8\" (UniqueName: \"kubernetes.io/projected/cabb6d37-9526-44bf-a3e4-0e58e176aad7-kube-api-access-t72k8\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.694061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693744    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-kubelet-config\") pod \"global-pull-secret-syncer-xqgzv\" (UID: \"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e\") " pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:38.694061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693758    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzjb9\" (UniqueName: \"kubernetes.io/projected/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-kube-api-access-tzjb9\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.694061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693773    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-sysctl-d\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.694061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693786    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-systemd\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.694640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693799    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-system-cni-dir\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.694640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693813    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf38e71f-f179-4e4d-95be-b9954e1b2605-hosts-file\") pod \"node-resolver-nvmbb\" (UID: \"bf38e71f-f179-4e4d-95be-b9954e1b2605\") " pod="openshift-dns/node-resolver-nvmbb"
Jun 14 03:12:38.694640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693829    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-run\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.694640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693865    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs\") pod \"network-metrics-daemon-c7zzq\" (UID: \"a7812b72-9313-42ca-96cf-cde0c84e41d6\") " pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:38.694640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693889    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-registration-dir\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.694640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693906    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.694640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693920    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e91468e4-f06a-4102-968e-3f963db5b774-konnectivity-ca\") pod \"konnectivity-agent-8vprh\" (UID: \"e91468e4-f06a-4102-968e-3f963db5b774\") " pod="kube-system/konnectivity-agent-8vprh"
Jun 14 03:12:38.694640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693958    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.694640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.693994    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-os-release\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.694640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.694028    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-tuned\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.694640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.694052    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-dbus\") pod \"global-pull-secret-syncer-xqgzv\" (UID: \"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e\") " pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:38.694640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.694089    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-run-ovn\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.694640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.694114    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-log-socket\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.694640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.694137    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a47fb2c-2e21-4947-86d3-20cf83361345-ovn-node-metrics-cert\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.694640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.694162    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-os-release\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.694640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.694185    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-run-netns\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.783952 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.783921    2516 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 14 03:12:38.794399 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794375    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f9a8e832-4cf1-4469-b58d-3703c0585d9e-cni-binary-copy\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.794548 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794405    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-sysctl-conf\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.794548 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794425    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e55a15d-3244-4d6d-a7c0-82b2c0758f6f-host\") pod \"node-ca-l4567\" (UID: \"0e55a15d-3244-4d6d-a7c0-82b2c0758f6f\") " pod="openshift-image-registry/node-ca-l4567"
Jun 14 03:12:38.794548 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794447    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-etc-openvswitch\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.794548 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794469    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-cnibin\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.794548 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794489    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-multus-cni-dir\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.794548 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794508    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-multus-conf-dir\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.794836 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794539    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e55a15d-3244-4d6d-a7c0-82b2c0758f6f-host\") pod \"node-ca-l4567\" (UID: \"0e55a15d-3244-4d6d-a7c0-82b2c0758f6f\") " pod="openshift-image-registry/node-ca-l4567"
Jun 14 03:12:38.794836 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794572    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-multus-cni-dir\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.794836 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794546    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-sys\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.794836 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794588    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-sysctl-conf\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.794836 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794606    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-sys\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.794836 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794611    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-etc-kubernetes\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.794836 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794611    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-etc-openvswitch\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.794836 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794651    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-cnibin\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.794836 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794710    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgrxg\" (UniqueName: \"kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg\") pod \"network-check-target-v662t\" (UID: \"9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d\") " pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:38.794836 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794732    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-multus-conf-dir\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.794836 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794739    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-etc-kubernetes\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.794836 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794762    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e55a15d-3244-4d6d-a7c0-82b2c0758f6f-serviceca\") pod \"node-ca-l4567\" (UID: \"0e55a15d-3244-4d6d-a7c0-82b2c0758f6f\") " pod="openshift-image-registry/node-ca-l4567"
Jun 14 03:12:38.794836 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794785    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-var-lib-openvswitch\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794887    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e91468e4-f06a-4102-968e-3f963db5b774-agent-certs\") pod \"konnectivity-agent-8vprh\" (UID: \"e91468e4-f06a-4102-968e-3f963db5b774\") " pod="kube-system/konnectivity-agent-8vprh"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794913    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6425821-be42-40c0-8366-ee901027b5da-iptables-alerter-script\") pod \"iptables-alerter-lzbf4\" (UID: \"d6425821-be42-40c0-8366-ee901027b5da\") " pod="openshift-network-operator/iptables-alerter-lzbf4"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794939    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r44m6\" (UniqueName: \"kubernetes.io/projected/a7812b72-9313-42ca-96cf-cde0c84e41d6-kube-api-access-r44m6\") pod \"network-metrics-daemon-c7zzq\" (UID: \"a7812b72-9313-42ca-96cf-cde0c84e41d6\") " pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.794943    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-var-lib-openvswitch\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795012    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f9a8e832-4cf1-4469-b58d-3703c0585d9e-cni-binary-copy\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795183    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e55a15d-3244-4d6d-a7c0-82b2c0758f6f-serviceca\") pod \"node-ca-l4567\" (UID: \"0e55a15d-3244-4d6d-a7c0-82b2c0758f6f\") " pod="openshift-image-registry/node-ca-l4567"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795228    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-device-dir\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795254    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-slash\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795278    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-cni-bin\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795301    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795312    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-device-dir\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795327    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-tmp\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795335    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-slash\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795354    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret\") pod \"global-pull-secret-syncer-xqgzv\" (UID: \"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e\") " pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795338    2516 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795365    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-cni-bin\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795379    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-run-openvswitch\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.795454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795401    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795421    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-cnibin\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795439    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-multus-socket-dir-parent\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795447    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6425821-be42-40c0-8366-ee901027b5da-iptables-alerter-script\") pod \"iptables-alerter-lzbf4\" (UID: \"d6425821-be42-40c0-8366-ee901027b5da\") " pod="openshift-network-operator/iptables-alerter-lzbf4"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795459    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-run-k8s-cni-cncf-io\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795479    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-kubernetes\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795500    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795510    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggpv8\" (UniqueName: \"kubernetes.io/projected/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-kube-api-access-ggpv8\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795540    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a47fb2c-2e21-4947-86d3-20cf83361345-env-overrides\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795565    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-hostroot\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795588    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-modprobe-d\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795618    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6425821-be42-40c0-8366-ee901027b5da-host-slash\") pod \"iptables-alerter-lzbf4\" (UID: \"d6425821-be42-40c0-8366-ee901027b5da\") " pod="openshift-network-operator/iptables-alerter-lzbf4"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795643    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fslxm\" (UniqueName: \"kubernetes.io/projected/d6425821-be42-40c0-8366-ee901027b5da-kube-api-access-fslxm\") pod \"iptables-alerter-lzbf4\" (UID: \"d6425821-be42-40c0-8366-ee901027b5da\") " pod="openshift-network-operator/iptables-alerter-lzbf4"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795669    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-socket-dir\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795694    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-cni-netd\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795718    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795721    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-run-k8s-cni-cncf-io\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.796256 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795768    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795771    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-kubernetes\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795805    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-multus-socket-dir-parent\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795821    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6425821-be42-40c0-8366-ee901027b5da-host-slash\") pod \"iptables-alerter-lzbf4\" (UID: \"d6425821-be42-40c0-8366-ee901027b5da\") " pod="openshift-network-operator/iptables-alerter-lzbf4"
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795816    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-modprobe-d\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795884    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-cnibin\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:38.795889    2516 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795923    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-hostroot\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795927    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-run-openvswitch\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:38.795958    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret podName:58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e nodeName:}" failed. No retries permitted until 2026-06-14 03:12:39.295939563 +0000 UTC m=+2.073384369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret") pod "global-pull-secret-syncer-xqgzv" (UID: "58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e") : object "kube-system"/"original-pull-secret" not registered
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795881    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.795974    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-cni-netd\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796012    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-var-lib-kubelet\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796034    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-socket-dir\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796039    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796089    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-var-lib-kubelet\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796098    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.797001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796117    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t72k8\" (UniqueName: \"kubernetes.io/projected/cabb6d37-9526-44bf-a3e4-0e58e176aad7-kube-api-access-t72k8\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796146    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-kubelet-config\") pod \"global-pull-secret-syncer-xqgzv\" (UID: \"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e\") " pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796171    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzjb9\" (UniqueName: \"kubernetes.io/projected/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-kube-api-access-tzjb9\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796208    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-sysctl-d\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796220    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-kubelet-config\") pod \"global-pull-secret-syncer-xqgzv\" (UID: \"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e\") " pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796231    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-systemd\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796275    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-systemd\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796286    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a47fb2c-2e21-4947-86d3-20cf83361345-env-overrides\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796353    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-system-cni-dir\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796368    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-sysctl-d\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796385    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf38e71f-f179-4e4d-95be-b9954e1b2605-hosts-file\") pod \"node-resolver-nvmbb\" (UID: \"bf38e71f-f179-4e4d-95be-b9954e1b2605\") " pod="openshift-dns/node-resolver-nvmbb"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796414    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-system-cni-dir\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796419    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-run\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796448    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs\") pod \"network-metrics-daemon-c7zzq\" (UID: \"a7812b72-9313-42ca-96cf-cde0c84e41d6\") " pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796458    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-run\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796448    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf38e71f-f179-4e4d-95be-b9954e1b2605-hosts-file\") pod \"node-resolver-nvmbb\" (UID: \"bf38e71f-f179-4e4d-95be-b9954e1b2605\") " pod="openshift-dns/node-resolver-nvmbb"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796475    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-registration-dir\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796498    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.797807 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796518    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e91468e4-f06a-4102-968e-3f963db5b774-konnectivity-ca\") pod \"konnectivity-agent-8vprh\" (UID: \"e91468e4-f06a-4102-968e-3f963db5b774\") " pod="kube-system/konnectivity-agent-8vprh"
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:38.796504    2516 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796534    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796553    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-os-release\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796557    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-registration-dir\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:38.796578    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs podName:a7812b72-9313-42ca-96cf-cde0c84e41d6 nodeName:}" failed. No retries permitted until 2026-06-14 03:12:39.296562086 +0000 UTC m=+2.074006902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs") pod "network-metrics-daemon-c7zzq" (UID: "a7812b72-9313-42ca-96cf-cde0c84e41d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796576    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796602    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-os-release\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796609    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-tuned\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796626    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-dbus\") pod \"global-pull-secret-syncer-xqgzv\" (UID: \"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e\") " pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796674    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-dbus\") pod \"global-pull-secret-syncer-xqgzv\" (UID: \"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e\") " pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796707    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-run-ovn\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796738    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-log-socket\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796764    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a47fb2c-2e21-4947-86d3-20cf83361345-ovn-node-metrics-cert\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796799    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-os-release\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796829    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-run-netns\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796855    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz8m6\" (UniqueName: \"kubernetes.io/projected/bf38e71f-f179-4e4d-95be-b9954e1b2605-kube-api-access-bz8m6\") pod \"node-resolver-nvmbb\" (UID: \"bf38e71f-f179-4e4d-95be-b9954e1b2605\") " pod="openshift-dns/node-resolver-nvmbb"
Jun 14 03:12:38.798640 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796877    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-lib-modules\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796906    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-var-lib-kubelet\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796935    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a47fb2c-2e21-4947-86d3-20cf83361345-ovnkube-script-lib\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796959    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkhtf\" (UniqueName: \"kubernetes.io/projected/2a47fb2c-2e21-4947-86d3-20cf83361345-kube-api-access-pkhtf\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.796999    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv774\" (UniqueName: \"kubernetes.io/projected/0e55a15d-3244-4d6d-a7c0-82b2c0758f6f-kube-api-access-hv774\") pod \"node-ca-l4567\" (UID: \"0e55a15d-3244-4d6d-a7c0-82b2c0758f6f\") " pod="openshift-image-registry/node-ca-l4567"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797028    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-kubelet\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797053    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-node-log\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797095    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a47fb2c-2e21-4947-86d3-20cf83361345-ovnkube-config\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797122    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-var-lib-cni-bin\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797116    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-log-socket\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797026    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797166    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-var-lib-cni-multus\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797129    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e91468e4-f06a-4102-968e-3f963db5b774-konnectivity-ca\") pod \"konnectivity-agent-8vprh\" (UID: \"e91468e4-f06a-4102-968e-3f963db5b774\") " pod="kube-system/konnectivity-agent-8vprh"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797197    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-node-log\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797223    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-var-lib-cni-bin\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797261    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-var-lib-cni-multus\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797314    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-var-lib-kubelet\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.799453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797342    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f9a8e832-4cf1-4469-b58d-3703c0585d9e-multus-daemon-config\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797369    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-sysconfig\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797377    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-os-release\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797394    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-run-multus-certs\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797413    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-run-netns\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797419    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-run-netns\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797452    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-run-netns\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797459    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-run-ovn-kubernetes\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797471    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-lib-modules\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797488    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8qr5\" (UniqueName: \"kubernetes.io/projected/f9a8e832-4cf1-4469-b58d-3703c0585d9e-kube-api-access-x8qr5\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797497    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-sysconfig\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797513    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf38e71f-f179-4e4d-95be-b9954e1b2605-tmp-dir\") pod \"node-resolver-nvmbb\" (UID: \"bf38e71f-f179-4e4d-95be-b9954e1b2605\") " pod="openshift-dns/node-resolver-nvmbb"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797525    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-kubelet\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797533    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f9a8e832-4cf1-4469-b58d-3703c0585d9e-host-run-multus-certs\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797537    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-host\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797566    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-sys-fs\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797575    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-host-run-ovn-kubernetes\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797578    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-host\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.799948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797592    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-system-cni-dir\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797600    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a47fb2c-2e21-4947-86d3-20cf83361345-ovnkube-script-lib\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797625    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-systemd-units\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797635    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-system-cni-dir\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797637    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a47fb2c-2e21-4947-86d3-20cf83361345-ovnkube-config\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797653    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-run-systemd\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797684    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797695    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cabb6d37-9526-44bf-a3e4-0e58e176aad7-sys-fs\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797695    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-systemd-units\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797727    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-run-systemd\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797798    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f9a8e832-4cf1-4469-b58d-3703c0585d9e-multus-daemon-config\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.797885    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a47fb2c-2e21-4947-86d3-20cf83361345-run-ovn\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.798042    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf38e71f-f179-4e4d-95be-b9954e1b2605-tmp-dir\") pod \"node-resolver-nvmbb\" (UID: \"bf38e71f-f179-4e4d-95be-b9954e1b2605\") " pod="openshift-dns/node-resolver-nvmbb"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.798737    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.799139    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e91468e4-f06a-4102-968e-3f963db5b774-agent-certs\") pod \"konnectivity-agent-8vprh\" (UID: \"e91468e4-f06a-4102-968e-3f963db5b774\") " pod="kube-system/konnectivity-agent-8vprh"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.799560    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-tmp\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.799651    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-etc-tuned\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.800523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.799704    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a47fb2c-2e21-4947-86d3-20cf83361345-ovn-node-metrics-cert\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.801210 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:38.801196    2516 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 14 03:12:38.801257 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:38.801214    2516 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 14 03:12:38.801257 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:38.801223    2516 projected.go:196] Error preparing data for projected volume kube-api-access-sgrxg for pod openshift-network-diagnostics/network-check-target-v662t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 14 03:12:38.801317 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:38.801283    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg podName:9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d nodeName:}" failed. No retries permitted until 2026-06-14 03:12:39.301268578 +0000 UTC m=+2.078713383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sgrxg" (UniqueName: "kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg") pod "network-check-target-v662t" (UID: "9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 14 03:12:38.803143 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.803125    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r44m6\" (UniqueName: \"kubernetes.io/projected/a7812b72-9313-42ca-96cf-cde0c84e41d6-kube-api-access-r44m6\") pod \"network-metrics-daemon-c7zzq\" (UID: \"a7812b72-9313-42ca-96cf-cde0c84e41d6\") " pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:38.803228 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.803126    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggpv8\" (UniqueName: \"kubernetes.io/projected/92d98f42-dbda-4096-9ce7-cdf6076e3c8e-kube-api-access-ggpv8\") pod \"tuned-wf7kf\" (UID: \"92d98f42-dbda-4096-9ce7-cdf6076e3c8e\") " pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.805719 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.805692    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fslxm\" (UniqueName: \"kubernetes.io/projected/d6425821-be42-40c0-8366-ee901027b5da-kube-api-access-fslxm\") pod \"iptables-alerter-lzbf4\" (UID: \"d6425821-be42-40c0-8366-ee901027b5da\") " pod="openshift-network-operator/iptables-alerter-lzbf4"
Jun 14 03:12:38.805873 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.805851    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t72k8\" (UniqueName: \"kubernetes.io/projected/cabb6d37-9526-44bf-a3e4-0e58e176aad7-kube-api-access-t72k8\") pod \"aws-ebs-csi-driver-node-8gg6r\" (UID: \"cabb6d37-9526-44bf-a3e4-0e58e176aad7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.806286 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.806259    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzjb9\" (UniqueName: \"kubernetes.io/projected/b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c-kube-api-access-tzjb9\") pod \"multus-additional-cni-plugins-p9cw2\" (UID: \"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c\") " pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.806544 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.806528    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz8m6\" (UniqueName: \"kubernetes.io/projected/bf38e71f-f179-4e4d-95be-b9954e1b2605-kube-api-access-bz8m6\") pod \"node-resolver-nvmbb\" (UID: \"bf38e71f-f179-4e4d-95be-b9954e1b2605\") " pod="openshift-dns/node-resolver-nvmbb"
Jun 14 03:12:38.806600 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.806581    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8qr5\" (UniqueName: \"kubernetes.io/projected/f9a8e832-4cf1-4469-b58d-3703c0585d9e-kube-api-access-x8qr5\") pod \"multus-fl99x\" (UID: \"f9a8e832-4cf1-4469-b58d-3703c0585d9e\") " pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.806971 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.806948    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkhtf\" (UniqueName: \"kubernetes.io/projected/2a47fb2c-2e21-4947-86d3-20cf83361345-kube-api-access-pkhtf\") pod \"ovnkube-node-cdpjm\" (UID: \"2a47fb2c-2e21-4947-86d3-20cf83361345\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.807039 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.807012    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv774\" (UniqueName: \"kubernetes.io/projected/0e55a15d-3244-4d6d-a7c0-82b2c0758f6f-kube-api-access-hv774\") pod \"node-ca-l4567\" (UID: \"0e55a15d-3244-4d6d-a7c0-82b2c0758f6f\") " pod="openshift-image-registry/node-ca-l4567"
Jun 14 03:12:38.908241 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.908218    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:12:38.918690 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:38.918670    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a47fb2c_2e21_4947_86d3_20cf83361345.slice/crio-d84528956466d6ff40922d2b7f2b55a211846c4514e401c3bbf91c0e1d2a4368 WatchSource:0}: Error finding container d84528956466d6ff40922d2b7f2b55a211846c4514e401c3bbf91c0e1d2a4368: Status 404 returned error can't find the container with id d84528956466d6ff40922d2b7f2b55a211846c4514e401c3bbf91c0e1d2a4368
Jun 14 03:12:38.929025 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.929007    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l4567"
Jun 14 03:12:38.935848 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.935826    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8vprh"
Jun 14 03:12:38.937438 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:38.937419    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e55a15d_3244_4d6d_a7c0_82b2c0758f6f.slice/crio-7642c9490c1cb28d8d363c3dfe8ca36a48ee3454b91a3f36c2e05ff52821142e WatchSource:0}: Error finding container 7642c9490c1cb28d8d363c3dfe8ca36a48ee3454b91a3f36c2e05ff52821142e: Status 404 returned error can't find the container with id 7642c9490c1cb28d8d363c3dfe8ca36a48ee3454b91a3f36c2e05ff52821142e
Jun 14 03:12:38.939401 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.939385    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p9cw2"
Jun 14 03:12:38.945039 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:38.945005    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91468e4_f06a_4102_968e_3f963db5b774.slice/crio-046b049dcf741f5e4b40c0b870fa2cc0e263173988974198bfafc989464c8819 WatchSource:0}: Error finding container 046b049dcf741f5e4b40c0b870fa2cc0e263173988974198bfafc989464c8819: Status 404 returned error can't find the container with id 046b049dcf741f5e4b40c0b870fa2cc0e263173988974198bfafc989464c8819
Jun 14 03:12:38.945123 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.945091    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fl99x"
Jun 14 03:12:38.948831 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:38.948808    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8267e59_45f3_4f8b_9e3f_8a8b0f444c8c.slice/crio-ad6ced2d1973509b53a632eb957fb0a975f62932f137ca3dbd2d96cd18209769 WatchSource:0}: Error finding container ad6ced2d1973509b53a632eb957fb0a975f62932f137ca3dbd2d96cd18209769: Status 404 returned error can't find the container with id ad6ced2d1973509b53a632eb957fb0a975f62932f137ca3dbd2d96cd18209769
Jun 14 03:12:38.950543 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.950526    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r"
Jun 14 03:12:38.953621 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:38.953600    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a8e832_4cf1_4469_b58d_3703c0585d9e.slice/crio-08c8804823553ba63712a9fbc743431da455863816416030abb213e49db93623 WatchSource:0}: Error finding container 08c8804823553ba63712a9fbc743431da455863816416030abb213e49db93623: Status 404 returned error can't find the container with id 08c8804823553ba63712a9fbc743431da455863816416030abb213e49db93623
Jun 14 03:12:38.955898 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.955876    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nvmbb"
Jun 14 03:12:38.961565 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.961545    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wf7kf"
Jun 14 03:12:38.962040 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:38.962018    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcabb6d37_9526_44bf_a3e4_0e58e176aad7.slice/crio-e17958ebb4ceadc34e1a5e7c51c2f9705b2f952bb2e67129c9a576a67aeb3df3 WatchSource:0}: Error finding container e17958ebb4ceadc34e1a5e7c51c2f9705b2f952bb2e67129c9a576a67aeb3df3: Status 404 returned error can't find the container with id e17958ebb4ceadc34e1a5e7c51c2f9705b2f952bb2e67129c9a576a67aeb3df3
Jun 14 03:12:38.966340 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:38.966320    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lzbf4"
Jun 14 03:12:38.966520 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:38.966500    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf38e71f_f179_4e4d_95be_b9954e1b2605.slice/crio-7477ca35c67b61eefa59055d65924331c4b473ebd8ac1b0c0658e9594e747160 WatchSource:0}: Error finding container 7477ca35c67b61eefa59055d65924331c4b473ebd8ac1b0c0658e9594e747160: Status 404 returned error can't find the container with id 7477ca35c67b61eefa59055d65924331c4b473ebd8ac1b0c0658e9594e747160
Jun 14 03:12:38.970416 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:38.970399    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d98f42_dbda_4096_9ce7_cdf6076e3c8e.slice/crio-742051e7ee4a165b4cf4255721a7d735ca155c5f0c68609b8c507da4d45f9428 WatchSource:0}: Error finding container 742051e7ee4a165b4cf4255721a7d735ca155c5f0c68609b8c507da4d45f9428: Status 404 returned error can't find the container with id 742051e7ee4a165b4cf4255721a7d735ca155c5f0c68609b8c507da4d45f9428
Jun 14 03:12:38.975885 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:12:38.975863    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6425821_be42_40c0_8366_ee901027b5da.slice/crio-e6a5316e2b3175fd5c1cabfadb027513ee47e6376026f5bebd83d07afeb12bf7 WatchSource:0}: Error finding container e6a5316e2b3175fd5c1cabfadb027513ee47e6376026f5bebd83d07afeb12bf7: Status 404 returned error can't find the container with id e6a5316e2b3175fd5c1cabfadb027513ee47e6376026f5bebd83d07afeb12bf7
Jun 14 03:12:39.015499 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.015459    2516 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 14 03:12:39.300361 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.300277    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret\") pod \"global-pull-secret-syncer-xqgzv\" (UID: \"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e\") " pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:39.300361 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.300351    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs\") pod \"network-metrics-daemon-c7zzq\" (UID: \"a7812b72-9313-42ca-96cf-cde0c84e41d6\") " pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:39.300577 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:39.300430    2516 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 14 03:12:39.300577 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:39.300459    2516 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 14 03:12:39.300577 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:39.300504    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret podName:58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e nodeName:}" failed. No retries permitted until 2026-06-14 03:12:40.30048438 +0000 UTC m=+3.077929187 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret") pod "global-pull-secret-syncer-xqgzv" (UID: "58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e") : object "kube-system"/"original-pull-secret" not registered
Jun 14 03:12:39.300577 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:39.300525    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs podName:a7812b72-9313-42ca-96cf-cde0c84e41d6 nodeName:}" failed. No retries permitted until 2026-06-14 03:12:40.300515062 +0000 UTC m=+3.077959866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs") pod "network-metrics-daemon-c7zzq" (UID: "a7812b72-9313-42ca-96cf-cde0c84e41d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 14 03:12:39.402257 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.401495    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgrxg\" (UniqueName: \"kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg\") pod \"network-check-target-v662t\" (UID: \"9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d\") " pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:39.402257 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:39.401700    2516 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 14 03:12:39.402257 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:39.401721    2516 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 14 03:12:39.402257 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:39.401734    2516 projected.go:196] Error preparing data for projected volume kube-api-access-sgrxg for pod openshift-network-diagnostics/network-check-target-v662t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 14 03:12:39.402257 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:39.401791    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg podName:9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d nodeName:}" failed. No retries permitted until 2026-06-14 03:12:40.401773758 +0000 UTC m=+3.179218574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sgrxg" (UniqueName: "kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg") pod "network-check-target-v662t" (UID: "9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 14 03:12:39.629735 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.629625    2516 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 03:07:38 +0000 UTC" deadline="2028-03-21 10:02:10.679697396 +0000 UTC"
Jun 14 03:12:39.629735 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.629680    2516 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15510h49m31.050022225s"
Jun 14 03:12:39.654054 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.653387    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:39.654054 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:39.653506    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:12:39.654054 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.653851    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:39.654054 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:39.653996    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:12:39.677169 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.677060    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l4567" event={"ID":"0e55a15d-3244-4d6d-a7c0-82b2c0758f6f","Type":"ContainerStarted","Data":"7642c9490c1cb28d8d363c3dfe8ca36a48ee3454b91a3f36c2e05ff52821142e"}
Jun 14 03:12:39.685989 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.685938    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lzbf4" event={"ID":"d6425821-be42-40c0-8366-ee901027b5da","Type":"ContainerStarted","Data":"e6a5316e2b3175fd5c1cabfadb027513ee47e6376026f5bebd83d07afeb12bf7"}
Jun 14 03:12:39.702562 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.702526    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fl99x" event={"ID":"f9a8e832-4cf1-4469-b58d-3703c0585d9e","Type":"ContainerStarted","Data":"08c8804823553ba63712a9fbc743431da455863816416030abb213e49db93623"}
Jun 14 03:12:39.720496 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.720180    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm" event={"ID":"2a47fb2c-2e21-4947-86d3-20cf83361345","Type":"ContainerStarted","Data":"d84528956466d6ff40922d2b7f2b55a211846c4514e401c3bbf91c0e1d2a4368"}
Jun 14 03:12:39.741168 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.740491    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal" event={"ID":"a64a0089d96df9e7686766c7f0343b5c","Type":"ContainerStarted","Data":"316a96415e5292d2873658cf9ec4e3552d9ba48f4e1fcc7698787825168dd819"}
Jun 14 03:12:39.745136 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.744271    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wf7kf" event={"ID":"92d98f42-dbda-4096-9ce7-cdf6076e3c8e","Type":"ContainerStarted","Data":"742051e7ee4a165b4cf4255721a7d735ca155c5f0c68609b8c507da4d45f9428"}
Jun 14 03:12:39.751610 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.751585    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nvmbb" event={"ID":"bf38e71f-f179-4e4d-95be-b9954e1b2605","Type":"ContainerStarted","Data":"7477ca35c67b61eefa59055d65924331c4b473ebd8ac1b0c0658e9594e747160"}
Jun 14 03:12:39.758016 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.757981    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r" event={"ID":"cabb6d37-9526-44bf-a3e4-0e58e176aad7","Type":"ContainerStarted","Data":"e17958ebb4ceadc34e1a5e7c51c2f9705b2f952bb2e67129c9a576a67aeb3df3"}
Jun 14 03:12:39.774923 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.774855    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9cw2" event={"ID":"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c","Type":"ContainerStarted","Data":"ad6ced2d1973509b53a632eb957fb0a975f62932f137ca3dbd2d96cd18209769"}
Jun 14 03:12:39.781981 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.781952    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8vprh" event={"ID":"e91468e4-f06a-4102-968e-3f963db5b774","Type":"ContainerStarted","Data":"046b049dcf741f5e4b40c0b870fa2cc0e263173988974198bfafc989464c8819"}
Jun 14 03:12:39.923857 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:39.923781    2516 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 14 03:12:40.308549 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:40.308466    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret\") pod \"global-pull-secret-syncer-xqgzv\" (UID: \"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e\") " pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:40.308549 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:40.308529    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs\") pod \"network-metrics-daemon-c7zzq\" (UID: \"a7812b72-9313-42ca-96cf-cde0c84e41d6\") " pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:40.308777 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:40.308646    2516 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 14 03:12:40.308777 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:40.308708    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs podName:a7812b72-9313-42ca-96cf-cde0c84e41d6 nodeName:}" failed. No retries permitted until 2026-06-14 03:12:42.308689232 +0000 UTC m=+5.086134032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs") pod "network-metrics-daemon-c7zzq" (UID: "a7812b72-9313-42ca-96cf-cde0c84e41d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 14 03:12:40.311032 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:40.309093    2516 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 14 03:12:40.311032 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:40.309161    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret podName:58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e nodeName:}" failed. No retries permitted until 2026-06-14 03:12:42.309131565 +0000 UTC m=+5.086576372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret") pod "global-pull-secret-syncer-xqgzv" (UID: "58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e") : object "kube-system"/"original-pull-secret" not registered
Jun 14 03:12:40.408947 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:40.408912    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgrxg\" (UniqueName: \"kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg\") pod \"network-check-target-v662t\" (UID: \"9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d\") " pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:40.409158 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:40.409135    2516 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 14 03:12:40.409158 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:40.409157    2516 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 14 03:12:40.409272 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:40.409169    2516 projected.go:196] Error preparing data for projected volume kube-api-access-sgrxg for pod openshift-network-diagnostics/network-check-target-v662t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 14 03:12:40.409272 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:40.409223    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg podName:9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d nodeName:}" failed. No retries permitted until 2026-06-14 03:12:42.409205327 +0000 UTC m=+5.186650127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sgrxg" (UniqueName: "kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg") pod "network-check-target-v662t" (UID: "9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 14 03:12:40.630810 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:40.630724    2516 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 03:07:38 +0000 UTC" deadline="2028-03-09 05:19:58.578848284 +0000 UTC"
Jun 14 03:12:40.630810 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:40.630763    2516 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15218h7m17.948090121s"
Jun 14 03:12:40.653653 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:40.653149    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:40.653653 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:40.653281    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:12:40.755263 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:40.755232    2516 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 14 03:12:41.655642 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:41.655609    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:41.656099 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:41.655751    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:12:41.656186 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:41.656121    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:41.656288 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:41.656230    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:12:42.329203 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:42.329172    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs\") pod \"network-metrics-daemon-c7zzq\" (UID: \"a7812b72-9313-42ca-96cf-cde0c84e41d6\") " pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:42.329383 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:42.329259    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret\") pod \"global-pull-secret-syncer-xqgzv\" (UID: \"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e\") " pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:42.329451 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:42.329400    2516 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 14 03:12:42.329503 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:42.329457    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret podName:58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e nodeName:}" failed. No retries permitted until 2026-06-14 03:12:46.329439324 +0000 UTC m=+9.106884139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret") pod "global-pull-secret-syncer-xqgzv" (UID: "58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e") : object "kube-system"/"original-pull-secret" not registered
Jun 14 03:12:42.329866 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:42.329846    2516 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 14 03:12:42.329958 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:42.329911    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs podName:a7812b72-9313-42ca-96cf-cde0c84e41d6 nodeName:}" failed. No retries permitted until 2026-06-14 03:12:46.329885585 +0000 UTC m=+9.107330393 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs") pod "network-metrics-daemon-c7zzq" (UID: "a7812b72-9313-42ca-96cf-cde0c84e41d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 14 03:12:42.431054 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:42.430628    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgrxg\" (UniqueName: \"kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg\") pod \"network-check-target-v662t\" (UID: \"9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d\") " pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:42.431054 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:42.430785    2516 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 14 03:12:42.431054 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:42.430806    2516 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 14 03:12:42.431054 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:42.430818    2516 projected.go:196] Error preparing data for projected volume kube-api-access-sgrxg for pod openshift-network-diagnostics/network-check-target-v662t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 14 03:12:42.431054 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:42.430881    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg podName:9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d nodeName:}" failed. No retries permitted until 2026-06-14 03:12:46.43086184 +0000 UTC m=+9.208306644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sgrxg" (UniqueName: "kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg") pod "network-check-target-v662t" (UID: "9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 14 03:12:42.653224 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:42.653175    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:42.653399 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:42.653325    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:12:43.654120 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:43.654050    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:43.654892 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:43.654133    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:43.654892 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:43.654264    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:12:43.654892 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:43.654596    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:12:44.653247 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:44.653167    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:44.653426 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:44.653306    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:12:45.653458 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:45.653425    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:45.654401 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:45.653435    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:45.654401 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:45.654018    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:12:45.654401 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:45.654136    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:12:46.361722 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:46.361671    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs\") pod \"network-metrics-daemon-c7zzq\" (UID: \"a7812b72-9313-42ca-96cf-cde0c84e41d6\") " pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:46.361898 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:46.361773    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret\") pod \"global-pull-secret-syncer-xqgzv\" (UID: \"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e\") " pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:46.361898 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:46.361836    2516 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 14 03:12:46.361898 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:46.361873    2516 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 14 03:12:46.362065 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:46.361916    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs podName:a7812b72-9313-42ca-96cf-cde0c84e41d6 nodeName:}" failed. No retries permitted until 2026-06-14 03:12:54.361894757 +0000 UTC m=+17.139339558 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs") pod "network-metrics-daemon-c7zzq" (UID: "a7812b72-9313-42ca-96cf-cde0c84e41d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 14 03:12:46.362065 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:46.361936    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret podName:58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e nodeName:}" failed. No retries permitted until 2026-06-14 03:12:54.361926294 +0000 UTC m=+17.139371095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret") pod "global-pull-secret-syncer-xqgzv" (UID: "58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e") : object "kube-system"/"original-pull-secret" not registered
Jun 14 03:12:46.462861 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:46.462826    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgrxg\" (UniqueName: \"kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg\") pod \"network-check-target-v662t\" (UID: \"9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d\") " pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:46.463035 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:46.463019    2516 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 14 03:12:46.463123 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:46.463047    2516 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 14 03:12:46.463123 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:46.463061    2516 projected.go:196] Error preparing data for projected volume kube-api-access-sgrxg for pod openshift-network-diagnostics/network-check-target-v662t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 14 03:12:46.463231 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:46.463147    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg podName:9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d nodeName:}" failed. No retries permitted until 2026-06-14 03:12:54.463124346 +0000 UTC m=+17.240569151 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sgrxg" (UniqueName: "kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg") pod "network-check-target-v662t" (UID: "9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 14 03:12:46.653131 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:46.653051    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:46.653424 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:46.653346    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:12:47.653743 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:47.653707    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:47.654181 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:47.653847    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:12:47.654288 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:47.654266    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:47.654454 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:47.654380    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:12:48.653324 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:48.653285    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:48.653496 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:48.653419    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:12:49.653840 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:49.653605    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:49.654323 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:49.653662    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:49.654323 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:49.653924    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:12:49.654323 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:49.654000    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:12:50.653697 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:50.653671    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:50.653805 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:50.653767    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:12:51.653024 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:51.652979    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:51.653502 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:51.653142    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:12:51.653502 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:51.653209    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:51.653502 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:51.653328    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:12:52.653204 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:52.653162    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:52.653656 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:52.653309    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:12:53.652954 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:53.652919    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:53.653163 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:53.652962    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:53.653163 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:53.653044    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:12:53.653163 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:53.653139    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:12:54.424060 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:54.424025    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs\") pod \"network-metrics-daemon-c7zzq\" (UID: \"a7812b72-9313-42ca-96cf-cde0c84e41d6\") " pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:54.424300 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:54.424124    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret\") pod \"global-pull-secret-syncer-xqgzv\" (UID: \"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e\") " pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:54.424300 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:54.424274    2516 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 14 03:12:54.424423 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:54.424309    2516 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 14 03:12:54.424423 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:54.424346    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs podName:a7812b72-9313-42ca-96cf-cde0c84e41d6 nodeName:}" failed. No retries permitted until 2026-06-14 03:13:10.424324077 +0000 UTC m=+33.201768902 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs") pod "network-metrics-daemon-c7zzq" (UID: "a7812b72-9313-42ca-96cf-cde0c84e41d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 14 03:12:54.424423 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:54.424368    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret podName:58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e nodeName:}" failed. No retries permitted until 2026-06-14 03:13:10.424358466 +0000 UTC m=+33.201803270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret") pod "global-pull-secret-syncer-xqgzv" (UID: "58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e") : object "kube-system"/"original-pull-secret" not registered
Jun 14 03:12:54.525363 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:54.525334    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgrxg\" (UniqueName: \"kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg\") pod \"network-check-target-v662t\" (UID: \"9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d\") " pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:54.525469 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:54.525443    2516 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 14 03:12:54.525469 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:54.525456    2516 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 14 03:12:54.525469 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:54.525465    2516 projected.go:196] Error preparing data for projected volume kube-api-access-sgrxg for pod openshift-network-diagnostics/network-check-target-v662t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 14 03:12:54.525559 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:54.525505    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg podName:9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d nodeName:}" failed. No retries permitted until 2026-06-14 03:13:10.52549358 +0000 UTC m=+33.302938396 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sgrxg" (UniqueName: "kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg") pod "network-check-target-v662t" (UID: "9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 14 03:12:54.653745 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:54.653704    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:54.654181 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:54.653836    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:12:55.653501 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:55.653459    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:55.653686 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:55.653591    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:12:55.653686 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:55.653663    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:55.653821 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:55.653798    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:12:56.653674 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:56.653644    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:56.653862 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:56.653768    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:12:57.654093 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:57.654050    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:57.654608 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:57.654174    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:57.654608 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:57.654176    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:12:57.654608 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:57.654290    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:12:58.653249 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:58.653220    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:12:58.653387 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:58.653321    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:12:59.653952 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:59.653788    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:12:59.654768 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:59.653865    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:12:59.654768 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:59.654024    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:12:59.654768 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:12:59.654126    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:12:59.833360 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:59.833310    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fl99x" event={"ID":"f9a8e832-4cf1-4469-b58d-3703c0585d9e","Type":"ContainerStarted","Data":"0c855b2b6633c63d8b92bc437ed32d783c444dcb943c9106219a749811b91f1e"}
Jun 14 03:12:59.836388 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:59.836366    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:12:59.836747 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:59.836725    2516 generic.go:356] "Generic (PLEG): container finished" podID="2a47fb2c-2e21-4947-86d3-20cf83361345" containerID="d534dfe527afe063af9ebf82ee0ea99ed3348b1e7c7ce24d19877a31511916b3" exitCode=1
Jun 14 03:12:59.836828 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:59.836795    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm" event={"ID":"2a47fb2c-2e21-4947-86d3-20cf83361345","Type":"ContainerStarted","Data":"021cfb31e9a5704038278b3181394dcf98143c89c72eb43710dad4b3b1bb06c0"}
Jun 14 03:12:59.836894 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:59.836879    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm" event={"ID":"2a47fb2c-2e21-4947-86d3-20cf83361345","Type":"ContainerStarted","Data":"b924dfe8c6c748230d324d13cdc80b39a025ca718c2eeddd0f45853c84eaf0dc"}
Jun 14 03:12:59.836951 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:59.836937    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm" event={"ID":"2a47fb2c-2e21-4947-86d3-20cf83361345","Type":"ContainerStarted","Data":"61353d8f1b32f7b848880774e9ed862f82d900890f482ef3384dd629595f8f3c"}
Jun 14 03:12:59.837003 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:59.836990    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm" event={"ID":"2a47fb2c-2e21-4947-86d3-20cf83361345","Type":"ContainerStarted","Data":"9ecd4d485c61727d861894c77e056460b27b013819c1048452cf4d28f3f36893"}
Jun 14 03:12:59.837057 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:59.837042    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm" event={"ID":"2a47fb2c-2e21-4947-86d3-20cf83361345","Type":"ContainerDied","Data":"d534dfe527afe063af9ebf82ee0ea99ed3348b1e7c7ce24d19877a31511916b3"}
Jun 14 03:12:59.837138 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:59.837117    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm" event={"ID":"2a47fb2c-2e21-4947-86d3-20cf83361345","Type":"ContainerStarted","Data":"dac3282fee56753437f333030f5b30ef148dae5c5fb78d0c185295bc84b4a855"}
Jun 14 03:12:59.838259 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:59.838241    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal" event={"ID":"a64a0089d96df9e7686766c7f0343b5c","Type":"ContainerStarted","Data":"161fc827f012bbe3ad8c3f0116afe3a0503c4aceb8645e121e9d4fbda499895c"}
Jun 14 03:12:59.839720 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:59.839692    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wf7kf" event={"ID":"92d98f42-dbda-4096-9ce7-cdf6076e3c8e","Type":"ContainerStarted","Data":"8ac1f39cc2dabe1894c012bc1695d893b0c7b46222bcc92ebac0dfac93b6ca95"}
Jun 14 03:12:59.851178 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:59.851140    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fl99x" podStartSLOduration=2.3437451830000002 podStartE2EDuration="22.85112846s" totalImagesPullingTime="20.507383277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:12:59.850614655 +0000 UTC m=+22.628059477" watchObservedRunningTime="2026-06-14 03:12:59.85112846 +0000 UTC m=+22.628573283"
Jun 14 03:12:59.868015 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:59.867969    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wf7kf" podStartSLOduration=2.742155466 podStartE2EDuration="22.867951116s" totalImagesPullingTime="20.12579565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:12:59.867588517 +0000 UTC m=+22.645033354" watchObservedRunningTime="2026-06-14 03:12:59.867951116 +0000 UTC m=+22.645395941"
Jun 14 03:12:59.881206 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:12:59.881174    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal" podStartSLOduration=21.881159382 podStartE2EDuration="21.881159382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:12:59.881093716 +0000 UTC m=+22.658538558" watchObservedRunningTime="2026-06-14 03:12:59.881159382 +0000 UTC m=+22.658604206"
Jun 14 03:13:00.653154 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:00.652973    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:13:00.653320 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:00.653225    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:13:00.843490 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:00.843412    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8vprh" event={"ID":"e91468e4-f06a-4102-968e-3f963db5b774","Type":"ContainerStarted","Data":"1b4f321517c95d92cafc119dca0d2419a8647556e7cbe6f78389c311c3a9405f"}
Jun 14 03:13:00.845042 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:00.845010    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l4567" event={"ID":"0e55a15d-3244-4d6d-a7c0-82b2c0758f6f","Type":"ContainerStarted","Data":"76fb93b0c32c442907e7ba26f1bca6af26968c97eed343cca950fa8bdf58c74a"}
Jun 14 03:13:00.846659 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:00.846633    2516 generic.go:356] "Generic (PLEG): container finished" podID="6966a3b5ef7b3f02e3b85e0510d36f37" containerID="ef765f46458e7863fe6e6aa0b2e234a158131f8ee0b9c84d628ca331ca4dbaac" exitCode=0
Jun 14 03:13:00.846779 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:00.846698    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" event={"ID":"6966a3b5ef7b3f02e3b85e0510d36f37","Type":"ContainerDied","Data":"ef765f46458e7863fe6e6aa0b2e234a158131f8ee0b9c84d628ca331ca4dbaac"}
Jun 14 03:13:00.851769 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:00.851742    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lzbf4" event={"ID":"d6425821-be42-40c0-8366-ee901027b5da","Type":"ContainerStarted","Data":"03648fa2fafc8cf2c57bf9065ab9a2d9df67e64d9929ba632a369c5566c7aa2c"}
Jun 14 03:13:00.853244 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:00.853220    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nvmbb" event={"ID":"bf38e71f-f179-4e4d-95be-b9954e1b2605","Type":"ContainerStarted","Data":"348894b39e7d68f1027d616efc1a16f83d841c03c00a3134e95fc4b1dbb8cba2"}
Jun 14 03:13:00.854846 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:00.854827    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r" event={"ID":"cabb6d37-9526-44bf-a3e4-0e58e176aad7","Type":"ContainerStarted","Data":"44dd0f4d5ca4a4137a930432d550a76329cbef461877fc0c272f1cd6e9e9c928"}
Jun 14 03:13:00.856307 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:00.856281    2516 generic.go:356] "Generic (PLEG): container finished" podID="b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c" containerID="1abdf93e7e7e8d29c7918afd94e342ff2ea809293bd86459f4caffb90d107417" exitCode=0
Jun 14 03:13:00.856421 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:00.856367    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9cw2" event={"ID":"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c","Type":"ContainerDied","Data":"1abdf93e7e7e8d29c7918afd94e342ff2ea809293bd86459f4caffb90d107417"}
Jun 14 03:13:00.871573 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:00.871533    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8vprh" podStartSLOduration=3.7415671059999998 podStartE2EDuration="23.871518131s" totalImagesPullingTime="20.129951025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:00.870477902 +0000 UTC m=+23.647922726" watchObservedRunningTime="2026-06-14 03:13:00.871518131 +0000 UTC m=+23.648962955"
Jun 14 03:13:00.939846 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:00.939803    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nvmbb" podStartSLOduration=3.809130833 podStartE2EDuration="23.939788794s" totalImagesPullingTime="20.130657961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:00.939765917 +0000 UTC m=+23.717210741" watchObservedRunningTime="2026-06-14 03:13:00.939788794 +0000 UTC m=+23.717233601"
Jun 14 03:13:00.953624 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:00.953583    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lzbf4" podStartSLOduration=2.874677073 podStartE2EDuration="22.953569571s" totalImagesPullingTime="20.078892498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:00.953441658 +0000 UTC m=+23.730886481" watchObservedRunningTime="2026-06-14 03:13:00.953569571 +0000 UTC m=+23.731014394"
Jun 14 03:13:00.967856 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:00.967820    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l4567" podStartSLOduration=3.809497397 podStartE2EDuration="23.96780719s" totalImagesPullingTime="20.158309793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:00.967732067 +0000 UTC m=+23.745176889" watchObservedRunningTime="2026-06-14 03:13:00.96780719 +0000 UTC m=+23.745252012"
Jun 14 03:13:01.457866 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:01.457838    2516 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 14 03:13:01.653096 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:01.653054    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:13:01.653300 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:01.653201    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:13:01.653300 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:01.653250    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:13:01.653395 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:01.653368    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:13:01.660788 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:01.660715    2516 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T03:13:01.457863482Z","UUID":"61c6301c-5509-4e08-b847-1434849accfe","Handler":null,"Name":"","Endpoint":""}
Jun 14 03:13:01.661987 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:01.661973    2516 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 14 03:13:01.662068 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:01.662004    2516 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 14 03:13:01.734526 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:01.734498    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8vprh"
Jun 14 03:13:01.735042 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:01.735022    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8vprh"
Jun 14 03:13:01.861854 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:01.861813    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r" event={"ID":"cabb6d37-9526-44bf-a3e4-0e58e176aad7","Type":"ContainerStarted","Data":"1caed53313d48831fc5497f5a4c7ae01ba22493b7d05587a887d51ad197f5e0b"}
Jun 14 03:13:01.864271 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:01.864020    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" event={"ID":"6966a3b5ef7b3f02e3b85e0510d36f37","Type":"ContainerStarted","Data":"7cfae5a653b9fce2223b93f4c68f25ac3d5c0b827d2087e63fcafe4f78a43327"}
Jun 14 03:13:01.864445 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:01.864422    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8vprh"
Jun 14 03:13:01.864893 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:01.864853    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8vprh"
Jun 14 03:13:01.881536 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:01.881484    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" podStartSLOduration=23.881464846 podStartE2EDuration="23.881464846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:01.880818651 +0000 UTC m=+24.658263486" watchObservedRunningTime="2026-06-14 03:13:01.881464846 +0000 UTC m=+24.658909672"
Jun 14 03:13:02.652996 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:02.652966    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:13:02.653241 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:02.653110    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:13:02.869167 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:02.869051    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r" event={"ID":"cabb6d37-9526-44bf-a3e4-0e58e176aad7","Type":"ContainerStarted","Data":"7044f3aebdb32b339f383fe3c943ffb364060de45b1d50ce523eacf454738cab"}
Jun 14 03:13:02.872702 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:02.872681    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:13:02.873253 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:02.873164    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm" event={"ID":"2a47fb2c-2e21-4947-86d3-20cf83361345","Type":"ContainerStarted","Data":"7ee03708622aa3582de25553970d70c3cba091ccf17b9b9dcf99efbd04762de2"}
Jun 14 03:13:02.886854 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:02.886810    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg6r" podStartSLOduration=3.690205577 podStartE2EDuration="25.886795833s" totalImagesPullingTime="22.196590256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:02.886387562 +0000 UTC m=+25.663832397" watchObservedRunningTime="2026-06-14 03:13:02.886795833 +0000 UTC m=+25.664240655"
Jun 14 03:13:03.656243 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:03.656215    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:13:03.656395 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:03.656325    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:13:03.656395 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:03.656382    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:13:03.656494 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:03.656475    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:13:04.653460 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:04.653422    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:13:04.654232 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:04.653537    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:13:04.880499 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:04.880311    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:13:04.880912 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:04.880886    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm" event={"ID":"2a47fb2c-2e21-4947-86d3-20cf83361345","Type":"ContainerStarted","Data":"50f4278b8389592a889fba0156be02270c2448456924d6f84b182e9a6c012ada"}
Jun 14 03:13:04.881182 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:04.881157    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:13:04.881393 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:04.881375    2516 scope.go:117] "RemoveContainer" containerID="d534dfe527afe063af9ebf82ee0ea99ed3348b1e7c7ce24d19877a31511916b3"
Jun 14 03:13:04.898362 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:04.898340    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:13:05.657042 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:05.657014    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:13:05.657561 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:05.657052    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:13:05.657561 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:05.657187    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:13:05.657561 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:05.657276    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:13:05.791004 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:05.790981    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:13:05.887468 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:05.887437    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:13:05.887853 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:05.887828    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm" event={"ID":"2a47fb2c-2e21-4947-86d3-20cf83361345","Type":"ContainerStarted","Data":"fd200cecf86a4116b1d4b0a0886bb2bd3ef6538bb42435e1ab5f350357c3742b"}
Jun 14 03:13:05.888056 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:05.888024    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:13:05.902104 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:05.902061    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:13:05.923648 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:05.923604    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm" podStartSLOduration=8.701238384 podStartE2EDuration="28.923591573s" totalImagesPullingTime="20.222353189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:05.923043374 +0000 UTC m=+28.700488199" watchObservedRunningTime="2026-06-14 03:13:05.923591573 +0000 UTC m=+28.701036396"
Jun 14 03:13:06.270433 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:06.270357    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xqgzv"]
Jun 14 03:13:06.270578 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:06.270462    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:13:06.270578 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:06.270543    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:13:06.273867 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:06.273834    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c7zzq"]
Jun 14 03:13:06.273974 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:06.273916    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:13:06.274029 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:06.273994    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:13:06.283824 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:06.283802    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v662t"]
Jun 14 03:13:06.283942 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:06.283867    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:13:06.283942 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:06.283932    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:13:06.891915 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:06.891878    2516 generic.go:356] "Generic (PLEG): container finished" podID="b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c" containerID="1afe5c3ad90a84881945afb8f95d8fc9f13c11a181eddec1498b60ee2a46fd04" exitCode=0
Jun 14 03:13:06.892360 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:06.891963    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9cw2" event={"ID":"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c","Type":"ContainerDied","Data":"1afe5c3ad90a84881945afb8f95d8fc9f13c11a181eddec1498b60ee2a46fd04"}
Jun 14 03:13:07.654179 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:07.654145    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:13:07.654359 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:07.654234    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:13:07.654359 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:07.654280    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:13:07.654476 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:07.654364    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:13:07.654698 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:07.654611    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:13:07.654698 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:07.654645    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:13:08.898738 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:08.898708    2516 generic.go:356] "Generic (PLEG): container finished" podID="b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c" containerID="e4877b89a79a5df0c0d6b2a70077f7a6b76ebe3773b9a116c37066fddd824c98" exitCode=0
Jun 14 03:13:08.899114 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:08.898749    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9cw2" event={"ID":"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c","Type":"ContainerDied","Data":"e4877b89a79a5df0c0d6b2a70077f7a6b76ebe3773b9a116c37066fddd824c98"}
Jun 14 03:13:09.653861 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:09.653689    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:13:09.654023 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:09.653699    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:13:09.654109 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:09.653751    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:13:09.654109 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:09.654034    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:13:09.654197 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:09.653923    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:13:09.654235 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:09.654210    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:13:10.451711 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:10.451675    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret\") pod \"global-pull-secret-syncer-xqgzv\" (UID: \"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e\") " pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:13:10.451711 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:10.451720    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs\") pod \"network-metrics-daemon-c7zzq\" (UID: \"a7812b72-9313-42ca-96cf-cde0c84e41d6\") " pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:13:10.452251 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:10.451850    2516 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 14 03:13:10.452251 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:10.451922    2516 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 14 03:13:10.452251 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:10.451934    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret podName:58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e nodeName:}" failed. No retries permitted until 2026-06-14 03:13:42.451912737 +0000 UTC m=+65.229357558 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret") pod "global-pull-secret-syncer-xqgzv" (UID: "58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e") : object "kube-system"/"original-pull-secret" not registered
Jun 14 03:13:10.452251 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:10.451974    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs podName:a7812b72-9313-42ca-96cf-cde0c84e41d6 nodeName:}" failed. No retries permitted until 2026-06-14 03:13:42.451956619 +0000 UTC m=+65.229401425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs") pod "network-metrics-daemon-c7zzq" (UID: "a7812b72-9313-42ca-96cf-cde0c84e41d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 14 03:13:10.552192 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:10.552152    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgrxg\" (UniqueName: \"kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg\") pod \"network-check-target-v662t\" (UID: \"9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d\") " pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:13:10.552361 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:10.552304    2516 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 14 03:13:10.552361 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:10.552328    2516 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 14 03:13:10.552361 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:10.552338    2516 projected.go:196] Error preparing data for projected volume kube-api-access-sgrxg for pod openshift-network-diagnostics/network-check-target-v662t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 14 03:13:10.552484 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:10.552389    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg podName:9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d nodeName:}" failed. No retries permitted until 2026-06-14 03:13:42.55237566 +0000 UTC m=+65.329820478 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sgrxg" (UniqueName: "kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg") pod "network-check-target-v662t" (UID: "9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 14 03:13:10.905694 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:10.905665    2516 generic.go:356] "Generic (PLEG): container finished" podID="b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c" containerID="634d207305074e911ec82a20396249a7686f858129439ba2888309014148b2f4" exitCode=0
Jun 14 03:13:10.905842 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:10.905736    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9cw2" event={"ID":"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c","Type":"ContainerDied","Data":"634d207305074e911ec82a20396249a7686f858129439ba2888309014148b2f4"}
Jun 14 03:13:11.653674 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:11.653630    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:13:11.653674 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:11.653674    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:13:11.654301 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:11.653755    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v662t" podUID="9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d"
Jun 14 03:13:11.654301 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:11.653869    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:13:11.654301 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:11.653914    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:13:11.654301 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:11.654006    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqgzv" podUID="58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e"
Jun 14 03:13:11.984174 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:11.984100    2516 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeReady"
Jun 14 03:13:11.984332 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:11.984249    2516 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 14 03:13:12.022800 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.022767    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d796fc86d-lwgzj"]
Jun 14 03:13:12.024630 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.024604    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.027190 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.027164    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 14 03:13:12.027390 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.027375    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 14 03:13:12.027955 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.027832    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fgws4\""
Jun 14 03:13:12.027955 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.027898    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 14 03:13:12.032872 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.032850    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 14 03:13:12.033884 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.033871    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2pxlj"]
Jun 14 03:13:12.036606 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.036582    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d796fc86d-lwgzj"]
Jun 14 03:13:12.036698 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.036640    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5z9bc"]
Jun 14 03:13:12.036698 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.036688    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:12.038459 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.038440    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5z9bc"
Jun 14 03:13:12.040587 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.040302    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ctq98\""
Jun 14 03:13:12.040587 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.040421    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 14 03:13:12.040739 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.040677    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 14 03:13:12.040859 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.040839    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 14 03:13:12.041156 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.041138    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 14 03:13:12.041281 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.041260    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 14 03:13:12.041502 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.041483    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pf4ph\""
Jun 14 03:13:12.048986 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.048967    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5z9bc"]
Jun 14 03:13:12.055567 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.055518    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2pxlj"]
Jun 14 03:13:12.161909 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.161873    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/785ada15-72a0-4d3a-b899-b442c0b7d3e4-image-registry-private-configuration\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.162124 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.161922    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59b69d24-0cbf-41a4-a252-647f088ec7bf-tmp-dir\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:12.162124 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.161995    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/785ada15-72a0-4d3a-b899-b442c0b7d3e4-installation-pull-secrets\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.162124 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.162049    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqmnf\" (UniqueName: \"kubernetes.io/projected/af4c2972-fca9-4bab-b645-44b2b1e876d0-kube-api-access-sqmnf\") pod \"ingress-canary-5z9bc\" (UID: \"af4c2972-fca9-4bab-b645-44b2b1e876d0\") " pod="openshift-ingress-canary/ingress-canary-5z9bc"
Jun 14 03:13:12.162124 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.162095    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-certificates\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.162326 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.162130    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59b69d24-0cbf-41a4-a252-647f088ec7bf-config-volume\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:12.162326 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.162165    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af4c2972-fca9-4bab-b645-44b2b1e876d0-cert\") pod \"ingress-canary-5z9bc\" (UID: \"af4c2972-fca9-4bab-b645-44b2b1e876d0\") " pod="openshift-ingress-canary/ingress-canary-5z9bc"
Jun 14 03:13:12.162326 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.162183    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hw9v\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-kube-api-access-7hw9v\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.162326 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.162257    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz6p4\" (UniqueName: \"kubernetes.io/projected/59b69d24-0cbf-41a4-a252-647f088ec7bf-kube-api-access-vz6p4\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:12.162326 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.162306    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.162545 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.162331    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/785ada15-72a0-4d3a-b899-b442c0b7d3e4-trusted-ca\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.162545 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.162386    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/785ada15-72a0-4d3a-b899-b442c0b7d3e4-ca-trust-extracted\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.162545 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.162408    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-bound-sa-token\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.162545 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.162431    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:12.191360 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.191329    2516 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vprh_e91468e4-f06a-4102-968e-3f963db5b774/konnectivity-agent/0.log" limit=1024
Jun 14 03:13:12.262841 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.262754    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.262841 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.262803    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/785ada15-72a0-4d3a-b899-b442c0b7d3e4-trusted-ca\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.263048 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.262862    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/785ada15-72a0-4d3a-b899-b442c0b7d3e4-ca-trust-extracted\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.263048 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.262901    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-bound-sa-token\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.263048 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:12.262913    2516 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 14 03:13:12.263048 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.262927    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:12.263048 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:12.262933    2516 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d796fc86d-lwgzj: secret "image-registry-tls" not found
Jun 14 03:13:12.263048 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:12.263008    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls podName:785ada15-72a0-4d3a-b899-b442c0b7d3e4 nodeName:}" failed. No retries permitted until 2026-06-14 03:13:12.762988215 +0000 UTC m=+35.540433036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls") pod "image-registry-7d796fc86d-lwgzj" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4") : secret "image-registry-tls" not found
Jun 14 03:13:12.263381 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:12.263226    2516 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 14 03:13:12.263381 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:12.263268    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls podName:59b69d24-0cbf-41a4-a252-647f088ec7bf nodeName:}" failed. No retries permitted until 2026-06-14 03:13:12.763253961 +0000 UTC m=+35.540698762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls") pod "dns-default-2pxlj" (UID: "59b69d24-0cbf-41a4-a252-647f088ec7bf") : secret "dns-default-metrics-tls" not found
Jun 14 03:13:12.263381 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.263311    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/785ada15-72a0-4d3a-b899-b442c0b7d3e4-image-registry-private-configuration\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.263381 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.263330    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/785ada15-72a0-4d3a-b899-b442c0b7d3e4-ca-trust-extracted\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.263381 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.263349    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59b69d24-0cbf-41a4-a252-647f088ec7bf-tmp-dir\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:12.263636 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.263385    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/785ada15-72a0-4d3a-b899-b442c0b7d3e4-installation-pull-secrets\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.263636 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.263428    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqmnf\" (UniqueName: \"kubernetes.io/projected/af4c2972-fca9-4bab-b645-44b2b1e876d0-kube-api-access-sqmnf\") pod \"ingress-canary-5z9bc\" (UID: \"af4c2972-fca9-4bab-b645-44b2b1e876d0\") " pod="openshift-ingress-canary/ingress-canary-5z9bc"
Jun 14 03:13:12.263636 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.263461    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-certificates\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.263636 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.263488    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59b69d24-0cbf-41a4-a252-647f088ec7bf-config-volume\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:12.263636 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.263516    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af4c2972-fca9-4bab-b645-44b2b1e876d0-cert\") pod \"ingress-canary-5z9bc\" (UID: \"af4c2972-fca9-4bab-b645-44b2b1e876d0\") " pod="openshift-ingress-canary/ingress-canary-5z9bc"
Jun 14 03:13:12.263636 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.263541    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hw9v\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-kube-api-access-7hw9v\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.263636 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.263580    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz6p4\" (UniqueName: \"kubernetes.io/projected/59b69d24-0cbf-41a4-a252-647f088ec7bf-kube-api-access-vz6p4\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:12.263952 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.263811    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/785ada15-72a0-4d3a-b899-b442c0b7d3e4-trusted-ca\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.264426 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.264323    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-certificates\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.264426 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.264417    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59b69d24-0cbf-41a4-a252-647f088ec7bf-config-volume\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:12.264598 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.264425    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59b69d24-0cbf-41a4-a252-647f088ec7bf-tmp-dir\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:12.267968 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.267942    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/785ada15-72a0-4d3a-b899-b442c0b7d3e4-installation-pull-secrets\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.268095 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.267978    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af4c2972-fca9-4bab-b645-44b2b1e876d0-cert\") pod \"ingress-canary-5z9bc\" (UID: \"af4c2972-fca9-4bab-b645-44b2b1e876d0\") " pod="openshift-ingress-canary/ingress-canary-5z9bc"
Jun 14 03:13:12.268095 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.268052    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/785ada15-72a0-4d3a-b899-b442c0b7d3e4-image-registry-private-configuration\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.271886 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.271866    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-bound-sa-token\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.283016 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.282994    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz6p4\" (UniqueName: \"kubernetes.io/projected/59b69d24-0cbf-41a4-a252-647f088ec7bf-kube-api-access-vz6p4\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:12.283413 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.283387    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqmnf\" (UniqueName: \"kubernetes.io/projected/af4c2972-fca9-4bab-b645-44b2b1e876d0-kube-api-access-sqmnf\") pod \"ingress-canary-5z9bc\" (UID: \"af4c2972-fca9-4bab-b645-44b2b1e876d0\") " pod="openshift-ingress-canary/ingress-canary-5z9bc"
Jun 14 03:13:12.283888 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.283852    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hw9v\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-kube-api-access-7hw9v\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.287628 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.287601    2516 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vprh_e91468e4-f06a-4102-968e-3f963db5b774/konnectivity-agent/0.log" limit=1024
Jun 14 03:13:12.355612 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.355584    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5z9bc"
Jun 14 03:13:12.500445 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.500240    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5z9bc"]
Jun 14 03:13:12.504497 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:13:12.504474    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf4c2972_fca9_4bab_b645_44b2b1e876d0.slice/crio-85b70dc35c01e54859d619f202e01c13ac263be27748ec4b2acf9aa11018ae73 WatchSource:0}: Error finding container 85b70dc35c01e54859d619f202e01c13ac263be27748ec4b2acf9aa11018ae73: Status 404 returned error can't find the container with id 85b70dc35c01e54859d619f202e01c13ac263be27748ec4b2acf9aa11018ae73
Jun 14 03:13:12.768816 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.768784    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:12.769490 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.768859    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:12.769490 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:12.768942    2516 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 14 03:13:12.769490 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:12.768955    2516 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d796fc86d-lwgzj: secret "image-registry-tls" not found
Jun 14 03:13:12.769490 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:12.769006    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls podName:785ada15-72a0-4d3a-b899-b442c0b7d3e4 nodeName:}" failed. No retries permitted until 2026-06-14 03:13:13.768990659 +0000 UTC m=+36.546435480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls") pod "image-registry-7d796fc86d-lwgzj" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4") : secret "image-registry-tls" not found
Jun 14 03:13:12.769490 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:12.769014    2516 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 14 03:13:12.769490 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:12.769092    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls podName:59b69d24-0cbf-41a4-a252-647f088ec7bf nodeName:}" failed. No retries permitted until 2026-06-14 03:13:13.769064369 +0000 UTC m=+36.546509171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls") pod "dns-default-2pxlj" (UID: "59b69d24-0cbf-41a4-a252-647f088ec7bf") : secret "dns-default-metrics-tls" not found
Jun 14 03:13:12.912734 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:12.912686    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5z9bc" event={"ID":"af4c2972-fca9-4bab-b645-44b2b1e876d0","Type":"ContainerStarted","Data":"85b70dc35c01e54859d619f202e01c13ac263be27748ec4b2acf9aa11018ae73"}
Jun 14 03:13:13.656670 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:13.656635    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:13:13.656670 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:13.656659    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:13:13.656923 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:13.656816    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:13:13.660895 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:13.660818    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 14 03:13:13.660895 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:13.660837    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6hmrz\""
Jun 14 03:13:13.660895 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:13.660882    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 14 03:13:13.660895 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:13.660891    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 14 03:13:13.661271 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:13.660914    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 14 03:13:13.661271 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:13.660882    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-68bfl\""
Jun 14 03:13:13.777854 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:13.777822    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:13.778305 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:13.777907    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:13.778305 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:13.777972    2516 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 14 03:13:13.778305 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:13.777995    2516 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d796fc86d-lwgzj: secret "image-registry-tls" not found
Jun 14 03:13:13.778305 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:13.778046    2516 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 14 03:13:13.778305 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:13.778067    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls podName:785ada15-72a0-4d3a-b899-b442c0b7d3e4 nodeName:}" failed. No retries permitted until 2026-06-14 03:13:15.778045163 +0000 UTC m=+38.555489978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls") pod "image-registry-7d796fc86d-lwgzj" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4") : secret "image-registry-tls" not found
Jun 14 03:13:13.778305 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:13.778117    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls podName:59b69d24-0cbf-41a4-a252-647f088ec7bf nodeName:}" failed. No retries permitted until 2026-06-14 03:13:15.778100823 +0000 UTC m=+38.555545640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls") pod "dns-default-2pxlj" (UID: "59b69d24-0cbf-41a4-a252-647f088ec7bf") : secret "dns-default-metrics-tls" not found
Jun 14 03:13:15.793860 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:15.793782    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:15.793860 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:15.793841    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:15.794228 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:15.793928    2516 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 14 03:13:15.794228 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:15.793994    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls podName:59b69d24-0cbf-41a4-a252-647f088ec7bf nodeName:}" failed. No retries permitted until 2026-06-14 03:13:19.793977542 +0000 UTC m=+42.571422347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls") pod "dns-default-2pxlj" (UID: "59b69d24-0cbf-41a4-a252-647f088ec7bf") : secret "dns-default-metrics-tls" not found
Jun 14 03:13:15.794228 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:15.793930    2516 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 14 03:13:15.794228 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:15.794018    2516 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d796fc86d-lwgzj: secret "image-registry-tls" not found
Jun 14 03:13:15.794228 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:15.794048    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls podName:785ada15-72a0-4d3a-b899-b442c0b7d3e4 nodeName:}" failed. No retries permitted until 2026-06-14 03:13:19.794041353 +0000 UTC m=+42.571486153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls") pod "image-registry-7d796fc86d-lwgzj" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4") : secret "image-registry-tls" not found
Jun 14 03:13:15.921698 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:15.921665    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5z9bc" event={"ID":"af4c2972-fca9-4bab-b645-44b2b1e876d0","Type":"ContainerStarted","Data":"077b073ef1bff7dba949afe185b9eaab01a8481bb9e9efdb642602e0fc313723"}
Jun 14 03:13:15.924172 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:15.924147    2516 generic.go:356] "Generic (PLEG): container finished" podID="b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c" containerID="12c2a2bd118c7886920a19c5ef2cfd63fc58d17ba6a929b943d6c3affbe6ae61" exitCode=0
Jun 14 03:13:15.924283 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:15.924180    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9cw2" event={"ID":"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c","Type":"ContainerDied","Data":"12c2a2bd118c7886920a19c5ef2cfd63fc58d17ba6a929b943d6c3affbe6ae61"}
Jun 14 03:13:15.937550 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:15.937509    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5z9bc" podStartSLOduration=0.984680532 podStartE2EDuration="3.937495373s" totalImagesPullingTime="2.952814841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:15.936503954 +0000 UTC m=+38.713948778" watchObservedRunningTime="2026-06-14 03:13:15.937495373 +0000 UTC m=+38.714940195"
Jun 14 03:13:16.929095 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:16.928899    2516 generic.go:356] "Generic (PLEG): container finished" podID="b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c" containerID="e2fc93b35323c84da9970afd2207a5b1bb8548b38d47b9aef11ae329a24e4831" exitCode=0
Jun 14 03:13:16.929427 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:16.928979    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9cw2" event={"ID":"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c","Type":"ContainerDied","Data":"e2fc93b35323c84da9970afd2207a5b1bb8548b38d47b9aef11ae329a24e4831"}
Jun 14 03:13:17.432658 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:17.432623    2516 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vprh_e91468e4-f06a-4102-968e-3f963db5b774/konnectivity-agent/0.log" limit=1024
Jun 14 03:13:17.934649 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:17.934612    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9cw2" event={"ID":"b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c","Type":"ContainerStarted","Data":"1b5b915e7aed26f83c6df092e6ba57fb248cb7290d1b681c585a7369860dbeb7"}
Jun 14 03:13:17.960373 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:17.960324    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p9cw2" podStartSLOduration=9.120926513 podStartE2EDuration="40.960307591s" totalImagesPullingTime="31.839381078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:17.959514865 +0000 UTC m=+40.736959690" watchObservedRunningTime="2026-06-14 03:13:17.960307591 +0000 UTC m=+40.737752414"
Jun 14 03:13:18.083281 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:18.083244    2516 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vprh_e91468e4-f06a-4102-968e-3f963db5b774/konnectivity-agent/0.log" limit=1024
Jun 14 03:13:18.140582 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:18.140554    2516 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vprh_e91468e4-f06a-4102-968e-3f963db5b774/konnectivity-agent/0.log" limit=1024
Jun 14 03:13:19.825462 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:19.825428    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:19.825874 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:19.825489    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:19.825874 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:19.825590    2516 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 14 03:13:19.825874 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:19.825595    2516 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 14 03:13:19.825874 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:19.825613    2516 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d796fc86d-lwgzj: secret "image-registry-tls" not found
Jun 14 03:13:19.825874 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:19.825642    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls podName:59b69d24-0cbf-41a4-a252-647f088ec7bf nodeName:}" failed. No retries permitted until 2026-06-14 03:13:27.825629671 +0000 UTC m=+50.603074472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls") pod "dns-default-2pxlj" (UID: "59b69d24-0cbf-41a4-a252-647f088ec7bf") : secret "dns-default-metrics-tls" not found
Jun 14 03:13:19.825874 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:19.825666    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls podName:785ada15-72a0-4d3a-b899-b442c0b7d3e4 nodeName:}" failed. No retries permitted until 2026-06-14 03:13:27.825652946 +0000 UTC m=+50.603097748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls") pod "image-registry-7d796fc86d-lwgzj" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4") : secret "image-registry-tls" not found
Jun 14 03:13:27.884127 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:27.884065    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:27.884661 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:27.884161    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:27.884661 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:27.884224    2516 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 14 03:13:27.884661 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:27.884248    2516 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d796fc86d-lwgzj: secret "image-registry-tls" not found
Jun 14 03:13:27.884661 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:27.884266    2516 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 14 03:13:27.884661 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:27.884319    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls podName:785ada15-72a0-4d3a-b899-b442c0b7d3e4 nodeName:}" failed. No retries permitted until 2026-06-14 03:13:43.884299645 +0000 UTC m=+66.661744467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls") pod "image-registry-7d796fc86d-lwgzj" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4") : secret "image-registry-tls" not found
Jun 14 03:13:27.884661 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:27.884339    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls podName:59b69d24-0cbf-41a4-a252-647f088ec7bf nodeName:}" failed. No retries permitted until 2026-06-14 03:13:43.884331006 +0000 UTC m=+66.661775821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls") pod "dns-default-2pxlj" (UID: "59b69d24-0cbf-41a4-a252-647f088ec7bf") : secret "dns-default-metrics-tls" not found
Jun 14 03:13:37.911538 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:37.911502    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdpjm"
Jun 14 03:13:42.479842 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:42.479803    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret\") pod \"global-pull-secret-syncer-xqgzv\" (UID: \"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e\") " pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:13:42.480295 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:42.479859    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs\") pod \"network-metrics-daemon-c7zzq\" (UID: \"a7812b72-9313-42ca-96cf-cde0c84e41d6\") " pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:13:42.482609 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:42.482590    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 14 03:13:42.482703 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:42.482610    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 14 03:13:42.490588 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:42.490569    2516 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 14 03:13:42.490653 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:42.490641    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs podName:a7812b72-9313-42ca-96cf-cde0c84e41d6 nodeName:}" failed. No retries permitted until 2026-06-14 03:14:46.490623007 +0000 UTC m=+129.268067823 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs") pod "network-metrics-daemon-c7zzq" (UID: "a7812b72-9313-42ca-96cf-cde0c84e41d6") : secret "metrics-daemon-secret" not found
Jun 14 03:13:42.494209 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:42.494192    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e-original-pull-secret\") pod \"global-pull-secret-syncer-xqgzv\" (UID: \"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e\") " pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:13:42.580956 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:42.580924    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgrxg\" (UniqueName: \"kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg\") pod \"network-check-target-v662t\" (UID: \"9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d\") " pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:13:42.583577 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:42.583555    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 14 03:13:42.593441 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:42.593422    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 14 03:13:42.603735 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:42.603715    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgrxg\" (UniqueName: \"kubernetes.io/projected/9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d-kube-api-access-sgrxg\") pod \"network-check-target-v662t\" (UID: \"9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d\") " pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:13:42.774651 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:42.774566    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqgzv"
Jun 14 03:13:42.782870 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:42.782841    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-68bfl\""
Jun 14 03:13:42.791208 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:42.791184    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:13:42.901882 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:42.901830    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xqgzv"]
Jun 14 03:13:42.905507 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:13:42.905480    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58fb4ed6_26bd_43a3_a1d1_fbfa9a0aa81e.slice/crio-0cef33ca1115aa67bf1b925965923f4cf31bf4a752a1d7f0e1194b901982e4e0 WatchSource:0}: Error finding container 0cef33ca1115aa67bf1b925965923f4cf31bf4a752a1d7f0e1194b901982e4e0: Status 404 returned error can't find the container with id 0cef33ca1115aa67bf1b925965923f4cf31bf4a752a1d7f0e1194b901982e4e0
Jun 14 03:13:42.916965 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:42.916932    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v662t"]
Jun 14 03:13:42.921831 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:13:42.921801    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c24c6d8_0272_4a18_91c6_8c7f4f7ae98d.slice/crio-292f3ebda65b2387bbf90a2bc7baac6184cecd92f1391919799ab40cdd1a6eef WatchSource:0}: Error finding container 292f3ebda65b2387bbf90a2bc7baac6184cecd92f1391919799ab40cdd1a6eef: Status 404 returned error can't find the container with id 292f3ebda65b2387bbf90a2bc7baac6184cecd92f1391919799ab40cdd1a6eef
Jun 14 03:13:42.989735 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:42.989697    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v662t" event={"ID":"9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d","Type":"ContainerStarted","Data":"292f3ebda65b2387bbf90a2bc7baac6184cecd92f1391919799ab40cdd1a6eef"}
Jun 14 03:13:42.990735 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:42.990704    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xqgzv" event={"ID":"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e","Type":"ContainerStarted","Data":"0cef33ca1115aa67bf1b925965923f4cf31bf4a752a1d7f0e1194b901982e4e0"}
Jun 14 03:13:43.890394 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:43.890364    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:13:43.890862 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:43.890419    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:13:43.890862 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:43.890541    2516 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 14 03:13:43.890862 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:43.890552    2516 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d796fc86d-lwgzj: secret "image-registry-tls" not found
Jun 14 03:13:43.890862 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:43.890550    2516 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 14 03:13:43.890862 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:43.890617    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls podName:785ada15-72a0-4d3a-b899-b442c0b7d3e4 nodeName:}" failed. No retries permitted until 2026-06-14 03:14:15.890601086 +0000 UTC m=+98.668045890 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls") pod "image-registry-7d796fc86d-lwgzj" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4") : secret "image-registry-tls" not found
Jun 14 03:13:43.890862 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:13:43.890635    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls podName:59b69d24-0cbf-41a4-a252-647f088ec7bf nodeName:}" failed. No retries permitted until 2026-06-14 03:14:15.890627155 +0000 UTC m=+98.668071957 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls") pod "dns-default-2pxlj" (UID: "59b69d24-0cbf-41a4-a252-647f088ec7bf") : secret "dns-default-metrics-tls" not found
Jun 14 03:13:48.005305 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:48.005264    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xqgzv" event={"ID":"58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e","Type":"ContainerStarted","Data":"c8f8ab35a250f9691dc0186f58b6f8daf697719920ae2ebce9b0cf13c53cf96a"}
Jun 14 03:13:48.006611 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:48.006591    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v662t" event={"ID":"9c24c6d8-0272-4a18-91c6-8c7f4f7ae98d","Type":"ContainerStarted","Data":"5c740c8ccdb27e87749372dd7fe997bb509be7d5b6eb3d295eb2fa70d1a42f53"}
Jun 14 03:13:48.006732 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:48.006717    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:13:48.022587 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:48.022066    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xqgzv" podStartSLOduration=65.360965221 podStartE2EDuration="1m10.022047735s" totalImagesPullingTime="4.661082514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:48.019337248 +0000 UTC m=+70.796782071" watchObservedRunningTime="2026-06-14 03:13:48.022047735 +0000 UTC m=+70.799492538"
Jun 14 03:13:48.034095 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:13:48.034040    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-v662t" podStartSLOduration=66.392211186 podStartE2EDuration="1m11.034028943s" totalImagesPullingTime="4.641817757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:48.033495238 +0000 UTC m=+70.810940062" watchObservedRunningTime="2026-06-14 03:13:48.034028943 +0000 UTC m=+70.811473766"
Jun 14 03:14:15.906427 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:14:15.906395    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:14:15.906861 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:14:15.906450    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:14:15.906861 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:14:15.906535    2516 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 14 03:14:15.906861 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:14:15.906586    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls podName:59b69d24-0cbf-41a4-a252-647f088ec7bf nodeName:}" failed. No retries permitted until 2026-06-14 03:15:19.906571973 +0000 UTC m=+162.684016775 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls") pod "dns-default-2pxlj" (UID: "59b69d24-0cbf-41a4-a252-647f088ec7bf") : secret "dns-default-metrics-tls" not found
Jun 14 03:14:15.906861 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:14:15.906533    2516 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 14 03:14:15.906861 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:14:15.906640    2516 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d796fc86d-lwgzj: secret "image-registry-tls" not found
Jun 14 03:14:15.906861 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:14:15.906723    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls podName:785ada15-72a0-4d3a-b899-b442c0b7d3e4 nodeName:}" failed. No retries permitted until 2026-06-14 03:15:19.906704362 +0000 UTC m=+162.684149183 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls") pod "image-registry-7d796fc86d-lwgzj" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4") : secret "image-registry-tls" not found
Jun 14 03:14:19.012373 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:14:19.012344    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-v662t"
Jun 14 03:14:46.507443 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:14:46.507391    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs\") pod \"network-metrics-daemon-c7zzq\" (UID: \"a7812b72-9313-42ca-96cf-cde0c84e41d6\") " pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:14:46.508028 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:14:46.507578    2516 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 14 03:14:46.508028 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:14:46.507678    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs podName:a7812b72-9313-42ca-96cf-cde0c84e41d6 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:48.507655131 +0000 UTC m=+251.285099950 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs") pod "network-metrics-daemon-c7zzq" (UID: "a7812b72-9313-42ca-96cf-cde0c84e41d6") : secret "metrics-daemon-secret" not found
Jun 14 03:15:15.037509 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:15:15.037460    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj" podUID="785ada15-72a0-4d3a-b899-b442c0b7d3e4"
Jun 14 03:15:15.049599 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:15:15.049568    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2pxlj" podUID="59b69d24-0cbf-41a4-a252-647f088ec7bf"
Jun 14 03:15:15.215654 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:15:15.215622    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:15:15.215814 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:15:15.215622    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:15:16.667659 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:15:16.667615    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:15:19.932314 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:15:19.932260    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:15:19.932314 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:15:19.932330    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:15:19.932815 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:15:19.932416    2516 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 14 03:15:19.932815 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:15:19.932427    2516 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 14 03:15:19.932815 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:15:19.932451    2516 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d796fc86d-lwgzj: secret "image-registry-tls" not found
Jun 14 03:15:19.932815 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:15:19.932476    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls podName:59b69d24-0cbf-41a4-a252-647f088ec7bf nodeName:}" failed. No retries permitted until 2026-06-14 03:17:21.932462397 +0000 UTC m=+284.709907198 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls") pod "dns-default-2pxlj" (UID: "59b69d24-0cbf-41a4-a252-647f088ec7bf") : secret "dns-default-metrics-tls" not found
Jun 14 03:15:19.932815 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:15:19.932507    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls podName:785ada15-72a0-4d3a-b899-b442c0b7d3e4 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:21.932486266 +0000 UTC m=+284.709931087 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls") pod "image-registry-7d796fc86d-lwgzj" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4") : secret "image-registry-tls" not found
Jun 14 03:15:29.652920 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:15:29.652833    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:16:48.537687 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:48.537648    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs\") pod \"network-metrics-daemon-c7zzq\" (UID: \"a7812b72-9313-42ca-96cf-cde0c84e41d6\") " pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:16:48.538194 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:48.537799    2516 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 14 03:16:48.538194 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:48.537876    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs podName:a7812b72-9313-42ca-96cf-cde0c84e41d6 nodeName:}" failed. No retries permitted until 2026-06-14 03:18:50.537857049 +0000 UTC m=+373.315302080 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs") pod "network-metrics-daemon-c7zzq" (UID: "a7812b72-9313-42ca-96cf-cde0c84e41d6") : secret "metrics-daemon-secret" not found
Jun 14 03:16:50.350227 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.350185    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"]
Jun 14 03:16:50.352162 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.352146    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-g9m86"]
Jun 14 03:16:50.352278 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.352259    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"
Jun 14 03:16:50.353648 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.353630    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:16:50.354550 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.354494    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jun 14 03:16:50.354677 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.354658    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jun 14 03:16:50.355039 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.355024    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hhrrj\""
Jun 14 03:16:50.356198 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.356138    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-llpfx\""
Jun 14 03:16:50.356372 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.356200    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jun 14 03:16:50.356477 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.356414    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jun 14 03:16:50.356905 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.356683    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff"]
Jun 14 03:16:50.356905 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.356737    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jun 14 03:16:50.357115 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.357094    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jun 14 03:16:50.358442 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.358425    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-775bdfb79b-5kgtp"]
Jun 14 03:16:50.358554 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.358539    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff"
Jun 14 03:16:50.360243 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.360068    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-jk9zm"]
Jun 14 03:16:50.360314 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.360242    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:50.360887 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.360857    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jun 14 03:16:50.360983 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.360942    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-99bxp\""
Jun 14 03:16:50.361259 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.361243    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jun 14 03:16:50.361328 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.361247    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jun 14 03:16:50.362269 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.362250    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-jk9zm"
Jun 14 03:16:50.363362 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.363340    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jun 14 03:16:50.364270 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.364251    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"]
Jun 14 03:16:50.364426 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.364405    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jun 14 03:16:50.364572 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.364553    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 14 03:16:50.364725 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.364708    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 14 03:16:50.366441 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.365375    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jun 14 03:16:50.366441 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.365551    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jun 14 03:16:50.366441 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.365705    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jun 14 03:16:50.366441 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.366133    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jun 14 03:16:50.366732 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.366491    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-t6nnh\""
Jun 14 03:16:50.367000 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.366984    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jun 14 03:16:50.367068 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.366996    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qbcf9\""
Jun 14 03:16:50.369332 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.369308    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-g9m86"]
Jun 14 03:16:50.372911 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.372890    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-jk9zm"]
Jun 14 03:16:50.374190 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.374143    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff"]
Jun 14 03:16:50.381329 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.381309    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-775bdfb79b-5kgtp"]
Jun 14 03:16:50.451977 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.451945    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l7hb\" (UniqueName: \"kubernetes.io/projected/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-kube-api-access-6l7hb\") pod \"cluster-samples-operator-9547488fd-k7zff\" (UID: \"174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff"
Jun 14 03:16:50.451977 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.451980    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv5pd\" (UniqueName: \"kubernetes.io/projected/3556d3e2-30f5-4112-b2c4-eec9f15b066c-kube-api-access-tv5pd\") pod \"volume-data-source-validator-bd4ccd799-jk9zm\" (UID: \"3556d3e2-30f5-4112-b2c4-eec9f15b066c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-jk9zm"
Jun 14 03:16:50.452232 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.451998    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-s4qdr\" (UID: \"0e07ac22-26c0-4234-90b8-f52f2c22c896\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"
Jun 14 03:16:50.452232 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.452064    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-k7zff\" (UID: \"174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff"
Jun 14 03:16:50.452232 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.452124    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:50.452232 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.452155    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9fddd80-a36b-4069-82a5-25b8f9332e38-config\") pod \"console-operator-5dbbb5d744-g9m86\" (UID: \"b9fddd80-a36b-4069-82a5-25b8f9332e38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:16:50.452232 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.452177    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-stats-auth\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:50.452420 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.452267    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:50.452420 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.452315    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8wxq\" (UniqueName: \"kubernetes.io/projected/b9fddd80-a36b-4069-82a5-25b8f9332e38-kube-api-access-p8wxq\") pod \"console-operator-5dbbb5d744-g9m86\" (UID: \"b9fddd80-a36b-4069-82a5-25b8f9332e38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:16:50.452420 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.452335    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9fddd80-a36b-4069-82a5-25b8f9332e38-serving-cert\") pod \"console-operator-5dbbb5d744-g9m86\" (UID: \"b9fddd80-a36b-4069-82a5-25b8f9332e38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:16:50.452420 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.452364    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spnbn\" (UniqueName: \"kubernetes.io/projected/d13e7b69-fc43-4106-81dc-286e6f6cc59c-kube-api-access-spnbn\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:50.452420 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.452392    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e07ac22-26c0-4234-90b8-f52f2c22c896-nginx-conf\") pod \"networking-console-plugin-867b76cb74-s4qdr\" (UID: \"0e07ac22-26c0-4234-90b8-f52f2c22c896\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"
Jun 14 03:16:50.452571 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.452426    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-default-certificate\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:50.452571 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.452481    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9fddd80-a36b-4069-82a5-25b8f9332e38-trusted-ca\") pod \"console-operator-5dbbb5d744-g9m86\" (UID: \"b9fddd80-a36b-4069-82a5-25b8f9332e38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:16:50.549532 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.549499    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-5tw5w"]
Jun 14 03:16:50.551717 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.551697    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-5tw5w"
Jun 14 03:16:50.553382 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.553360    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:50.553462 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.553404    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8wxq\" (UniqueName: \"kubernetes.io/projected/b9fddd80-a36b-4069-82a5-25b8f9332e38-kube-api-access-p8wxq\") pod \"console-operator-5dbbb5d744-g9m86\" (UID: \"b9fddd80-a36b-4069-82a5-25b8f9332e38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:16:50.553462 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.553425    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9fddd80-a36b-4069-82a5-25b8f9332e38-serving-cert\") pod \"console-operator-5dbbb5d744-g9m86\" (UID: \"b9fddd80-a36b-4069-82a5-25b8f9332e38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:16:50.553558 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:50.553511    2516 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 14 03:16:50.553608 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:50.553574    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs podName:d13e7b69-fc43-4106-81dc-286e6f6cc59c nodeName:}" failed. No retries permitted until 2026-06-14 03:16:51.053555697 +0000 UTC m=+253.831000500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs") pod "router-default-775bdfb79b-5kgtp" (UID: "d13e7b69-fc43-4106-81dc-286e6f6cc59c") : secret "router-metrics-certs-default" not found
Jun 14 03:16:50.553608 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.553558    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spnbn\" (UniqueName: \"kubernetes.io/projected/d13e7b69-fc43-4106-81dc-286e6f6cc59c-kube-api-access-spnbn\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:50.553725 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.553652    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e07ac22-26c0-4234-90b8-f52f2c22c896-nginx-conf\") pod \"networking-console-plugin-867b76cb74-s4qdr\" (UID: \"0e07ac22-26c0-4234-90b8-f52f2c22c896\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"
Jun 14 03:16:50.553725 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.553691    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-default-certificate\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:50.553823 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.553726    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9fddd80-a36b-4069-82a5-25b8f9332e38-trusted-ca\") pod \"console-operator-5dbbb5d744-g9m86\" (UID: \"b9fddd80-a36b-4069-82a5-25b8f9332e38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:16:50.553823 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.553790    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l7hb\" (UniqueName: \"kubernetes.io/projected/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-kube-api-access-6l7hb\") pod \"cluster-samples-operator-9547488fd-k7zff\" (UID: \"174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff"
Jun 14 03:16:50.553924 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.553825    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv5pd\" (UniqueName: \"kubernetes.io/projected/3556d3e2-30f5-4112-b2c4-eec9f15b066c-kube-api-access-tv5pd\") pod \"volume-data-source-validator-bd4ccd799-jk9zm\" (UID: \"3556d3e2-30f5-4112-b2c4-eec9f15b066c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-jk9zm"
Jun 14 03:16:50.553924 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.553852    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-s4qdr\" (UID: \"0e07ac22-26c0-4234-90b8-f52f2c22c896\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"
Jun 14 03:16:50.553924 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.553904    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-k7zff\" (UID: \"174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff"
Jun 14 03:16:50.554071 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.553937    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:50.554071 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.553963    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9fddd80-a36b-4069-82a5-25b8f9332e38-config\") pod \"console-operator-5dbbb5d744-g9m86\" (UID: \"b9fddd80-a36b-4069-82a5-25b8f9332e38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:16:50.554071 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.553986    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-stats-auth\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:50.554071 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.553891    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-djgtn\""
Jun 14 03:16:50.554301 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:50.554207    2516 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 14 03:16:50.554301 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:50.554250    2516 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 14 03:16:50.554301 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:50.554274    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert podName:0e07ac22-26c0-4234-90b8-f52f2c22c896 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:51.054239069 +0000 UTC m=+253.831683892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-s4qdr" (UID: "0e07ac22-26c0-4234-90b8-f52f2c22c896") : secret "networking-console-plugin-cert" not found
Jun 14 03:16:50.554301 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:50.554298    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls podName:174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:51.054286153 +0000 UTC m=+253.831730966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls") pod "cluster-samples-operator-9547488fd-k7zff" (UID: "174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8") : secret "samples-operator-tls" not found
Jun 14 03:16:50.554517 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:50.554356    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle podName:d13e7b69-fc43-4106-81dc-286e6f6cc59c nodeName:}" failed. No retries permitted until 2026-06-14 03:16:51.054345637 +0000 UTC m=+253.831790463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle") pod "router-default-775bdfb79b-5kgtp" (UID: "d13e7b69-fc43-4106-81dc-286e6f6cc59c") : configmap references non-existent config key: service-ca.crt
Jun 14 03:16:50.554517 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.554469    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e07ac22-26c0-4234-90b8-f52f2c22c896-nginx-conf\") pod \"networking-console-plugin-867b76cb74-s4qdr\" (UID: \"0e07ac22-26c0-4234-90b8-f52f2c22c896\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"
Jun 14 03:16:50.554778 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.554753    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9fddd80-a36b-4069-82a5-25b8f9332e38-trusted-ca\") pod \"console-operator-5dbbb5d744-g9m86\" (UID: \"b9fddd80-a36b-4069-82a5-25b8f9332e38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:16:50.554854 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.554759    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9fddd80-a36b-4069-82a5-25b8f9332e38-config\") pod \"console-operator-5dbbb5d744-g9m86\" (UID: \"b9fddd80-a36b-4069-82a5-25b8f9332e38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:16:50.555919 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.555895    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9fddd80-a36b-4069-82a5-25b8f9332e38-serving-cert\") pod \"console-operator-5dbbb5d744-g9m86\" (UID: \"b9fddd80-a36b-4069-82a5-25b8f9332e38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:16:50.556554 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.556538    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-stats-auth\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:50.557069 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.557054    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-default-certificate\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:50.561304 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.561269    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-5tw5w"]
Jun 14 03:16:50.565140 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.565115    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8wxq\" (UniqueName: \"kubernetes.io/projected/b9fddd80-a36b-4069-82a5-25b8f9332e38-kube-api-access-p8wxq\") pod \"console-operator-5dbbb5d744-g9m86\" (UID: \"b9fddd80-a36b-4069-82a5-25b8f9332e38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:16:50.565411 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.565389    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spnbn\" (UniqueName: \"kubernetes.io/projected/d13e7b69-fc43-4106-81dc-286e6f6cc59c-kube-api-access-spnbn\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:50.565506 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.565443    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l7hb\" (UniqueName: \"kubernetes.io/projected/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-kube-api-access-6l7hb\") pod \"cluster-samples-operator-9547488fd-k7zff\" (UID: \"174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff"
Jun 14 03:16:50.566165 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.566148    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv5pd\" (UniqueName: \"kubernetes.io/projected/3556d3e2-30f5-4112-b2c4-eec9f15b066c-kube-api-access-tv5pd\") pod \"volume-data-source-validator-bd4ccd799-jk9zm\" (UID: \"3556d3e2-30f5-4112-b2c4-eec9f15b066c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-jk9zm"
Jun 14 03:16:50.654492 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.654462    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqvlc\" (UniqueName: \"kubernetes.io/projected/d9c44d38-0255-4012-b95a-1ef774741a43-kube-api-access-bqvlc\") pod \"network-check-source-6947749cfc-5tw5w\" (UID: \"d9c44d38-0255-4012-b95a-1ef774741a43\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-5tw5w"
Jun 14 03:16:50.672597 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.672577    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:16:50.692333 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.692306    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-jk9zm"
Jun 14 03:16:50.755732 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.755702    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqvlc\" (UniqueName: \"kubernetes.io/projected/d9c44d38-0255-4012-b95a-1ef774741a43-kube-api-access-bqvlc\") pod \"network-check-source-6947749cfc-5tw5w\" (UID: \"d9c44d38-0255-4012-b95a-1ef774741a43\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-5tw5w"
Jun 14 03:16:50.767534 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.767502    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqvlc\" (UniqueName: \"kubernetes.io/projected/d9c44d38-0255-4012-b95a-1ef774741a43-kube-api-access-bqvlc\") pod \"network-check-source-6947749cfc-5tw5w\" (UID: \"d9c44d38-0255-4012-b95a-1ef774741a43\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-5tw5w"
Jun 14 03:16:50.798808 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.798780    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-g9m86"]
Jun 14 03:16:50.801705 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:16:50.801676    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9fddd80_a36b_4069_82a5_25b8f9332e38.slice/crio-bf4a0dda62c2c6567853f155a23bdafa6ce1fda41f9f132143e372562f917086 WatchSource:0}: Error finding container bf4a0dda62c2c6567853f155a23bdafa6ce1fda41f9f132143e372562f917086: Status 404 returned error can't find the container with id bf4a0dda62c2c6567853f155a23bdafa6ce1fda41f9f132143e372562f917086
Jun 14 03:16:50.813302 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.813279    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-jk9zm"]
Jun 14 03:16:50.815844 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:16:50.815824    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3556d3e2_30f5_4112_b2c4_eec9f15b066c.slice/crio-1c16f9a398c8bf544e0a3c35b9bbd41530dd7c5e83042d45795eed4e814fb5bd WatchSource:0}: Error finding container 1c16f9a398c8bf544e0a3c35b9bbd41530dd7c5e83042d45795eed4e814fb5bd: Status 404 returned error can't find the container with id 1c16f9a398c8bf544e0a3c35b9bbd41530dd7c5e83042d45795eed4e814fb5bd
Jun 14 03:16:50.877384 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:50.877360    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-5tw5w"
Jun 14 03:16:51.007644 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:51.007614    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-5tw5w"]
Jun 14 03:16:51.010463 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:16:51.010435    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c44d38_0255_4012_b95a_1ef774741a43.slice/crio-eb850b0f9cce57a7e3c0056544484ffb36c5aeae080314bfefe571cad6957beb WatchSource:0}: Error finding container eb850b0f9cce57a7e3c0056544484ffb36c5aeae080314bfefe571cad6957beb: Status 404 returned error can't find the container with id eb850b0f9cce57a7e3c0056544484ffb36c5aeae080314bfefe571cad6957beb
Jun 14 03:16:51.057886 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:51.057863    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-s4qdr\" (UID: \"0e07ac22-26c0-4234-90b8-f52f2c22c896\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"
Jun 14 03:16:51.057975 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:51.057904    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-k7zff\" (UID: \"174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff"
Jun 14 03:16:51.057975 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:51.057924    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:51.058097 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:51.058057    2516 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 14 03:16:51.058160 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:51.058136    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls podName:174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:52.058116653 +0000 UTC m=+254.835561474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls") pod "cluster-samples-operator-9547488fd-k7zff" (UID: "174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8") : secret "samples-operator-tls" not found
Jun 14 03:16:51.058160 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:51.058147    2516 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 14 03:16:51.058160 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:51.058155    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle podName:d13e7b69-fc43-4106-81dc-286e6f6cc59c nodeName:}" failed. No retries permitted until 2026-06-14 03:16:52.058145567 +0000 UTC m=+254.835590373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle") pod "router-default-775bdfb79b-5kgtp" (UID: "d13e7b69-fc43-4106-81dc-286e6f6cc59c") : configmap references non-existent config key: service-ca.crt
Jun 14 03:16:51.058283 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:51.058195    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert podName:0e07ac22-26c0-4234-90b8-f52f2c22c896 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:52.058180828 +0000 UTC m=+254.835625634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-s4qdr" (UID: "0e07ac22-26c0-4234-90b8-f52f2c22c896") : secret "networking-console-plugin-cert" not found
Jun 14 03:16:51.058283 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:51.058223    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:51.058364 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:51.058320    2516 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 14 03:16:51.058364 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:51.058353    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs podName:d13e7b69-fc43-4106-81dc-286e6f6cc59c nodeName:}" failed. No retries permitted until 2026-06-14 03:16:52.058345832 +0000 UTC m=+254.835790636 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs") pod "router-default-775bdfb79b-5kgtp" (UID: "d13e7b69-fc43-4106-81dc-286e6f6cc59c") : secret "router-metrics-certs-default" not found
Jun 14 03:16:51.434879 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:51.434837    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-jk9zm" event={"ID":"3556d3e2-30f5-4112-b2c4-eec9f15b066c","Type":"ContainerStarted","Data":"1c16f9a398c8bf544e0a3c35b9bbd41530dd7c5e83042d45795eed4e814fb5bd"}
Jun 14 03:16:51.436506 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:51.436317    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86" event={"ID":"b9fddd80-a36b-4069-82a5-25b8f9332e38","Type":"ContainerStarted","Data":"bf4a0dda62c2c6567853f155a23bdafa6ce1fda41f9f132143e372562f917086"}
Jun 14 03:16:51.438104 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:51.438060    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-5tw5w" event={"ID":"d9c44d38-0255-4012-b95a-1ef774741a43","Type":"ContainerStarted","Data":"5e5405285c9b7b1f1bd07dce3acb8e63e4f699de37758d6b9a838ee031b1e7c7"}
Jun 14 03:16:51.438220 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:51.438123    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-5tw5w" event={"ID":"d9c44d38-0255-4012-b95a-1ef774741a43","Type":"ContainerStarted","Data":"eb850b0f9cce57a7e3c0056544484ffb36c5aeae080314bfefe571cad6957beb"}
Jun 14 03:16:51.452396 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:51.452335    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-5tw5w" podStartSLOduration=1.452315933 podStartE2EDuration="1.452315933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:16:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:16:51.45120642 +0000 UTC m=+254.228651254" watchObservedRunningTime="2026-06-14 03:16:51.452315933 +0000 UTC m=+254.229760757"
Jun 14 03:16:52.065401 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:52.065357    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-s4qdr\" (UID: \"0e07ac22-26c0-4234-90b8-f52f2c22c896\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"
Jun 14 03:16:52.065601 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:52.065432    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-k7zff\" (UID: \"174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff"
Jun 14 03:16:52.065601 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:52.065464    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:52.065601 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:52.065514    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:52.065775 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:52.065623    2516 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 14 03:16:52.065775 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:52.065667    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle podName:d13e7b69-fc43-4106-81dc-286e6f6cc59c nodeName:}" failed. No retries permitted until 2026-06-14 03:16:54.065648767 +0000 UTC m=+256.843093571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle") pod "router-default-775bdfb79b-5kgtp" (UID: "d13e7b69-fc43-4106-81dc-286e6f6cc59c") : configmap references non-existent config key: service-ca.crt
Jun 14 03:16:52.065775 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:52.065623    2516 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 14 03:16:52.065775 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:52.065682    2516 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 14 03:16:52.065982 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:52.065691    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls podName:174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:54.065676372 +0000 UTC m=+256.843121176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls") pod "cluster-samples-operator-9547488fd-k7zff" (UID: "174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8") : secret "samples-operator-tls" not found
Jun 14 03:16:52.065982 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:52.065812    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert podName:0e07ac22-26c0-4234-90b8-f52f2c22c896 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:54.065789641 +0000 UTC m=+256.843234451 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-s4qdr" (UID: "0e07ac22-26c0-4234-90b8-f52f2c22c896") : secret "networking-console-plugin-cert" not found
Jun 14 03:16:52.065982 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:52.065831    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs podName:d13e7b69-fc43-4106-81dc-286e6f6cc59c nodeName:}" failed. No retries permitted until 2026-06-14 03:16:54.065821314 +0000 UTC m=+256.843266118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs") pod "router-default-775bdfb79b-5kgtp" (UID: "d13e7b69-fc43-4106-81dc-286e6f6cc59c") : secret "router-metrics-certs-default" not found
Jun 14 03:16:52.443995 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:52.443959    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-jk9zm" event={"ID":"3556d3e2-30f5-4112-b2c4-eec9f15b066c","Type":"ContainerStarted","Data":"5939b18348da4f63b9a22c0aac0f87f58f9a9122d8497e3e838fe08ad6662377"}
Jun 14 03:16:52.459213 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:52.459161    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-jk9zm" podStartSLOduration=1.16465745 podStartE2EDuration="2.459143557s" totalImagesPullingTime="1.294486107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:16:52.458306872 +0000 UTC m=+255.235751696" watchObservedRunningTime="2026-06-14 03:16:52.459143557 +0000 UTC m=+255.236588389"
Jun 14 03:16:53.447777 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:53.447748    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/0.log"
Jun 14 03:16:53.448163 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:53.447786    2516 generic.go:356] "Generic (PLEG): container finished" podID="b9fddd80-a36b-4069-82a5-25b8f9332e38" containerID="b4de55b554bd4008c7e558d6c9d474c75095de77f88e6ca2c89ac9359a3c2e35" exitCode=255
Jun 14 03:16:53.448163 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:53.447859    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86" event={"ID":"b9fddd80-a36b-4069-82a5-25b8f9332e38","Type":"ContainerDied","Data":"b4de55b554bd4008c7e558d6c9d474c75095de77f88e6ca2c89ac9359a3c2e35"}
Jun 14 03:16:53.448163 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:53.448043    2516 scope.go:117] "RemoveContainer" containerID="b4de55b554bd4008c7e558d6c9d474c75095de77f88e6ca2c89ac9359a3c2e35"
Jun 14 03:16:54.083106 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:54.083045    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:54.083412 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:54.083147    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-s4qdr\" (UID: \"0e07ac22-26c0-4234-90b8-f52f2c22c896\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"
Jun 14 03:16:54.083412 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:54.083179    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-k7zff\" (UID: \"174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff"
Jun 14 03:16:54.083412 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:54.083201    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:54.083412 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:54.083216    2516 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 14 03:16:54.083412 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:54.083294    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs podName:d13e7b69-fc43-4106-81dc-286e6f6cc59c nodeName:}" failed. No retries permitted until 2026-06-14 03:16:58.083271888 +0000 UTC m=+260.860716690 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs") pod "router-default-775bdfb79b-5kgtp" (UID: "d13e7b69-fc43-4106-81dc-286e6f6cc59c") : secret "router-metrics-certs-default" not found
Jun 14 03:16:54.083412 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:54.083296    2516 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 14 03:16:54.083412 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:54.083313    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle podName:d13e7b69-fc43-4106-81dc-286e6f6cc59c nodeName:}" failed. No retries permitted until 2026-06-14 03:16:58.083304239 +0000 UTC m=+260.860749043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle") pod "router-default-775bdfb79b-5kgtp" (UID: "d13e7b69-fc43-4106-81dc-286e6f6cc59c") : configmap references non-existent config key: service-ca.crt
Jun 14 03:16:54.083412 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:54.083296    2516 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 14 03:16:54.083412 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:54.083343    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls podName:174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:58.083331123 +0000 UTC m=+260.860775924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls") pod "cluster-samples-operator-9547488fd-k7zff" (UID: "174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8") : secret "samples-operator-tls" not found
Jun 14 03:16:54.083412 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:54.083358    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert podName:0e07ac22-26c0-4234-90b8-f52f2c22c896 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:58.083349655 +0000 UTC m=+260.860794457 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-s4qdr" (UID: "0e07ac22-26c0-4234-90b8-f52f2c22c896") : secret "networking-console-plugin-cert" not found
Jun 14 03:16:54.452525 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:54.452501    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/1.log"
Jun 14 03:16:54.452899 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:54.452887    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/0.log"
Jun 14 03:16:54.452952 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:54.452917    2516 generic.go:356] "Generic (PLEG): container finished" podID="b9fddd80-a36b-4069-82a5-25b8f9332e38" containerID="c42d282da66528c6d706fed53934a3e65a9169e68d5ead8fadb070692d1b4beb" exitCode=255
Jun 14 03:16:54.453003 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:54.452967    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86" event={"ID":"b9fddd80-a36b-4069-82a5-25b8f9332e38","Type":"ContainerDied","Data":"c42d282da66528c6d706fed53934a3e65a9169e68d5ead8fadb070692d1b4beb"}
Jun 14 03:16:54.453169 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:54.453010    2516 scope.go:117] "RemoveContainer" containerID="b4de55b554bd4008c7e558d6c9d474c75095de77f88e6ca2c89ac9359a3c2e35"
Jun 14 03:16:54.453284 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:54.453267    2516 scope.go:117] "RemoveContainer" containerID="c42d282da66528c6d706fed53934a3e65a9169e68d5ead8fadb070692d1b4beb"
Jun 14 03:16:54.453465 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:54.453445    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-g9m86_openshift-console-operator(b9fddd80-a36b-4069-82a5-25b8f9332e38)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86" podUID="b9fddd80-a36b-4069-82a5-25b8f9332e38"
Jun 14 03:16:55.057237 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.057199    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-rvt2z"]
Jun 14 03:16:55.059795 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.059778    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rvt2z"
Jun 14 03:16:55.062002 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.061985    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jun 14 03:16:55.062114 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.061985    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jun 14 03:16:55.063024 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.063005    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ldv7b\""
Jun 14 03:16:55.072462 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.072443    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-rvt2z"]
Jun 14 03:16:55.190638 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.190591    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hm2l\" (UniqueName: \"kubernetes.io/projected/09caee24-ceb8-4cc6-bee1-76dec37ce2b1-kube-api-access-8hm2l\") pod \"migrator-d4bcd4867-rvt2z\" (UID: \"09caee24-ceb8-4cc6-bee1-76dec37ce2b1\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rvt2z"
Jun 14 03:16:55.291602 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.291557    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hm2l\" (UniqueName: \"kubernetes.io/projected/09caee24-ceb8-4cc6-bee1-76dec37ce2b1-kube-api-access-8hm2l\") pod \"migrator-d4bcd4867-rvt2z\" (UID: \"09caee24-ceb8-4cc6-bee1-76dec37ce2b1\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rvt2z"
Jun 14 03:16:55.299223 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.299196    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hm2l\" (UniqueName: \"kubernetes.io/projected/09caee24-ceb8-4cc6-bee1-76dec37ce2b1-kube-api-access-8hm2l\") pod \"migrator-d4bcd4867-rvt2z\" (UID: \"09caee24-ceb8-4cc6-bee1-76dec37ce2b1\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rvt2z"
Jun 14 03:16:55.368065 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.367990    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rvt2z"
Jun 14 03:16:55.458485 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.458445    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/1.log"
Jun 14 03:16:55.458920 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.458850    2516 scope.go:117] "RemoveContainer" containerID="c42d282da66528c6d706fed53934a3e65a9169e68d5ead8fadb070692d1b4beb"
Jun 14 03:16:55.459319 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:55.459042    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-g9m86_openshift-console-operator(b9fddd80-a36b-4069-82a5-25b8f9332e38)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86" podUID="b9fddd80-a36b-4069-82a5-25b8f9332e38"
Jun 14 03:16:55.492143 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.492109    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x8hrf"]
Jun 14 03:16:55.495177 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.495154    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-rvt2z"]
Jun 14 03:16:55.495291 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.495256    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:55.497843 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.497792    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 14 03:16:55.497843 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.497833    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q7kdg\""
Jun 14 03:16:55.498009 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.497843    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 14 03:16:55.498009 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.497879    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 14 03:16:55.498009 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.497843    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 14 03:16:55.498695 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:16:55.498675    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09caee24_ceb8_4cc6_bee1_76dec37ce2b1.slice/crio-fc4b196674573a9366018acc22aa8faef24f095ce18b998f11191575e726fa08 WatchSource:0}: Error finding container fc4b196674573a9366018acc22aa8faef24f095ce18b998f11191575e726fa08: Status 404 returned error can't find the container with id fc4b196674573a9366018acc22aa8faef24f095ce18b998f11191575e726fa08
Jun 14 03:16:55.508149 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.508130    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x8hrf"]
Jun 14 03:16:55.594289 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.594256    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:55.594473 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.594380    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm4nz\" (UniqueName: \"kubernetes.io/projected/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-api-access-wm4nz\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:55.594473 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.594429    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bdfaeb97-a275-4495-b142-9cc10b93fa35-crio-socket\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:55.594596 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.594522    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdfaeb97-a275-4495-b142-9cc10b93fa35-data-volume\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:55.594663 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.594595    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:55.695909 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.695873    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdfaeb97-a275-4495-b142-9cc10b93fa35-data-volume\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:55.696099 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.695921    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:55.696099 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.695979    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:55.696099 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:55.696065    2516 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 14 03:16:55.696222 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.696066    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm4nz\" (UniqueName: \"kubernetes.io/projected/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-api-access-wm4nz\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:55.696483 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.696382    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bdfaeb97-a275-4495-b142-9cc10b93fa35-crio-socket\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:55.696649 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.696623    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bdfaeb97-a275-4495-b142-9cc10b93fa35-crio-socket\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:55.696735 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.696635    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdfaeb97-a275-4495-b142-9cc10b93fa35-data-volume\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:55.696735 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:55.696669    2516 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 14 03:16:55.696735 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:55.696726    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls podName:bdfaeb97-a275-4495-b142-9cc10b93fa35 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:56.19669892 +0000 UTC m=+258.974143727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x8hrf" (UID: "bdfaeb97-a275-4495-b142-9cc10b93fa35") : secret "insights-runtime-extractor-tls" not found
Jun 14 03:16:55.696888 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:55.696756    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm podName:bdfaeb97-a275-4495-b142-9cc10b93fa35 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:56.196741109 +0000 UTC m=+258.974185931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x8hrf" (UID: "bdfaeb97-a275-4495-b142-9cc10b93fa35") : configmap "kube-rbac-proxy" not found
Jun 14 03:16:55.704594 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:55.704570    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm4nz\" (UniqueName: \"kubernetes.io/projected/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-api-access-wm4nz\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:56.200236 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:56.200195    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:56.200420 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:56.200248    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:56.200420 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:56.200371    2516 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 14 03:16:56.200547 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:56.200423    2516 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 14 03:16:56.200547 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:56.200448    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls podName:bdfaeb97-a275-4495-b142-9cc10b93fa35 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:57.200427015 +0000 UTC m=+259.977871839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x8hrf" (UID: "bdfaeb97-a275-4495-b142-9cc10b93fa35") : secret "insights-runtime-extractor-tls" not found
Jun 14 03:16:56.200664 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:56.200558    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm podName:bdfaeb97-a275-4495-b142-9cc10b93fa35 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:57.200544097 +0000 UTC m=+259.977988909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x8hrf" (UID: "bdfaeb97-a275-4495-b142-9cc10b93fa35") : configmap "kube-rbac-proxy" not found
Jun 14 03:16:56.463015 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:56.462895    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rvt2z" event={"ID":"09caee24-ceb8-4cc6-bee1-76dec37ce2b1","Type":"ContainerStarted","Data":"fc4b196674573a9366018acc22aa8faef24f095ce18b998f11191575e726fa08"}
Jun 14 03:16:57.208242 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:57.208206    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:57.208242 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:57.208241    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:57.208451 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:57.208342    2516 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 14 03:16:57.208451 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:57.208367    2516 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 14 03:16:57.208451 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:57.208401    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls podName:bdfaeb97-a275-4495-b142-9cc10b93fa35 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:59.208386597 +0000 UTC m=+261.985831399 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x8hrf" (UID: "bdfaeb97-a275-4495-b142-9cc10b93fa35") : secret "insights-runtime-extractor-tls" not found
Jun 14 03:16:57.208451 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:57.208415    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm podName:bdfaeb97-a275-4495-b142-9cc10b93fa35 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:59.208408563 +0000 UTC m=+261.985853364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x8hrf" (UID: "bdfaeb97-a275-4495-b142-9cc10b93fa35") : configmap "kube-rbac-proxy" not found
Jun 14 03:16:57.467449 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:57.467365    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rvt2z" event={"ID":"09caee24-ceb8-4cc6-bee1-76dec37ce2b1","Type":"ContainerStarted","Data":"ac90772613840aa12fb89e94d6d1a40040f49b8ac0b868919c030ef99b55d526"}
Jun 14 03:16:57.467449 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:57.467422    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rvt2z" event={"ID":"09caee24-ceb8-4cc6-bee1-76dec37ce2b1","Type":"ContainerStarted","Data":"56bc8d4596f0d7f660ed8513c85d1ba0a44c5c6fd3f2c23cfcc02167c468ded3"}
Jun 14 03:16:57.482771 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:57.482725    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rvt2z" podStartSLOduration=1.376031488 podStartE2EDuration="2.482711281s" totalImagesPullingTime="1.106679793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:16:57.48199264 +0000 UTC m=+260.259437494" watchObservedRunningTime="2026-06-14 03:16:57.482711281 +0000 UTC m=+260.260156104"
Jun 14 03:16:58.115709 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:58.115672    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:58.115908 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:58.115737    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-s4qdr\" (UID: \"0e07ac22-26c0-4234-90b8-f52f2c22c896\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"
Jun 14 03:16:58.115908 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:58.115766    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-k7zff\" (UID: \"174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff"
Jun 14 03:16:58.115908 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:58.115785    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:16:58.115908 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:58.115823    2516 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 14 03:16:58.115908 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:58.115884    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs podName:d13e7b69-fc43-4106-81dc-286e6f6cc59c nodeName:}" failed. No retries permitted until 2026-06-14 03:17:06.115870179 +0000 UTC m=+268.893314981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs") pod "router-default-775bdfb79b-5kgtp" (UID: "d13e7b69-fc43-4106-81dc-286e6f6cc59c") : secret "router-metrics-certs-default" not found
Jun 14 03:16:58.115908 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:58.115899    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle podName:d13e7b69-fc43-4106-81dc-286e6f6cc59c nodeName:}" failed. No retries permitted until 2026-06-14 03:17:06.115893748 +0000 UTC m=+268.893338549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle") pod "router-default-775bdfb79b-5kgtp" (UID: "d13e7b69-fc43-4106-81dc-286e6f6cc59c") : configmap references non-existent config key: service-ca.crt
Jun 14 03:16:58.115908 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:58.115896    2516 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 14 03:16:58.116239 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:58.115958    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert podName:0e07ac22-26c0-4234-90b8-f52f2c22c896 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:06.115940695 +0000 UTC m=+268.893385514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-s4qdr" (UID: "0e07ac22-26c0-4234-90b8-f52f2c22c896") : secret "networking-console-plugin-cert" not found
Jun 14 03:16:58.116239 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:58.115907    2516 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 14 03:16:58.116239 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:58.116003    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls podName:174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:06.115993025 +0000 UTC m=+268.893437841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls") pod "cluster-samples-operator-9547488fd-k7zff" (UID: "174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8") : secret "samples-operator-tls" not found
Jun 14 03:16:58.298169 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:58.298141    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nvmbb_bf38e71f-f179-4e4d-95be-b9954e1b2605/dns-node-resolver/0.log"
Jun 14 03:16:59.098573 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:59.098547    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l4567_0e55a15d-3244-4d6d-a7c0-82b2c0758f6f/node-ca/0.log"
Jun 14 03:16:59.224345 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:59.224312    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:59.224345 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:59.224345    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:16:59.224529 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:59.224459    2516 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 14 03:16:59.224529 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:59.224489    2516 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 14 03:16:59.224529 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:59.224512    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls podName:bdfaeb97-a275-4495-b142-9cc10b93fa35 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:03.224497735 +0000 UTC m=+266.001942539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x8hrf" (UID: "bdfaeb97-a275-4495-b142-9cc10b93fa35") : secret "insights-runtime-extractor-tls" not found
Jun 14 03:16:59.224629 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:16:59.224534    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm podName:bdfaeb97-a275-4495-b142-9cc10b93fa35 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:03.224517971 +0000 UTC m=+266.001962775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x8hrf" (UID: "bdfaeb97-a275-4495-b142-9cc10b93fa35") : configmap "kube-rbac-proxy" not found
Jun 14 03:16:59.898201 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:16:59.898169    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5z9bc_af4c2972-fca9-4bab-b645-44b2b1e876d0/serve-healthcheck-canary/0.log"
Jun 14 03:17:00.499147 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:00.499115    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-rvt2z_09caee24-ceb8-4cc6-bee1-76dec37ce2b1/migrator/0.log"
Jun 14 03:17:00.673540 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:00.673508    2516 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:17:00.673688 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:00.673564    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:17:00.673855 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:00.673844    2516 scope.go:117] "RemoveContainer" containerID="c42d282da66528c6d706fed53934a3e65a9169e68d5ead8fadb070692d1b4beb"
Jun 14 03:17:00.673988 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:17:00.673972    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-g9m86_openshift-console-operator(b9fddd80-a36b-4069-82a5-25b8f9332e38)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86" podUID="b9fddd80-a36b-4069-82a5-25b8f9332e38"
Jun 14 03:17:00.698763 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:00.698738    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-rvt2z_09caee24-ceb8-4cc6-bee1-76dec37ce2b1/graceful-termination/0.log"
Jun 14 03:17:03.259543 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:03.259508    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:17:03.259543 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:03.259545    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:17:03.260003 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:17:03.259646    2516 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 14 03:17:03.260003 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:17:03.259662    2516 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 14 03:17:03.260003 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:17:03.259703    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm podName:bdfaeb97-a275-4495-b142-9cc10b93fa35 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:11.259688592 +0000 UTC m=+274.037133396 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x8hrf" (UID: "bdfaeb97-a275-4495-b142-9cc10b93fa35") : configmap "kube-rbac-proxy" not found
Jun 14 03:17:03.260003 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:17:03.259716    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls podName:bdfaeb97-a275-4495-b142-9cc10b93fa35 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:11.259710373 +0000 UTC m=+274.037155175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x8hrf" (UID: "bdfaeb97-a275-4495-b142-9cc10b93fa35") : secret "insights-runtime-extractor-tls" not found
Jun 14 03:17:06.182641 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:06.182599    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-s4qdr\" (UID: \"0e07ac22-26c0-4234-90b8-f52f2c22c896\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"
Jun 14 03:17:06.183072 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:06.182656    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-k7zff\" (UID: \"174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff"
Jun 14 03:17:06.183072 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:06.182685    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:17:06.183072 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:06.182750    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:17:06.183072 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:17:06.182763    2516 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 14 03:17:06.183072 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:17:06.182830    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert podName:0e07ac22-26c0-4234-90b8-f52f2c22c896 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:22.182809489 +0000 UTC m=+284.960254315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-s4qdr" (UID: "0e07ac22-26c0-4234-90b8-f52f2c22c896") : secret "networking-console-plugin-cert" not found
Jun 14 03:17:06.183072 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:17:06.182879    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle podName:d13e7b69-fc43-4106-81dc-286e6f6cc59c nodeName:}" failed. No retries permitted until 2026-06-14 03:17:22.182859403 +0000 UTC m=+284.960304224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle") pod "router-default-775bdfb79b-5kgtp" (UID: "d13e7b69-fc43-4106-81dc-286e6f6cc59c") : configmap references non-existent config key: service-ca.crt
Jun 14 03:17:06.185113 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:06.185090    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d13e7b69-fc43-4106-81dc-286e6f6cc59c-metrics-certs\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:17:06.185219 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:06.185200    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-k7zff\" (UID: \"174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff"
Jun 14 03:17:06.280825 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:06.280791    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff"
Jun 14 03:17:06.404511 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:06.404451    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff"]
Jun 14 03:17:06.495058 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:06.495031    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff" event={"ID":"174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8","Type":"ContainerStarted","Data":"6c4f70f92c42cc5e83fff23606814ea24446d69473e6eb6b423f425b25431119"}
Jun 14 03:17:08.502773 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:08.502690    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff" event={"ID":"174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8","Type":"ContainerStarted","Data":"00746da922a57b205e30164f990932323d1e0cd8eaa2aea2ea7abf60d88a7d3c"}
Jun 14 03:17:08.502773 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:08.502768    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff" event={"ID":"174e8dc2-6fd3-4ccb-b865-9cf2f5ad33c8","Type":"ContainerStarted","Data":"10ac7ca9011f067b42cfd15cd553defc74fb66ed5d66261926b9f4b36e2f8315"}
Jun 14 03:17:08.520186 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:08.520137    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-k7zff" podStartSLOduration=16.814665157 podStartE2EDuration="18.520123127s" totalImagesPullingTime="1.70545797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:08.519003942 +0000 UTC m=+271.296448765" watchObservedRunningTime="2026-06-14 03:17:08.520123127 +0000 UTC m=+271.297567960"
Jun 14 03:17:11.327976 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:11.327937    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:17:11.327976 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:11.327975    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:17:11.328457 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:11.328440    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdfaeb97-a275-4495-b142-9cc10b93fa35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:17:11.330240 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:11.330215    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdfaeb97-a275-4495-b142-9cc10b93fa35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8hrf\" (UID: \"bdfaeb97-a275-4495-b142-9cc10b93fa35\") " pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:17:11.410320 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:11.410292    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x8hrf"
Jun 14 03:17:11.534754 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:11.534733    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x8hrf"]
Jun 14 03:17:11.537120 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:17:11.537096    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdfaeb97_a275_4495_b142_9cc10b93fa35.slice/crio-8801d755dad40b9e7598df973705d80b598d4dd22dda50666250ad773a16f417 WatchSource:0}: Error finding container 8801d755dad40b9e7598df973705d80b598d4dd22dda50666250ad773a16f417: Status 404 returned error can't find the container with id 8801d755dad40b9e7598df973705d80b598d4dd22dda50666250ad773a16f417
Jun 14 03:17:12.516275 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:12.516236    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x8hrf" event={"ID":"bdfaeb97-a275-4495-b142-9cc10b93fa35","Type":"ContainerStarted","Data":"8801d755dad40b9e7598df973705d80b598d4dd22dda50666250ad773a16f417"}
Jun 14 03:17:12.653941 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:12.653914    2516 scope.go:117] "RemoveContainer" containerID="c42d282da66528c6d706fed53934a3e65a9169e68d5ead8fadb070692d1b4beb"
Jun 14 03:17:13.521955 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:13.521926    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:17:13.522401 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:13.522380    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/1.log"
Jun 14 03:17:13.522456 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:13.522418    2516 generic.go:356] "Generic (PLEG): container finished" podID="b9fddd80-a36b-4069-82a5-25b8f9332e38" containerID="ef128933144046c20bfbbfc638e3a24f0e279a6e252050b765dff25ff5753eb5" exitCode=255
Jun 14 03:17:13.522501 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:13.522464    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86" event={"ID":"b9fddd80-a36b-4069-82a5-25b8f9332e38","Type":"ContainerDied","Data":"ef128933144046c20bfbbfc638e3a24f0e279a6e252050b765dff25ff5753eb5"}
Jun 14 03:17:13.522537 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:13.522514    2516 scope.go:117] "RemoveContainer" containerID="c42d282da66528c6d706fed53934a3e65a9169e68d5ead8fadb070692d1b4beb"
Jun 14 03:17:13.522850 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:13.522814    2516 scope.go:117] "RemoveContainer" containerID="ef128933144046c20bfbbfc638e3a24f0e279a6e252050b765dff25ff5753eb5"
Jun 14 03:17:13.523027 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:17:13.523002    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-g9m86_openshift-console-operator(b9fddd80-a36b-4069-82a5-25b8f9332e38)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86" podUID="b9fddd80-a36b-4069-82a5-25b8f9332e38"
Jun 14 03:17:15.531402 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:15.531380    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:17:15.532968 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:15.532945    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x8hrf" event={"ID":"bdfaeb97-a275-4495-b142-9cc10b93fa35","Type":"ContainerStarted","Data":"14b48f1049354832326b0476abbab43a1d21eb435d439b9c9e60fb6c86c3cc7c"}
Jun 14 03:17:16.538468 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:16.538432    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x8hrf" event={"ID":"bdfaeb97-a275-4495-b142-9cc10b93fa35","Type":"ContainerStarted","Data":"3bd146adc7a9548a9512a2de7f3f790497dda6d9078009e08754ce467cf78f74"}
Jun 14 03:17:17.543547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:17.543457    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x8hrf" event={"ID":"bdfaeb97-a275-4495-b142-9cc10b93fa35","Type":"ContainerStarted","Data":"a79a3d112be0ac9cf879f35f040e712cccbfbd4668d71f14f9bb6019f7e51e05"}
Jun 14 03:17:17.559963 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:17.559914    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x8hrf" podStartSLOduration=17.012948679 podStartE2EDuration="22.559898308s" totalImagesPullingTime="5.546949629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:16:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:17.559021505 +0000 UTC m=+280.336466342" watchObservedRunningTime="2026-06-14 03:17:17.559898308 +0000 UTC m=+280.337343130"
Jun 14 03:17:18.216303 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:17:18.216265    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2pxlj" podUID="59b69d24-0cbf-41a4-a252-647f088ec7bf"
Jun 14 03:17:18.216303 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:17:18.216277    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj" podUID="785ada15-72a0-4d3a-b899-b442c0b7d3e4"
Jun 14 03:17:18.545948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:18.545861    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:17:18.545948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:18.545865    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:17:20.673500 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:20.673461    2516 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:17:20.673886 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:20.673518    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:17:20.673886 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:20.673814    2516 scope.go:117] "RemoveContainer" containerID="ef128933144046c20bfbbfc638e3a24f0e279a6e252050b765dff25ff5753eb5"
Jun 14 03:17:20.673981 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:17:20.673960    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-g9m86_openshift-console-operator(b9fddd80-a36b-4069-82a5-25b8f9332e38)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86" podUID="b9fddd80-a36b-4069-82a5-25b8f9332e38"
Jun 14 03:17:22.011929 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.011882    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:17:22.011929 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.011938    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:17:22.014231 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.014202    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59b69d24-0cbf-41a4-a252-647f088ec7bf-metrics-tls\") pod \"dns-default-2pxlj\" (UID: \"59b69d24-0cbf-41a4-a252-647f088ec7bf\") " pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:17:22.014340 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.014291    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls\") pod \"image-registry-7d796fc86d-lwgzj\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") " pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:17:22.150504 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.150472    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ctq98\""
Jun 14 03:17:22.150504 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.150472    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fgws4\""
Jun 14 03:17:22.157956 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.157938    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:17:22.158049 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.158032    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:17:22.214743 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.213856    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-s4qdr\" (UID: \"0e07ac22-26c0-4234-90b8-f52f2c22c896\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"
Jun 14 03:17:22.214743 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.213932    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:17:22.214743 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.214694    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d13e7b69-fc43-4106-81dc-286e6f6cc59c-service-ca-bundle\") pod \"router-default-775bdfb79b-5kgtp\" (UID: \"d13e7b69-fc43-4106-81dc-286e6f6cc59c\") " pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:17:22.217123 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.217056    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e07ac22-26c0-4234-90b8-f52f2c22c896-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-s4qdr\" (UID: \"0e07ac22-26c0-4234-90b8-f52f2c22c896\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"
Jun 14 03:17:22.305907 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.305873    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2pxlj"]
Jun 14 03:17:22.309160 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:17:22.309133    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b69d24_0cbf_41a4_a252_647f088ec7bf.slice/crio-0a4705b1b2d33118af56f1487b4919eb2bf7b2ddb0bb68d0ab2ee56b6e7ac461 WatchSource:0}: Error finding container 0a4705b1b2d33118af56f1487b4919eb2bf7b2ddb0bb68d0ab2ee56b6e7ac461: Status 404 returned error can't find the container with id 0a4705b1b2d33118af56f1487b4919eb2bf7b2ddb0bb68d0ab2ee56b6e7ac461
Jun 14 03:17:22.319931 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.319907    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d796fc86d-lwgzj"]
Jun 14 03:17:22.323164 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:17:22.323142    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod785ada15_72a0_4d3a_b899_b442c0b7d3e4.slice/crio-b065dc061a0a3409a33aa005d891195144916de6acdf5fc504c7e1bd13f51fb8 WatchSource:0}: Error finding container b065dc061a0a3409a33aa005d891195144916de6acdf5fc504c7e1bd13f51fb8: Status 404 returned error can't find the container with id b065dc061a0a3409a33aa005d891195144916de6acdf5fc504c7e1bd13f51fb8
Jun 14 03:17:22.463380 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.463348    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"
Jun 14 03:17:22.487664 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.487638    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:17:22.560502 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.560462    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2pxlj" event={"ID":"59b69d24-0cbf-41a4-a252-647f088ec7bf","Type":"ContainerStarted","Data":"0a4705b1b2d33118af56f1487b4919eb2bf7b2ddb0bb68d0ab2ee56b6e7ac461"}
Jun 14 03:17:22.562794 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.562238    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj" event={"ID":"785ada15-72a0-4d3a-b899-b442c0b7d3e4","Type":"ContainerStarted","Data":"d81c80ac7255113da747708f3cdad790dbb13c4c3e5627a6f5a87eb6a67261aa"}
Jun 14 03:17:22.562794 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.562278    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj" event={"ID":"785ada15-72a0-4d3a-b899-b442c0b7d3e4","Type":"ContainerStarted","Data":"b065dc061a0a3409a33aa005d891195144916de6acdf5fc504c7e1bd13f51fb8"}
Jun 14 03:17:22.562794 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.562451    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:17:22.587932 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.587877    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj" podStartSLOduration=284.587855418 podStartE2EDuration="4m44.587855418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:12:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:22.587259671 +0000 UTC m=+285.364704495" watchObservedRunningTime="2026-06-14 03:17:22.587855418 +0000 UTC m=+285.365300242"
Jun 14 03:17:22.600135 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.600098    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-s4qdr"]
Jun 14 03:17:22.603410 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:17:22.603374    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e07ac22_26c0_4234_90b8_f52f2c22c896.slice/crio-a100f1d1b07991c2e7b117fc4f22afcb10bdcd7096ab81048203c388d14c939f WatchSource:0}: Error finding container a100f1d1b07991c2e7b117fc4f22afcb10bdcd7096ab81048203c388d14c939f: Status 404 returned error can't find the container with id a100f1d1b07991c2e7b117fc4f22afcb10bdcd7096ab81048203c388d14c939f
Jun 14 03:17:22.629837 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:22.629807    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-775bdfb79b-5kgtp"]
Jun 14 03:17:22.632215 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:17:22.632196    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd13e7b69_fc43_4106_81dc_286e6f6cc59c.slice/crio-f505d09e7ca9ae0f16fb196b732368d3e27795411c86cfa8624b88624fd277a9 WatchSource:0}: Error finding container f505d09e7ca9ae0f16fb196b732368d3e27795411c86cfa8624b88624fd277a9: Status 404 returned error can't find the container with id f505d09e7ca9ae0f16fb196b732368d3e27795411c86cfa8624b88624fd277a9
Jun 14 03:17:23.566769 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:23.566730    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr" event={"ID":"0e07ac22-26c0-4234-90b8-f52f2c22c896","Type":"ContainerStarted","Data":"a100f1d1b07991c2e7b117fc4f22afcb10bdcd7096ab81048203c388d14c939f"}
Jun 14 03:17:23.568341 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:23.568309    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-775bdfb79b-5kgtp" event={"ID":"d13e7b69-fc43-4106-81dc-286e6f6cc59c","Type":"ContainerStarted","Data":"11cdbe351f4184876ea55095ccf2c53754a705fb92cf41abe1917d56ab6f11af"}
Jun 14 03:17:23.568471 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:23.568358    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-775bdfb79b-5kgtp" event={"ID":"d13e7b69-fc43-4106-81dc-286e6f6cc59c","Type":"ContainerStarted","Data":"f505d09e7ca9ae0f16fb196b732368d3e27795411c86cfa8624b88624fd277a9"}
Jun 14 03:17:23.588316 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:23.588268    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-775bdfb79b-5kgtp" podStartSLOduration=33.588252692 podStartE2EDuration="33.588252692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:16:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:23.586813871 +0000 UTC m=+286.364258694" watchObservedRunningTime="2026-06-14 03:17:23.588252692 +0000 UTC m=+286.365697516"
Jun 14 03:17:24.488127 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.488071    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:17:24.490582 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.490551    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:17:24.497849 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.497826    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-dcl7x"]
Jun 14 03:17:24.499752 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.499736    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-dcl7x"
Jun 14 03:17:24.501888 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.501861    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jun 14 03:17:24.501982 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.501869    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-v6kdt\""
Jun 14 03:17:24.508590 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.508569    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-dcl7x"]
Jun 14 03:17:24.534697 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.534673    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1d05d1e6-5aab-4201-a3c6-2eaa3e7ef008-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-dcl7x\" (UID: \"1d05d1e6-5aab-4201-a3c6-2eaa3e7ef008\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-dcl7x"
Jun 14 03:17:24.573385 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.573355    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2pxlj" event={"ID":"59b69d24-0cbf-41a4-a252-647f088ec7bf","Type":"ContainerStarted","Data":"c2167c4fdf9aeb1c56b58d1768ea37cfd79faa7b830c3f7c5a73b77c21a0497f"}
Jun 14 03:17:24.573756 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.573402    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2pxlj" event={"ID":"59b69d24-0cbf-41a4-a252-647f088ec7bf","Type":"ContainerStarted","Data":"e983174fc45a123eabf15a2a9487a7beda35a9788896c7c0737bd9cc6f967797"}
Jun 14 03:17:24.573756 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.573538    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:17:24.574869 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.574842    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr" event={"ID":"0e07ac22-26c0-4234-90b8-f52f2c22c896","Type":"ContainerStarted","Data":"df99aad749f56eef3f1045f72b078d6a5f1b7453e7d856f98d8eacaaef8f39eb"}
Jun 14 03:17:24.575117 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.575101    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:17:24.576164 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.576147    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-775bdfb79b-5kgtp"
Jun 14 03:17:24.593450 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.593414    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2pxlj" podStartSLOduration=250.807406174 podStartE2EDuration="4m12.593401396s" totalImagesPullingTime="1.785995222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:24.592355685 +0000 UTC m=+287.369800507" watchObservedRunningTime="2026-06-14 03:17:24.593401396 +0000 UTC m=+287.370846218"
Jun 14 03:17:24.627334 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.627279    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-s4qdr" podStartSLOduration=33.14149783 podStartE2EDuration="34.627258839s" totalImagesPullingTime="1.485761009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:24.626696981 +0000 UTC m=+287.404141803" watchObservedRunningTime="2026-06-14 03:17:24.627258839 +0000 UTC m=+287.404703869"
Jun 14 03:17:24.635103 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.635061    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1d05d1e6-5aab-4201-a3c6-2eaa3e7ef008-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-dcl7x\" (UID: \"1d05d1e6-5aab-4201-a3c6-2eaa3e7ef008\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-dcl7x"
Jun 14 03:17:24.638072 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.638049    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1d05d1e6-5aab-4201-a3c6-2eaa3e7ef008-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-dcl7x\" (UID: \"1d05d1e6-5aab-4201-a3c6-2eaa3e7ef008\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-dcl7x"
Jun 14 03:17:24.808607 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.808504    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-dcl7x"
Jun 14 03:17:24.930026 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:24.929917    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-dcl7x"]
Jun 14 03:17:24.932429 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:17:24.932395    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d05d1e6_5aab_4201_a3c6_2eaa3e7ef008.slice/crio-fec4e72b115adbfc4356e427d9254500165618ecb2876fa12d727eb14dd47d8f WatchSource:0}: Error finding container fec4e72b115adbfc4356e427d9254500165618ecb2876fa12d727eb14dd47d8f: Status 404 returned error can't find the container with id fec4e72b115adbfc4356e427d9254500165618ecb2876fa12d727eb14dd47d8f
Jun 14 03:17:25.580541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:25.580491    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-dcl7x" event={"ID":"1d05d1e6-5aab-4201-a3c6-2eaa3e7ef008","Type":"ContainerStarted","Data":"fec4e72b115adbfc4356e427d9254500165618ecb2876fa12d727eb14dd47d8f"}
Jun 14 03:17:26.584928 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:26.584891    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-dcl7x" event={"ID":"1d05d1e6-5aab-4201-a3c6-2eaa3e7ef008","Type":"ContainerStarted","Data":"33f95eabd0e35149a7b2d7d2bf4c41374162e2ab5c7d8512aeed1cbfb68f5ac2"}
Jun 14 03:17:26.585350 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:26.585126    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-dcl7x"
Jun 14 03:17:26.589780 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:26.589754    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-dcl7x"
Jun 14 03:17:26.599449 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:26.599378    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-dcl7x" podStartSLOduration=1.6604510019999998 podStartE2EDuration="2.599364553s" totalImagesPullingTime="938.913551ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:26.598386729 +0000 UTC m=+289.375831553" watchObservedRunningTime="2026-06-14 03:17:26.599364553 +0000 UTC m=+289.376809375"
Jun 14 03:17:27.553303 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.553265    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"]
Jun 14 03:17:27.556065 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.556050    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"
Jun 14 03:17:27.558672 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.558644    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jun 14 03:17:27.560000 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.559975    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 14 03:17:27.560141 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.559982    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jun 14 03:17:27.560459 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.560438    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 14 03:17:27.560588 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.560558    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 14 03:17:27.560705 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.560683    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xzwr2\""
Jun 14 03:17:27.564160 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.564134    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"]
Jun 14 03:17:27.660505 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.660474    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afe0f4d6-b1e2-483f-ace1-5483185a195a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-l9gxr\" (UID: \"afe0f4d6-b1e2-483f-ace1-5483185a195a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"
Jun 14 03:17:27.660505 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.660505    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwh6k\" (UniqueName: \"kubernetes.io/projected/afe0f4d6-b1e2-483f-ace1-5483185a195a-kube-api-access-zwh6k\") pod \"prometheus-operator-864fcfc6f9-l9gxr\" (UID: \"afe0f4d6-b1e2-483f-ace1-5483185a195a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"
Jun 14 03:17:27.660898 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.660557    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/afe0f4d6-b1e2-483f-ace1-5483185a195a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-l9gxr\" (UID: \"afe0f4d6-b1e2-483f-ace1-5483185a195a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"
Jun 14 03:17:27.660898 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.660621    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afe0f4d6-b1e2-483f-ace1-5483185a195a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-l9gxr\" (UID: \"afe0f4d6-b1e2-483f-ace1-5483185a195a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"
Jun 14 03:17:27.761332 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.761284    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afe0f4d6-b1e2-483f-ace1-5483185a195a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-l9gxr\" (UID: \"afe0f4d6-b1e2-483f-ace1-5483185a195a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"
Jun 14 03:17:27.761332 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.761336    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwh6k\" (UniqueName: \"kubernetes.io/projected/afe0f4d6-b1e2-483f-ace1-5483185a195a-kube-api-access-zwh6k\") pod \"prometheus-operator-864fcfc6f9-l9gxr\" (UID: \"afe0f4d6-b1e2-483f-ace1-5483185a195a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"
Jun 14 03:17:27.761549 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.761373    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/afe0f4d6-b1e2-483f-ace1-5483185a195a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-l9gxr\" (UID: \"afe0f4d6-b1e2-483f-ace1-5483185a195a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"
Jun 14 03:17:27.761549 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.761416    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afe0f4d6-b1e2-483f-ace1-5483185a195a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-l9gxr\" (UID: \"afe0f4d6-b1e2-483f-ace1-5483185a195a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"
Jun 14 03:17:27.762170 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.762143    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afe0f4d6-b1e2-483f-ace1-5483185a195a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-l9gxr\" (UID: \"afe0f4d6-b1e2-483f-ace1-5483185a195a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"
Jun 14 03:17:27.763826 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.763805    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/afe0f4d6-b1e2-483f-ace1-5483185a195a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-l9gxr\" (UID: \"afe0f4d6-b1e2-483f-ace1-5483185a195a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"
Jun 14 03:17:27.763948 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.763926    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afe0f4d6-b1e2-483f-ace1-5483185a195a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-l9gxr\" (UID: \"afe0f4d6-b1e2-483f-ace1-5483185a195a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"
Jun 14 03:17:27.768877 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.768846    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwh6k\" (UniqueName: \"kubernetes.io/projected/afe0f4d6-b1e2-483f-ace1-5483185a195a-kube-api-access-zwh6k\") pod \"prometheus-operator-864fcfc6f9-l9gxr\" (UID: \"afe0f4d6-b1e2-483f-ace1-5483185a195a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"
Jun 14 03:17:27.870007 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.869925    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"
Jun 14 03:17:27.993776 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:27.993745    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr"]
Jun 14 03:17:27.996625 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:17:27.996598    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe0f4d6_b1e2_483f_ace1_5483185a195a.slice/crio-b6e2e1226f5af64138a4f896ae601139bedc773ca051a8f01c5131d4f3684a53 WatchSource:0}: Error finding container b6e2e1226f5af64138a4f896ae601139bedc773ca051a8f01c5131d4f3684a53: Status 404 returned error can't find the container with id b6e2e1226f5af64138a4f896ae601139bedc773ca051a8f01c5131d4f3684a53
Jun 14 03:17:28.592836 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:28.592797    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr" event={"ID":"afe0f4d6-b1e2-483f-ace1-5483185a195a","Type":"ContainerStarted","Data":"b6e2e1226f5af64138a4f896ae601139bedc773ca051a8f01c5131d4f3684a53"}
Jun 14 03:17:29.597862 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:29.597777    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr" event={"ID":"afe0f4d6-b1e2-483f-ace1-5483185a195a","Type":"ContainerStarted","Data":"f4425602632ce036468d58a6f824a837277ad09f009a3376db88dcc59f929c82"}
Jun 14 03:17:29.597862 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:29.597827    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr" event={"ID":"afe0f4d6-b1e2-483f-ace1-5483185a195a","Type":"ContainerStarted","Data":"0db63a7dbca05e7e9db1702b4521e7ada61a43e39365970d46cdcd8c809b8633"}
Jun 14 03:17:29.614895 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:29.614839    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-l9gxr" podStartSLOduration=1.472298192 podStartE2EDuration="2.614820157s" totalImagesPullingTime="1.142521965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:29.613283474 +0000 UTC m=+292.390728295" watchObservedRunningTime="2026-06-14 03:17:29.614820157 +0000 UTC m=+292.392264980"
Jun 14 03:17:31.881796 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.879704    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"]
Jun 14 03:17:31.884659 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.884638    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"
Jun 14 03:17:31.886887 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.886866    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jun 14 03:17:31.886998 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.886903    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-t9lx8\""
Jun 14 03:17:31.887219 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.887198    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jun 14 03:17:31.893798 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.893778    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"]
Jun 14 03:17:31.899582 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.899563    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qmsgr"]
Jun 14 03:17:31.902594 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.902580    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:31.904940 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.904919    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wf949\""
Jun 14 03:17:31.905011 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.904927    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 14 03:17:31.905117 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.905100    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 14 03:17:31.905389 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.905370    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 14 03:17:31.992599 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.992568    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/18192158-800a-4b9c-9ce0-a8d6ff97fe2e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-549pr\" (UID: \"18192158-800a-4b9c-9ce0-a8d6ff97fe2e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"
Jun 14 03:17:31.992599 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.992599    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18192158-800a-4b9c-9ce0-a8d6ff97fe2e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-549pr\" (UID: \"18192158-800a-4b9c-9ce0-a8d6ff97fe2e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"
Jun 14 03:17:31.992811 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.992622    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c94a1ab-6730-4b36-928d-5582b2655ad4-node-exporter-textfile\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:31.992811 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.992644    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c94a1ab-6730-4b36-928d-5582b2655ad4-node-exporter-tls\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:31.992811 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.992741    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c94a1ab-6730-4b36-928d-5582b2655ad4-root\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:31.992811 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.992782    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c94a1ab-6730-4b36-928d-5582b2655ad4-node-exporter-accelerators-collector-config\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:31.992811 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.992800    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c94a1ab-6730-4b36-928d-5582b2655ad4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:31.992985 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.992830    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt7jt\" (UniqueName: \"kubernetes.io/projected/2c94a1ab-6730-4b36-928d-5582b2655ad4-kube-api-access-bt7jt\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:31.992985 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.992849    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18192158-800a-4b9c-9ce0-a8d6ff97fe2e-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-549pr\" (UID: \"18192158-800a-4b9c-9ce0-a8d6ff97fe2e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"
Jun 14 03:17:31.992985 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.992865    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c94a1ab-6730-4b36-928d-5582b2655ad4-node-exporter-wtmp\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:31.992985 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.992906    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j94xk\" (UniqueName: \"kubernetes.io/projected/18192158-800a-4b9c-9ce0-a8d6ff97fe2e-kube-api-access-j94xk\") pod \"openshift-state-metrics-6b8d965dd5-549pr\" (UID: \"18192158-800a-4b9c-9ce0-a8d6ff97fe2e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"
Jun 14 03:17:31.992985 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.992941    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c94a1ab-6730-4b36-928d-5582b2655ad4-sys\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:31.992985 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:31.992957    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c94a1ab-6730-4b36-928d-5582b2655ad4-metrics-client-ca\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.094142 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094094    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j94xk\" (UniqueName: \"kubernetes.io/projected/18192158-800a-4b9c-9ce0-a8d6ff97fe2e-kube-api-access-j94xk\") pod \"openshift-state-metrics-6b8d965dd5-549pr\" (UID: \"18192158-800a-4b9c-9ce0-a8d6ff97fe2e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"
Jun 14 03:17:32.094142 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094140    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c94a1ab-6730-4b36-928d-5582b2655ad4-sys\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.094400 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094169    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c94a1ab-6730-4b36-928d-5582b2655ad4-metrics-client-ca\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.094400 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094195    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/18192158-800a-4b9c-9ce0-a8d6ff97fe2e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-549pr\" (UID: \"18192158-800a-4b9c-9ce0-a8d6ff97fe2e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"
Jun 14 03:17:32.094400 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094220    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18192158-800a-4b9c-9ce0-a8d6ff97fe2e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-549pr\" (UID: \"18192158-800a-4b9c-9ce0-a8d6ff97fe2e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"
Jun 14 03:17:32.094400 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094257    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c94a1ab-6730-4b36-928d-5582b2655ad4-node-exporter-textfile\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.094400 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094274    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c94a1ab-6730-4b36-928d-5582b2655ad4-sys\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.094400 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094286    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c94a1ab-6730-4b36-928d-5582b2655ad4-node-exporter-tls\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.094400 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094381    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c94a1ab-6730-4b36-928d-5582b2655ad4-root\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.094793 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094434    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c94a1ab-6730-4b36-928d-5582b2655ad4-node-exporter-accelerators-collector-config\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.094793 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094460    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c94a1ab-6730-4b36-928d-5582b2655ad4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.094793 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094508    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt7jt\" (UniqueName: \"kubernetes.io/projected/2c94a1ab-6730-4b36-928d-5582b2655ad4-kube-api-access-bt7jt\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.094793 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094536    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18192158-800a-4b9c-9ce0-a8d6ff97fe2e-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-549pr\" (UID: \"18192158-800a-4b9c-9ce0-a8d6ff97fe2e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"
Jun 14 03:17:32.094793 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094467    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c94a1ab-6730-4b36-928d-5582b2655ad4-root\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.094793 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094559    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c94a1ab-6730-4b36-928d-5582b2655ad4-node-exporter-wtmp\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.094793 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094678    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c94a1ab-6730-4b36-928d-5582b2655ad4-node-exporter-wtmp\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.094793 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.094681    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c94a1ab-6730-4b36-928d-5582b2655ad4-node-exporter-textfile\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.095226 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.095000    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c94a1ab-6730-4b36-928d-5582b2655ad4-node-exporter-accelerators-collector-config\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.095398 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.095375    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18192158-800a-4b9c-9ce0-a8d6ff97fe2e-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-549pr\" (UID: \"18192158-800a-4b9c-9ce0-a8d6ff97fe2e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"
Jun 14 03:17:32.095464 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.095404    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c94a1ab-6730-4b36-928d-5582b2655ad4-metrics-client-ca\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.096862 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.096838    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c94a1ab-6730-4b36-928d-5582b2655ad4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.096969 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.096903    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/18192158-800a-4b9c-9ce0-a8d6ff97fe2e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-549pr\" (UID: \"18192158-800a-4b9c-9ce0-a8d6ff97fe2e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"
Jun 14 03:17:32.097110 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.097069    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c94a1ab-6730-4b36-928d-5582b2655ad4-node-exporter-tls\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.097178 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.097162    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18192158-800a-4b9c-9ce0-a8d6ff97fe2e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-549pr\" (UID: \"18192158-800a-4b9c-9ce0-a8d6ff97fe2e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"
Jun 14 03:17:32.101686 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.101659    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j94xk\" (UniqueName: \"kubernetes.io/projected/18192158-800a-4b9c-9ce0-a8d6ff97fe2e-kube-api-access-j94xk\") pod \"openshift-state-metrics-6b8d965dd5-549pr\" (UID: \"18192158-800a-4b9c-9ce0-a8d6ff97fe2e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"
Jun 14 03:17:32.101772 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.101731    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt7jt\" (UniqueName: \"kubernetes.io/projected/2c94a1ab-6730-4b36-928d-5582b2655ad4-kube-api-access-bt7jt\") pod \"node-exporter-qmsgr\" (UID: \"2c94a1ab-6730-4b36-928d-5582b2655ad4\") " pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.194117 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.194021    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"
Jun 14 03:17:32.211198 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.211169    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qmsgr"
Jun 14 03:17:32.221886 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:17:32.221851    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c94a1ab_6730_4b36_928d_5582b2655ad4.slice/crio-c3131060d1cdd0f4479a519679a2f0c0dc4529fabbce4b5f11dfda7d481d923d WatchSource:0}: Error finding container c3131060d1cdd0f4479a519679a2f0c0dc4529fabbce4b5f11dfda7d481d923d: Status 404 returned error can't find the container with id c3131060d1cdd0f4479a519679a2f0c0dc4529fabbce4b5f11dfda7d481d923d
Jun 14 03:17:32.322691 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.322614    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr"]
Jun 14 03:17:32.325156 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:17:32.325133    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18192158_800a_4b9c_9ce0_a8d6ff97fe2e.slice/crio-cb9f3bed997f90c856dc8ab18b2201301cfc44687a04a2e568173a5328ee6905 WatchSource:0}: Error finding container cb9f3bed997f90c856dc8ab18b2201301cfc44687a04a2e568173a5328ee6905: Status 404 returned error can't find the container with id cb9f3bed997f90c856dc8ab18b2201301cfc44687a04a2e568173a5328ee6905
Jun 14 03:17:32.610259 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.610224    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qmsgr" event={"ID":"2c94a1ab-6730-4b36-928d-5582b2655ad4","Type":"ContainerStarted","Data":"c3131060d1cdd0f4479a519679a2f0c0dc4529fabbce4b5f11dfda7d481d923d"}
Jun 14 03:17:32.611885 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.611860    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr" event={"ID":"18192158-800a-4b9c-9ce0-a8d6ff97fe2e","Type":"ContainerStarted","Data":"448adc555ea453973531da8b148b43e579b88f9d39202aadff0ccf8587e325fb"}
Jun 14 03:17:32.612000 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.611912    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr" event={"ID":"18192158-800a-4b9c-9ce0-a8d6ff97fe2e","Type":"ContainerStarted","Data":"9cff6fe0e172232014a783de9cc2e2f67d8ea98590467be8a49779d56d4c99cb"}
Jun 14 03:17:32.612000 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.611941    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr" event={"ID":"18192158-800a-4b9c-9ce0-a8d6ff97fe2e","Type":"ContainerStarted","Data":"cb9f3bed997f90c856dc8ab18b2201301cfc44687a04a2e568173a5328ee6905"}
Jun 14 03:17:32.653511 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:32.653478    2516 scope.go:117] "RemoveContainer" containerID="ef128933144046c20bfbbfc638e3a24f0e279a6e252050b765dff25ff5753eb5"
Jun 14 03:17:32.653663 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:17:32.653546    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-c7zzq" podUID="a7812b72-9313-42ca-96cf-cde0c84e41d6"
Jun 14 03:17:32.653712 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:17:32.653657    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-g9m86_openshift-console-operator(b9fddd80-a36b-4069-82a5-25b8f9332e38)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86" podUID="b9fddd80-a36b-4069-82a5-25b8f9332e38"
Jun 14 03:17:33.617000 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:33.616909    2516 generic.go:356] "Generic (PLEG): container finished" podID="2c94a1ab-6730-4b36-928d-5582b2655ad4" containerID="d8b4a3c2e671392f3ab72f6fb4dd5880eb7b5f180094b407019aab04243bd4b5" exitCode=0
Jun 14 03:17:33.617426 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:33.616995    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qmsgr" event={"ID":"2c94a1ab-6730-4b36-928d-5582b2655ad4","Type":"ContainerDied","Data":"d8b4a3c2e671392f3ab72f6fb4dd5880eb7b5f180094b407019aab04243bd4b5"}
Jun 14 03:17:33.619171 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:33.619146    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr" event={"ID":"18192158-800a-4b9c-9ce0-a8d6ff97fe2e","Type":"ContainerStarted","Data":"03cb151695a8efa7e8c90fb2bc1786b7800fdf266b9c439daf86bbddb7bccf34"}
Jun 14 03:17:33.652629 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:33.652583    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-549pr" podStartSLOduration=1.754353308 podStartE2EDuration="2.65256642s" totalImagesPullingTime="898.213112ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:33.651738697 +0000 UTC m=+296.429183521" watchObservedRunningTime="2026-06-14 03:17:33.65256642 +0000 UTC m=+296.430011243"
Jun 14 03:17:34.582880 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:34.582852    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2pxlj"
Jun 14 03:17:34.630860 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:34.630822    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qmsgr" event={"ID":"2c94a1ab-6730-4b36-928d-5582b2655ad4","Type":"ContainerStarted","Data":"b2bbecc7aaac69f78cead77e5b9b8a83c7e232d1317eac8c521b3dca8b832bd7"}
Jun 14 03:17:34.631279 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:34.630900    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qmsgr" event={"ID":"2c94a1ab-6730-4b36-928d-5582b2655ad4","Type":"ContainerStarted","Data":"0ac82f500ab7316c0d63b22ba68f86b77cca57f70643c6915c9bb2e19fed3f74"}
Jun 14 03:17:34.651812 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:34.651766    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qmsgr" podStartSLOduration=2.465924509 podStartE2EDuration="3.651750437s" totalImagesPullingTime="1.121155525s" totalInitContainerRuntime="64.670403ms" isStatefulPod=true podCreationTimestamp="2026-06-14 03:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:34.650255208 +0000 UTC m=+297.427700054" watchObservedRunningTime="2026-06-14 03:17:34.651750437 +0000 UTC m=+297.429195314"
Jun 14 03:17:34.972671 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:34.972616    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"]
Jun 14 03:17:34.976492 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:34.976472    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:34.979208 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:34.979162    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 14 03:17:34.979364 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:34.979333    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 14 03:17:34.979452 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:34.979435    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 14 03:17:34.979529 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:34.979451    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3jr8m853088n6\""
Jun 14 03:17:34.979713 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:34.979697    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 14 03:17:34.979896 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:34.979881    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dc9md\""
Jun 14 03:17:34.979961 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:34.979883    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 14 03:17:34.988511 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:34.988488    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"]
Jun 14 03:17:35.020597 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.020567    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.020790 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.020614    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-grpc-tls\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.020790 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.020644    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.020790 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.020729    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzt6w\" (UniqueName: \"kubernetes.io/projected/a590ae68-37d9-469f-92c9-9c1adff7fe95-kube-api-access-nzt6w\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.020790 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.020778    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.020966 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.020798    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a590ae68-37d9-469f-92c9-9c1adff7fe95-metrics-client-ca\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.020966 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.020817    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.020966 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.020848    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-thanos-querier-tls\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.122013 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.121969    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzt6w\" (UniqueName: \"kubernetes.io/projected/a590ae68-37d9-469f-92c9-9c1adff7fe95-kube-api-access-nzt6w\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.122179 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.122029    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.122252 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.122207    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a590ae68-37d9-469f-92c9-9c1adff7fe95-metrics-client-ca\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.122252 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.122244    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.122407 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.122271    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-thanos-querier-tls\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.122407 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.122314    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.122407 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.122349    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-grpc-tls\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.122407 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.122373    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.123094 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.123053    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a590ae68-37d9-469f-92c9-9c1adff7fe95-metrics-client-ca\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.124918 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.124883    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-thanos-querier-tls\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.125044 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.124982    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.125044 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.125003    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-grpc-tls\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.125175 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.125119    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.125175 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.125138    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.125523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.125501    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a590ae68-37d9-469f-92c9-9c1adff7fe95-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.133575 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.133552    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzt6w\" (UniqueName: \"kubernetes.io/projected/a590ae68-37d9-469f-92c9-9c1adff7fe95-kube-api-access-nzt6w\") pod \"thanos-querier-5b95b445f5-rv7wl\" (UID: \"a590ae68-37d9-469f-92c9-9c1adff7fe95\") " pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.286403 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.286321    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:35.417846 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.417812    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"]
Jun 14 03:17:35.421250 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:17:35.421224    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda590ae68_37d9_469f_92c9_9c1adff7fe95.slice/crio-623e0001944daf6830d5d2373f28bdb265887c18ec2f9517c0e3a44b245684ae WatchSource:0}: Error finding container 623e0001944daf6830d5d2373f28bdb265887c18ec2f9517c0e3a44b245684ae: Status 404 returned error can't find the container with id 623e0001944daf6830d5d2373f28bdb265887c18ec2f9517c0e3a44b245684ae
Jun 14 03:17:35.635145 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:35.635113    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl" event={"ID":"a590ae68-37d9-469f-92c9-9c1adff7fe95","Type":"ContainerStarted","Data":"623e0001944daf6830d5d2373f28bdb265887c18ec2f9517c0e3a44b245684ae"}
Jun 14 03:17:37.622534 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:37.622510    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:17:37.624562 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:37.624539    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:17:37.629947 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:37.629924    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:17:37.631800 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:37.631784    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:17:37.634044 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:37.634031    2516 kubelet.go:1648] "Image garbage collection succeeded"
Jun 14 03:17:37.644806 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:37.644782    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl" event={"ID":"a590ae68-37d9-469f-92c9-9c1adff7fe95","Type":"ContainerStarted","Data":"53c70189716eefb984b91c23af251b15e537d07bbed012ad0a8c36d887310eb9"}
Jun 14 03:17:37.644890 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:37.644868    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl" event={"ID":"a590ae68-37d9-469f-92c9-9c1adff7fe95","Type":"ContainerStarted","Data":"19e5f7b1105ce563066a71dda825a7d80d761f7063f7e1194ea25680ec9a7249"}
Jun 14 03:17:37.644933 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:37.644894    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl" event={"ID":"a590ae68-37d9-469f-92c9-9c1adff7fe95","Type":"ContainerStarted","Data":"7158eac313c190303480373af2c1bd9831c96850c2a72b20e48a37936657d385"}
Jun 14 03:17:38.073224 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.073140    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 14 03:17:38.078836 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.078813    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.081456 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.081431    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 14 03:17:38.081620 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.081541    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hpm8z\""
Jun 14 03:17:38.081620 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.081429    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 14 03:17:38.081752 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.081635    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 14 03:17:38.081752 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.081659    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 14 03:17:38.081752 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.081726    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 14 03:17:38.081900 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.081857    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 14 03:17:38.081954 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.081911    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 14 03:17:38.082007 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.081963    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1mg0g7dpdejs6\""
Jun 14 03:17:38.082160 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.082139    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 14 03:17:38.082920 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.082901    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 14 03:17:38.083436 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.083417    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jun 14 03:17:38.083732 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.083712    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jun 14 03:17:38.083924 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.083903    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 14 03:17:38.084112 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.084098    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 14 03:17:38.084636 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.084610    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 14 03:17:38.085962 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.085941    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 14 03:17:38.092343 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.092314    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 14 03:17:38.152355 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152324    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fefb219d-e1ac-4a90-890c-ae282cd0589c-config-out\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.152355 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152358    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.152602 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152379    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.152602 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152397    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkswd\" (UniqueName: \"kubernetes.io/projected/fefb219d-e1ac-4a90-890c-ae282cd0589c-kube-api-access-mkswd\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.152602 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152416    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.152602 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152482    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.152602 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152545    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.152806 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152622    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.152806 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152643    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.152806 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152664    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fefb219d-e1ac-4a90-890c-ae282cd0589c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.152806 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152681    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.152806 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152698    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-config\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.152806 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152753    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-web-config\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.152806 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152796    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.153176 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152842    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.153176 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152894    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.153176 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152924    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.153176 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152968    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.153176 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.152994    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.153176 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.153024    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.253580 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.253492    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-web-config\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.253580 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.253544    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.253798 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.253586    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.253798 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.253612    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.253798 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.253641    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.253798 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.253669    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.253798 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.253692    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.253798 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.253725    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.253798 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.253792    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fefb219d-e1ac-4a90-890c-ae282cd0589c-config-out\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.254222 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.253817    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.254222 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.253852    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.254222 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.253882    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkswd\" (UniqueName: \"kubernetes.io/projected/fefb219d-e1ac-4a90-890c-ae282cd0589c-kube-api-access-mkswd\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.254222 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.253913    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.254222 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.253950    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.254222 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.253980    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.254222 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.254024    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.254222 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.254050    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.254222 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.254113    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fefb219d-e1ac-4a90-890c-ae282cd0589c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.254222 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.254142    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.254222 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.254172    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-config\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.254745 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.254602    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.254745 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.254636    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.255049 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.255023    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.255410 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.255376    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.256737 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.256705    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-web-config\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.256823 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.256714    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.257482 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.257280    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.257482 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.257300    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.257482 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.257428    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.257851 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.257817    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.258006 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.257949    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.259175 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.259110    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.260134 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.259117    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-config\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.260134 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.259726    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.260361 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.260305    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fefb219d-e1ac-4a90-890c-ae282cd0589c-config-out\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.260523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.260488    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fefb219d-e1ac-4a90-890c-ae282cd0589c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.261324 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.261281    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.263661 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.263636    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.264140 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.264071    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.268865 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.267730    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkswd\" (UniqueName: \"kubernetes.io/projected/fefb219d-e1ac-4a90-890c-ae282cd0589c-kube-api-access-mkswd\") pod \"prometheus-k8s-0\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.401341 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.401307    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:38.540439 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.540121    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 14 03:17:38.544608 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:17:38.544585    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfefb219d_e1ac_4a90_890c_ae282cd0589c.slice/crio-d991f0684dc724be3f470820d7bb5d324f342f99fcb735bdab4076d75b386d12 WatchSource:0}: Error finding container d991f0684dc724be3f470820d7bb5d324f342f99fcb735bdab4076d75b386d12: Status 404 returned error can't find the container with id d991f0684dc724be3f470820d7bb5d324f342f99fcb735bdab4076d75b386d12
Jun 14 03:17:38.649511 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.649472    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fefb219d-e1ac-4a90-890c-ae282cd0589c","Type":"ContainerStarted","Data":"d991f0684dc724be3f470820d7bb5d324f342f99fcb735bdab4076d75b386d12"}
Jun 14 03:17:38.652359 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.652330    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl" event={"ID":"a590ae68-37d9-469f-92c9-9c1adff7fe95","Type":"ContainerStarted","Data":"17829918498daf86c16735e891e781582219be0488196c279917bdafeffd9f4c"}
Jun 14 03:17:38.652495 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.652386    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl" event={"ID":"a590ae68-37d9-469f-92c9-9c1adff7fe95","Type":"ContainerStarted","Data":"5b53129968bf093e816aaae49ea6069f0f971cd8666c3f35418aeac26a83b4d1"}
Jun 14 03:17:38.652495 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.652417    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl" event={"ID":"a590ae68-37d9-469f-92c9-9c1adff7fe95","Type":"ContainerStarted","Data":"e6f34d193d47c0aeabcbc129030adf7d8c912b2058fa159e34402595db20c6e7"}
Jun 14 03:17:38.652495 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.652468    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:38.672058 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:38.672013    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl" podStartSLOduration=2.314056433 podStartE2EDuration="4.671988038s" totalImagesPullingTime="2.357931605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:17:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:38.670648263 +0000 UTC m=+301.448093101" watchObservedRunningTime="2026-06-14 03:17:38.671988038 +0000 UTC m=+301.449432862"
Jun 14 03:17:39.242629 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:39.242590    2516 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d796fc86d-lwgzj"]
Jun 14 03:17:39.247871 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:39.247766    2516 patch_prober.go:28] interesting pod/image-registry-7d796fc86d-lwgzj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 14 03:17:39.247871 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:39.247837    2516 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj" podUID="785ada15-72a0-4d3a-b899-b442c0b7d3e4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 14 03:17:39.660866 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:39.660835    2516 generic.go:356] "Generic (PLEG): container finished" podID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerID="4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960" exitCode=0
Jun 14 03:17:39.661240 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:39.660911    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fefb219d-e1ac-4a90-890c-ae282cd0589c","Type":"ContainerDied","Data":"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960"}
Jun 14 03:17:39.662031 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:39.662018    2516 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 14 03:17:43.686342 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:43.686308    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fefb219d-e1ac-4a90-890c-ae282cd0589c","Type":"ContainerStarted","Data":"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45"}
Jun 14 03:17:43.686717 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:43.686372    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fefb219d-e1ac-4a90-890c-ae282cd0589c","Type":"ContainerStarted","Data":"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79"}
Jun 14 03:17:43.686717 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:43.686399    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fefb219d-e1ac-4a90-890c-ae282cd0589c","Type":"ContainerStarted","Data":"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95"}
Jun 14 03:17:43.686717 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:43.686422    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fefb219d-e1ac-4a90-890c-ae282cd0589c","Type":"ContainerStarted","Data":"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b"}
Jun 14 03:17:43.686717 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:43.686451    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fefb219d-e1ac-4a90-890c-ae282cd0589c","Type":"ContainerStarted","Data":"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b"}
Jun 14 03:17:43.686717 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:43.686475    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fefb219d-e1ac-4a90-890c-ae282cd0589c","Type":"ContainerStarted","Data":"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3"}
Jun 14 03:17:43.713964 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:43.713906    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.531602254 podStartE2EDuration="5.713890281s" totalImagesPullingTime="4.160308129s" totalInitContainerRuntime="21.979898ms" isStatefulPod=false podCreationTimestamp="2026-06-14 03:17:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:43.711420454 +0000 UTC m=+306.488865276" watchObservedRunningTime="2026-06-14 03:17:43.713890281 +0000 UTC m=+306.491335135"
Jun 14 03:17:44.668189 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:44.668163    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5b95b445f5-rv7wl"
Jun 14 03:17:46.653415 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:46.653380    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:17:47.655835 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:47.655806    2516 scope.go:117] "RemoveContainer" containerID="ef128933144046c20bfbbfc638e3a24f0e279a6e252050b765dff25ff5753eb5"
Jun 14 03:17:48.402134 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:48.402096    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:17:48.708814 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:48.708742    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:17:48.709207 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:48.708816    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86" event={"ID":"b9fddd80-a36b-4069-82a5-25b8f9332e38","Type":"ContainerStarted","Data":"01d795c0f15ee2ba1dd560429cdc5553d32bc972494ef38590790421d459a2ca"}
Jun 14 03:17:48.709207 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:48.709116    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:17:48.713990 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:48.713967    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86"
Jun 14 03:17:48.728545 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:48.728503    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-g9m86" podStartSLOduration=56.858664347 podStartE2EDuration="58.728490117s" totalImagesPullingTime="1.86982577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:48.727308463 +0000 UTC m=+311.504753285" watchObservedRunningTime="2026-06-14 03:17:48.728490117 +0000 UTC m=+311.505934918"
Jun 14 03:17:49.247470 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:17:49.247440    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:18:04.265255 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.265192    2516 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj" podUID="785ada15-72a0-4d3a-b899-b442c0b7d3e4" containerName="registry" containerID="cri-o://d81c80ac7255113da747708f3cdad790dbb13c4c3e5627a6f5a87eb6a67261aa" gracePeriod=30
Jun 14 03:18:04.523283 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.523229    2516 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:18:04.598509 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.598482    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hw9v\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-kube-api-access-7hw9v\") pod \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") "
Jun 14 03:18:04.598509 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.598516    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-certificates\") pod \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") "
Jun 14 03:18:04.598716 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.598540    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/785ada15-72a0-4d3a-b899-b442c0b7d3e4-ca-trust-extracted\") pod \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") "
Jun 14 03:18:04.598716 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.598567    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls\") pod \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") "
Jun 14 03:18:04.598716 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.598608    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/785ada15-72a0-4d3a-b899-b442c0b7d3e4-trusted-ca\") pod \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") "
Jun 14 03:18:04.598716 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.598678    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/785ada15-72a0-4d3a-b899-b442c0b7d3e4-installation-pull-secrets\") pod \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") "
Jun 14 03:18:04.598716 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.598704    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-bound-sa-token\") pod \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") "
Jun 14 03:18:04.598965 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.598756    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/785ada15-72a0-4d3a-b899-b442c0b7d3e4-image-registry-private-configuration\") pod \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\" (UID: \"785ada15-72a0-4d3a-b899-b442c0b7d3e4\") "
Jun 14 03:18:04.599123 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.599041    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "785ada15-72a0-4d3a-b899-b442c0b7d3e4" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 14 03:18:04.599247 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.599149    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/785ada15-72a0-4d3a-b899-b442c0b7d3e4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "785ada15-72a0-4d3a-b899-b442c0b7d3e4" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 14 03:18:04.601061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.601025    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "785ada15-72a0-4d3a-b899-b442c0b7d3e4" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 14 03:18:04.601365 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.601338    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-kube-api-access-7hw9v" (OuterVolumeSpecName: "kube-api-access-7hw9v") pod "785ada15-72a0-4d3a-b899-b442c0b7d3e4" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4"). InnerVolumeSpecName "kube-api-access-7hw9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 14 03:18:04.601470 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.601368    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/785ada15-72a0-4d3a-b899-b442c0b7d3e4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "785ada15-72a0-4d3a-b899-b442c0b7d3e4" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 14 03:18:04.601470 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.601445    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/785ada15-72a0-4d3a-b899-b442c0b7d3e4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "785ada15-72a0-4d3a-b899-b442c0b7d3e4" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 14 03:18:04.601555 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.601466    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "785ada15-72a0-4d3a-b899-b442c0b7d3e4" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 14 03:18:04.606891 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.606865    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/785ada15-72a0-4d3a-b899-b442c0b7d3e4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "785ada15-72a0-4d3a-b899-b442c0b7d3e4" (UID: "785ada15-72a0-4d3a-b899-b442c0b7d3e4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 14 03:18:04.699655 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.699628    2516 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hw9v\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-kube-api-access-7hw9v\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:04.699655 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.699652    2516 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-certificates\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:04.699655 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.699662    2516 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/785ada15-72a0-4d3a-b899-b442c0b7d3e4-ca-trust-extracted\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:04.699655 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.699670    2516 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-registry-tls\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:04.699884 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.699679    2516 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/785ada15-72a0-4d3a-b899-b442c0b7d3e4-trusted-ca\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:04.699884 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.699687    2516 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/785ada15-72a0-4d3a-b899-b442c0b7d3e4-installation-pull-secrets\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:04.699884 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.699695    2516 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/785ada15-72a0-4d3a-b899-b442c0b7d3e4-bound-sa-token\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:04.699884 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.699705    2516 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/785ada15-72a0-4d3a-b899-b442c0b7d3e4-image-registry-private-configuration\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:04.777166 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.777063    2516 generic.go:356] "Generic (PLEG): container finished" podID="785ada15-72a0-4d3a-b899-b442c0b7d3e4" containerID="d81c80ac7255113da747708f3cdad790dbb13c4c3e5627a6f5a87eb6a67261aa" exitCode=0
Jun 14 03:18:04.777166 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.777123    2516 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj"
Jun 14 03:18:04.777329 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.777121    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj" event={"ID":"785ada15-72a0-4d3a-b899-b442c0b7d3e4","Type":"ContainerDied","Data":"d81c80ac7255113da747708f3cdad790dbb13c4c3e5627a6f5a87eb6a67261aa"}
Jun 14 03:18:04.777329 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.777236    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d796fc86d-lwgzj" event={"ID":"785ada15-72a0-4d3a-b899-b442c0b7d3e4","Type":"ContainerDied","Data":"b065dc061a0a3409a33aa005d891195144916de6acdf5fc504c7e1bd13f51fb8"}
Jun 14 03:18:04.777329 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.777257    2516 scope.go:117] "RemoveContainer" containerID="d81c80ac7255113da747708f3cdad790dbb13c4c3e5627a6f5a87eb6a67261aa"
Jun 14 03:18:04.785812 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.785797    2516 scope.go:117] "RemoveContainer" containerID="d81c80ac7255113da747708f3cdad790dbb13c4c3e5627a6f5a87eb6a67261aa"
Jun 14 03:18:04.786054 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:18:04.786039    2516 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d81c80ac7255113da747708f3cdad790dbb13c4c3e5627a6f5a87eb6a67261aa\": container with ID starting with d81c80ac7255113da747708f3cdad790dbb13c4c3e5627a6f5a87eb6a67261aa not found: ID does not exist" containerID="d81c80ac7255113da747708f3cdad790dbb13c4c3e5627a6f5a87eb6a67261aa"
Jun 14 03:18:04.786160 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.786062    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d81c80ac7255113da747708f3cdad790dbb13c4c3e5627a6f5a87eb6a67261aa"} err="failed to get container status \"d81c80ac7255113da747708f3cdad790dbb13c4c3e5627a6f5a87eb6a67261aa\": rpc error: code = NotFound desc = could not find container \"d81c80ac7255113da747708f3cdad790dbb13c4c3e5627a6f5a87eb6a67261aa\": container with ID starting with d81c80ac7255113da747708f3cdad790dbb13c4c3e5627a6f5a87eb6a67261aa not found: ID does not exist"
Jun 14 03:18:04.797689 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.797667    2516 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d796fc86d-lwgzj"]
Jun 14 03:18:04.800786 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:04.800764    2516 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d796fc86d-lwgzj"]
Jun 14 03:18:05.658707 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:05.658672    2516 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="785ada15-72a0-4d3a-b899-b442c0b7d3e4" path="/var/lib/kubelet/pods/785ada15-72a0-4d3a-b899-b442c0b7d3e4/volumes"
Jun 14 03:18:38.401794 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:38.401762    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:38.417982 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:38.417959    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:38.932908 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:38.932882    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:50.592459 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:50.592423    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs\") pod \"network-metrics-daemon-c7zzq\" (UID: \"a7812b72-9313-42ca-96cf-cde0c84e41d6\") " pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:18:50.594649 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:50.594628    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7812b72-9313-42ca-96cf-cde0c84e41d6-metrics-certs\") pod \"network-metrics-daemon-c7zzq\" (UID: \"a7812b72-9313-42ca-96cf-cde0c84e41d6\") " pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:18:50.856152 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:50.856053    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6hmrz\""
Jun 14 03:18:50.863983 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:50.863958    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c7zzq"
Jun 14 03:18:50.992605 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:50.992580    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c7zzq"]
Jun 14 03:18:50.995179 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:18:50.995144    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7812b72_9313_42ca_96cf_cde0c84e41d6.slice/crio-16cf989dd20104db0247267010bfbdb2b7fb40761c3473a0c24372d164070f3e WatchSource:0}: Error finding container 16cf989dd20104db0247267010bfbdb2b7fb40761c3473a0c24372d164070f3e: Status 404 returned error can't find the container with id 16cf989dd20104db0247267010bfbdb2b7fb40761c3473a0c24372d164070f3e
Jun 14 03:18:51.971415 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:51.971353    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c7zzq" event={"ID":"a7812b72-9313-42ca-96cf-cde0c84e41d6","Type":"ContainerStarted","Data":"16cf989dd20104db0247267010bfbdb2b7fb40761c3473a0c24372d164070f3e"}
Jun 14 03:18:52.976569 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:52.976527    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c7zzq" event={"ID":"a7812b72-9313-42ca-96cf-cde0c84e41d6","Type":"ContainerStarted","Data":"2df63d54eeafbb5415d6716b5b9bd9585e2185ce05b994eb3cae13986064cdd4"}
Jun 14 03:18:52.976939 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:52.976616    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c7zzq" event={"ID":"a7812b72-9313-42ca-96cf-cde0c84e41d6","Type":"ContainerStarted","Data":"8e1890240b7b7f0260a45d11ee424bfa6b12651c6a7c19ee197ceb25a903cba3"}
Jun 14 03:18:52.993213 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:52.993169    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c7zzq" podStartSLOduration=375.039817274 podStartE2EDuration="6m15.993155999s" totalImagesPullingTime="953.338725ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:18:52.990744742 +0000 UTC m=+375.768189580" watchObservedRunningTime="2026-06-14 03:18:52.993155999 +0000 UTC m=+375.770600822"
Jun 14 03:18:56.429343 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.429308    2516 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 14 03:18:56.429765 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.429599    2516 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="prometheus" containerID="cri-o://b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3" gracePeriod=600
Jun 14 03:18:56.429765 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.429636    2516 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="thanos-sidecar" containerID="cri-o://7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b" gracePeriod=600
Jun 14 03:18:56.429765 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.429636    2516 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="kube-rbac-proxy" containerID="cri-o://0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79" gracePeriod=600
Jun 14 03:18:56.429765 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.429686    2516 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45" gracePeriod=600
Jun 14 03:18:56.429765 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.429662    2516 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="kube-rbac-proxy-web" containerID="cri-o://489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95" gracePeriod=600
Jun 14 03:18:56.430018 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.429667    2516 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="config-reloader" containerID="cri-o://1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b" gracePeriod=600
Jun 14 03:18:56.696599 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.696564    2516 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:56.741511 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.741472    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.741686 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.741527    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-serving-certs-ca-bundle\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.741686 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.741560    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-metrics-client-ca\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.741686 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.741605    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-1\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.741686 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.741629    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-thanos-prometheus-http-client-file\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.741686 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.741659    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.744369 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.743912    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-trusted-ca-bundle\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.744369 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.744002    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fefb219d-e1ac-4a90-890c-ae282cd0589c-tls-assets\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.744369 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.744043    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-db\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.744369 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.744103    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-2\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.744369 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.744142    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-tls\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.744369 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.744186    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-config\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.744369 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.744222    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-grpc-tls\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.744369 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.744271    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-metrics-client-certs\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.744369 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.744265    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 14 03:18:56.744369 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.744301    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-web-config\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.744369 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.744329    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 14 03:18:56.744369 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.744342    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-0\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.746100 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.745111    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-kube-rbac-proxy\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.746100 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.745264    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fefb219d-e1ac-4a90-890c-ae282cd0589c-config-out\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.746100 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.745454    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkswd\" (UniqueName: \"kubernetes.io/projected/fefb219d-e1ac-4a90-890c-ae282cd0589c-kube-api-access-mkswd\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.746100 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.745649    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-kubelet-serving-ca-bundle\") pod \"fefb219d-e1ac-4a90-890c-ae282cd0589c\" (UID: \"fefb219d-e1ac-4a90-890c-ae282cd0589c\") "
Jun 14 03:18:56.747118 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.744330    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 14 03:18:56.747118 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.744523    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 14 03:18:56.747118 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.744781    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 14 03:18:56.749116 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.747480    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 14 03:18:56.749116 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.747557    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 14 03:18:56.749597 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.749562    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 14 03:18:56.750412 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.750378    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fefb219d-e1ac-4a90-890c-ae282cd0589c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 14 03:18:56.753941 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.753917    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 14 03:18:56.754594 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.753985    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fefb219d-e1ac-4a90-890c-ae282cd0589c-config-out" (OuterVolumeSpecName: "config-out") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 14 03:18:56.754594 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.754040    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 14 03:18:56.754734 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.754116    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 14 03:18:56.754734 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.754239    2516 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.754734 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.754639    2516 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-metrics-client-ca\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.754734 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.754655    2516 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.754734 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.754672    2516 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.754734 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.754691    2516 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.759068 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.759039    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 14 03:18:56.761563 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.761512    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 14 03:18:56.761563 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.761532    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 14 03:18:56.761712 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.761612    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-config" (OuterVolumeSpecName: "config") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 14 03:18:56.761712 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.761699    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 14 03:18:56.762366 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.762343    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fefb219d-e1ac-4a90-890c-ae282cd0589c-kube-api-access-mkswd" (OuterVolumeSpecName: "kube-api-access-mkswd") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "kube-api-access-mkswd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 14 03:18:56.770918 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.770894    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-web-config" (OuterVolumeSpecName: "web-config") pod "fefb219d-e1ac-4a90-890c-ae282cd0589c" (UID: "fefb219d-e1ac-4a90-890c-ae282cd0589c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 14 03:18:56.855121 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.855061    2516 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fefb219d-e1ac-4a90-890c-ae282cd0589c-tls-assets\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.855121 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.855118    2516 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-db\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.855121 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.855130    2516 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.855334 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.855139    2516 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-config\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.855334 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.855149    2516 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-grpc-tls\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.855334 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.855158    2516 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-metrics-client-certs\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.855334 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.855167    2516 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-web-config\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.855334 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.855175    2516 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.855334 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.855182    2516 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-kube-rbac-proxy\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.855334 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.855191    2516 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fefb219d-e1ac-4a90-890c-ae282cd0589c-config-out\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.855334 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.855199    2516 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkswd\" (UniqueName: \"kubernetes.io/projected/fefb219d-e1ac-4a90-890c-ae282cd0589c-kube-api-access-mkswd\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.855334 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.855208    2516 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefb219d-e1ac-4a90-890c-ae282cd0589c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.855334 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.855218    2516 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.855334 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.855228    2516 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.855334 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.855237    2516 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fefb219d-e1ac-4a90-890c-ae282cd0589c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:18:56.995129 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.995025    2516 generic.go:356] "Generic (PLEG): container finished" podID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerID="289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45" exitCode=0
Jun 14 03:18:56.995129 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.995052    2516 generic.go:356] "Generic (PLEG): container finished" podID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerID="0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79" exitCode=0
Jun 14 03:18:56.995129 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.995059    2516 generic.go:356] "Generic (PLEG): container finished" podID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerID="489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95" exitCode=0
Jun 14 03:18:56.995129 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.995065    2516 generic.go:356] "Generic (PLEG): container finished" podID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerID="7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b" exitCode=0
Jun 14 03:18:56.995129 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.995071    2516 generic.go:356] "Generic (PLEG): container finished" podID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerID="1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b" exitCode=0
Jun 14 03:18:56.995129 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.995088    2516 generic.go:356] "Generic (PLEG): container finished" podID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerID="b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3" exitCode=0
Jun 14 03:18:56.995405 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.995139    2516 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:56.995405 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.995145    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fefb219d-e1ac-4a90-890c-ae282cd0589c","Type":"ContainerDied","Data":"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45"}
Jun 14 03:18:56.995405 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.995228    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fefb219d-e1ac-4a90-890c-ae282cd0589c","Type":"ContainerDied","Data":"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79"}
Jun 14 03:18:56.995405 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.995255    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fefb219d-e1ac-4a90-890c-ae282cd0589c","Type":"ContainerDied","Data":"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95"}
Jun 14 03:18:56.995405 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.995278    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fefb219d-e1ac-4a90-890c-ae282cd0589c","Type":"ContainerDied","Data":"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b"}
Jun 14 03:18:56.995405 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.995304    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fefb219d-e1ac-4a90-890c-ae282cd0589c","Type":"ContainerDied","Data":"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b"}
Jun 14 03:18:56.995405 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.995309    2516 scope.go:117] "RemoveContainer" containerID="289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45"
Jun 14 03:18:56.995673 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.995333    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fefb219d-e1ac-4a90-890c-ae282cd0589c","Type":"ContainerDied","Data":"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3"}
Jun 14 03:18:56.995673 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:56.995442    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fefb219d-e1ac-4a90-890c-ae282cd0589c","Type":"ContainerDied","Data":"d991f0684dc724be3f470820d7bb5d324f342f99fcb735bdab4076d75b386d12"}
Jun 14 03:18:57.003608 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.003583    2516 scope.go:117] "RemoveContainer" containerID="0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79"
Jun 14 03:18:57.010477 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.010462    2516 scope.go:117] "RemoveContainer" containerID="489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95"
Jun 14 03:18:57.016672 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.016655    2516 scope.go:117] "RemoveContainer" containerID="7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b"
Jun 14 03:18:57.018966 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.018947    2516 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 14 03:18:57.023911 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.023895    2516 scope.go:117] "RemoveContainer" containerID="1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b"
Jun 14 03:18:57.024333 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.024314    2516 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 14 03:18:57.030458 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.030442    2516 scope.go:117] "RemoveContainer" containerID="b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3"
Jun 14 03:18:57.037391 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.037378    2516 scope.go:117] "RemoveContainer" containerID="4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960"
Jun 14 03:18:57.043835 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.043813    2516 scope.go:117] "RemoveContainer" containerID="289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45"
Jun 14 03:18:57.044170 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:18:57.044073    2516 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45\": container with ID starting with 289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45 not found: ID does not exist" containerID="289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45"
Jun 14 03:18:57.044170 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.044137    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45"} err="failed to get container status \"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45\": rpc error: code = NotFound desc = could not find container \"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45\": container with ID starting with 289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45 not found: ID does not exist"
Jun 14 03:18:57.044170 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.044155    2516 scope.go:117] "RemoveContainer" containerID="0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79"
Jun 14 03:18:57.044386 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:18:57.044369    2516 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79\": container with ID starting with 0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79 not found: ID does not exist" containerID="0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79"
Jun 14 03:18:57.044425 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.044391    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79"} err="failed to get container status \"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79\": rpc error: code = NotFound desc = could not find container \"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79\": container with ID starting with 0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79 not found: ID does not exist"
Jun 14 03:18:57.044425 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.044406    2516 scope.go:117] "RemoveContainer" containerID="489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95"
Jun 14 03:18:57.044644 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:18:57.044628    2516 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95\": container with ID starting with 489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95 not found: ID does not exist" containerID="489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95"
Jun 14 03:18:57.044685 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.044648    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95"} err="failed to get container status \"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95\": rpc error: code = NotFound desc = could not find container \"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95\": container with ID starting with 489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95 not found: ID does not exist"
Jun 14 03:18:57.044685 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.044662    2516 scope.go:117] "RemoveContainer" containerID="7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b"
Jun 14 03:18:57.044885 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:18:57.044869    2516 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b\": container with ID starting with 7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b not found: ID does not exist" containerID="7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b"
Jun 14 03:18:57.044938 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.044890    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b"} err="failed to get container status \"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b\": rpc error: code = NotFound desc = could not find container \"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b\": container with ID starting with 7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b not found: ID does not exist"
Jun 14 03:18:57.044938 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.044905    2516 scope.go:117] "RemoveContainer" containerID="1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b"
Jun 14 03:18:57.045168 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:18:57.045148    2516 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b\": container with ID starting with 1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b not found: ID does not exist" containerID="1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b"
Jun 14 03:18:57.045207 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.045169    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b"} err="failed to get container status \"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b\": rpc error: code = NotFound desc = could not find container \"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b\": container with ID starting with 1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b not found: ID does not exist"
Jun 14 03:18:57.045207 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.045183    2516 scope.go:117] "RemoveContainer" containerID="b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3"
Jun 14 03:18:57.045411 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:18:57.045395    2516 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3\": container with ID starting with b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3 not found: ID does not exist" containerID="b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3"
Jun 14 03:18:57.045453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.045415    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3"} err="failed to get container status \"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3\": rpc error: code = NotFound desc = could not find container \"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3\": container with ID starting with b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3 not found: ID does not exist"
Jun 14 03:18:57.045453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.045430    2516 scope.go:117] "RemoveContainer" containerID="4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960"
Jun 14 03:18:57.045630 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:18:57.045614    2516 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960\": container with ID starting with 4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960 not found: ID does not exist" containerID="4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960"
Jun 14 03:18:57.045671 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.045634    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960"} err="failed to get container status \"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960\": rpc error: code = NotFound desc = could not find container \"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960\": container with ID starting with 4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960 not found: ID does not exist"
Jun 14 03:18:57.045671 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.045647    2516 scope.go:117] "RemoveContainer" containerID="289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45"
Jun 14 03:18:57.045852 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.045833    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45"} err="failed to get container status \"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45\": rpc error: code = NotFound desc = could not find container \"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45\": container with ID starting with 289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45 not found: ID does not exist"
Jun 14 03:18:57.045905 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.045854    2516 scope.go:117] "RemoveContainer" containerID="0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79"
Jun 14 03:18:57.046097 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.046065    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79"} err="failed to get container status \"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79\": rpc error: code = NotFound desc = could not find container \"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79\": container with ID starting with 0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79 not found: ID does not exist"
Jun 14 03:18:57.046143 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.046098    2516 scope.go:117] "RemoveContainer" containerID="489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95"
Jun 14 03:18:57.046299 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.046281    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95"} err="failed to get container status \"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95\": rpc error: code = NotFound desc = could not find container \"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95\": container with ID starting with 489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95 not found: ID does not exist"
Jun 14 03:18:57.046337 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.046300    2516 scope.go:117] "RemoveContainer" containerID="7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b"
Jun 14 03:18:57.046517 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.046498    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b"} err="failed to get container status \"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b\": rpc error: code = NotFound desc = could not find container \"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b\": container with ID starting with 7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b not found: ID does not exist"
Jun 14 03:18:57.046557 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.046517    2516 scope.go:117] "RemoveContainer" containerID="1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b"
Jun 14 03:18:57.046731 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.046712    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b"} err="failed to get container status \"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b\": rpc error: code = NotFound desc = could not find container \"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b\": container with ID starting with 1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b not found: ID does not exist"
Jun 14 03:18:57.046785 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.046731    2516 scope.go:117] "RemoveContainer" containerID="b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3"
Jun 14 03:18:57.046962 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.046946    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3"} err="failed to get container status \"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3\": rpc error: code = NotFound desc = could not find container \"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3\": container with ID starting with b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3 not found: ID does not exist"
Jun 14 03:18:57.047002 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.046963    2516 scope.go:117] "RemoveContainer" containerID="4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960"
Jun 14 03:18:57.047225 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.047207    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960"} err="failed to get container status \"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960\": rpc error: code = NotFound desc = could not find container \"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960\": container with ID starting with 4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960 not found: ID does not exist"
Jun 14 03:18:57.047281 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.047225    2516 scope.go:117] "RemoveContainer" containerID="289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45"
Jun 14 03:18:57.047452 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.047433    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45"} err="failed to get container status \"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45\": rpc error: code = NotFound desc = could not find container \"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45\": container with ID starting with 289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45 not found: ID does not exist"
Jun 14 03:18:57.047559 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.047454    2516 scope.go:117] "RemoveContainer" containerID="0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79"
Jun 14 03:18:57.047698 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.047681    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79"} err="failed to get container status \"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79\": rpc error: code = NotFound desc = could not find container \"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79\": container with ID starting with 0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79 not found: ID does not exist"
Jun 14 03:18:57.047745 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.047701    2516 scope.go:117] "RemoveContainer" containerID="489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95"
Jun 14 03:18:57.047906 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.047889    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95"} err="failed to get container status \"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95\": rpc error: code = NotFound desc = could not find container \"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95\": container with ID starting with 489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95 not found: ID does not exist"
Jun 14 03:18:57.047975 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.047908    2516 scope.go:117] "RemoveContainer" containerID="7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b"
Jun 14 03:18:57.048156 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.048139    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b"} err="failed to get container status \"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b\": rpc error: code = NotFound desc = could not find container \"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b\": container with ID starting with 7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b not found: ID does not exist"
Jun 14 03:18:57.048206 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.048158    2516 scope.go:117] "RemoveContainer" containerID="1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b"
Jun 14 03:18:57.048378 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.048357    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b"} err="failed to get container status \"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b\": rpc error: code = NotFound desc = could not find container \"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b\": container with ID starting with 1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b not found: ID does not exist"
Jun 14 03:18:57.048419 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.048381    2516 scope.go:117] "RemoveContainer" containerID="b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3"
Jun 14 03:18:57.048608 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.048589    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3"} err="failed to get container status \"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3\": rpc error: code = NotFound desc = could not find container \"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3\": container with ID starting with b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3 not found: ID does not exist"
Jun 14 03:18:57.048654 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.048608    2516 scope.go:117] "RemoveContainer" containerID="4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960"
Jun 14 03:18:57.048815 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.048794    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960"} err="failed to get container status \"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960\": rpc error: code = NotFound desc = could not find container \"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960\": container with ID starting with 4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960 not found: ID does not exist"
Jun 14 03:18:57.048815 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.048813    2516 scope.go:117] "RemoveContainer" containerID="289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45"
Jun 14 03:18:57.049022 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.049005    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45"} err="failed to get container status \"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45\": rpc error: code = NotFound desc = could not find container \"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45\": container with ID starting with 289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45 not found: ID does not exist"
Jun 14 03:18:57.049070 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.049022    2516 scope.go:117] "RemoveContainer" containerID="0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79"
Jun 14 03:18:57.049269 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.049251    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79"} err="failed to get container status \"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79\": rpc error: code = NotFound desc = could not find container \"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79\": container with ID starting with 0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79 not found: ID does not exist"
Jun 14 03:18:57.049269 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.049270    2516 scope.go:117] "RemoveContainer" containerID="489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95"
Jun 14 03:18:57.049488 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.049468    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95"} err="failed to get container status \"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95\": rpc error: code = NotFound desc = could not find container \"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95\": container with ID starting with 489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95 not found: ID does not exist"
Jun 14 03:18:57.049488 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.049484    2516 scope.go:117] "RemoveContainer" containerID="7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b"
Jun 14 03:18:57.049701 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.049686    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b"} err="failed to get container status \"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b\": rpc error: code = NotFound desc = could not find container \"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b\": container with ID starting with 7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b not found: ID does not exist"
Jun 14 03:18:57.049740 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.049703    2516 scope.go:117] "RemoveContainer" containerID="1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b"
Jun 14 03:18:57.049896 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.049878    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b"} err="failed to get container status \"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b\": rpc error: code = NotFound desc = could not find container \"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b\": container with ID starting with 1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b not found: ID does not exist"
Jun 14 03:18:57.049957 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.049896    2516 scope.go:117] "RemoveContainer" containerID="b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3"
Jun 14 03:18:57.050108 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.050072    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3"} err="failed to get container status \"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3\": rpc error: code = NotFound desc = could not find container \"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3\": container with ID starting with b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3 not found: ID does not exist"
Jun 14 03:18:57.050187 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.050110    2516 scope.go:117] "RemoveContainer" containerID="4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960"
Jun 14 03:18:57.050340 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.050325    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960"} err="failed to get container status \"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960\": rpc error: code = NotFound desc = could not find container \"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960\": container with ID starting with 4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960 not found: ID does not exist"
Jun 14 03:18:57.050390 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.050339    2516 scope.go:117] "RemoveContainer" containerID="289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45"
Jun 14 03:18:57.050537 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.050518    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45"} err="failed to get container status \"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45\": rpc error: code = NotFound desc = could not find container \"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45\": container with ID starting with 289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45 not found: ID does not exist"
Jun 14 03:18:57.050590 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.050539    2516 scope.go:117] "RemoveContainer" containerID="0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79"
Jun 14 03:18:57.050769 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.050747    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79"} err="failed to get container status \"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79\": rpc error: code = NotFound desc = could not find container \"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79\": container with ID starting with 0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79 not found: ID does not exist"
Jun 14 03:18:57.050820 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.050772    2516 scope.go:117] "RemoveContainer" containerID="489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95"
Jun 14 03:18:57.051006 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.050990    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95"} err="failed to get container status \"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95\": rpc error: code = NotFound desc = could not find container \"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95\": container with ID starting with 489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95 not found: ID does not exist"
Jun 14 03:18:57.051053 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.051006    2516 scope.go:117] "RemoveContainer" containerID="7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b"
Jun 14 03:18:57.051273 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.051228    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b"} err="failed to get container status \"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b\": rpc error: code = NotFound desc = could not find container \"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b\": container with ID starting with 7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b not found: ID does not exist"
Jun 14 03:18:57.051325 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.051274    2516 scope.go:117] "RemoveContainer" containerID="1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b"
Jun 14 03:18:57.051507 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.051489    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b"} err="failed to get container status \"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b\": rpc error: code = NotFound desc = could not find container \"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b\": container with ID starting with 1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b not found: ID does not exist"
Jun 14 03:18:57.051578 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.051509    2516 scope.go:117] "RemoveContainer" containerID="b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3"
Jun 14 03:18:57.051729 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.051710    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3"} err="failed to get container status \"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3\": rpc error: code = NotFound desc = could not find container \"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3\": container with ID starting with b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3 not found: ID does not exist"
Jun 14 03:18:57.051773 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.051730    2516 scope.go:117] "RemoveContainer" containerID="4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960"
Jun 14 03:18:57.051951 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.051895    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960"} err="failed to get container status \"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960\": rpc error: code = NotFound desc = could not find container \"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960\": container with ID starting with 4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960 not found: ID does not exist"
Jun 14 03:18:57.051994 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.051952    2516 scope.go:117] "RemoveContainer" containerID="289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45"
Jun 14 03:18:57.052227 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.052207    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45"} err="failed to get container status \"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45\": rpc error: code = NotFound desc = could not find container \"289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45\": container with ID starting with 289ccf17476b825f263bc016e316379ba50254783dbc6fa5f8ba862b2ed75d45 not found: ID does not exist"
Jun 14 03:18:57.052227 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.052226    2516 scope.go:117] "RemoveContainer" containerID="0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79"
Jun 14 03:18:57.052509 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.052484    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79"} err="failed to get container status \"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79\": rpc error: code = NotFound desc = could not find container \"0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79\": container with ID starting with 0113aa570eaa54dc1db974f1f98486f843d2fc1ae247bf55c5424a0d50975d79 not found: ID does not exist"
Jun 14 03:18:57.052509 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.052506    2516 scope.go:117] "RemoveContainer" containerID="489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95"
Jun 14 03:18:57.052897 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.052760    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95"} err="failed to get container status \"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95\": rpc error: code = NotFound desc = could not find container \"489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95\": container with ID starting with 489c8c2c6e11ad4c933a2e3ef91abeb15c516000c0965a9005a76c6b9afbaa95 not found: ID does not exist"
Jun 14 03:18:57.052897 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.052785    2516 scope.go:117] "RemoveContainer" containerID="7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b"
Jun 14 03:18:57.053044 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.053025    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b"} err="failed to get container status \"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b\": rpc error: code = NotFound desc = could not find container \"7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b\": container with ID starting with 7f794ac89c20c7eb2c8b71651622e00e1c41810e27cc70af85e08e954859f69b not found: ID does not exist"
Jun 14 03:18:57.053044 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.053041    2516 scope.go:117] "RemoveContainer" containerID="1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b"
Jun 14 03:18:57.053321 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.053302    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b"} err="failed to get container status \"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b\": rpc error: code = NotFound desc = could not find container \"1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b\": container with ID starting with 1900e323ad06fb9f38dda132403253f19bba656ff0b74be5c607b3f439baba3b not found: ID does not exist"
Jun 14 03:18:57.053386 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.053322    2516 scope.go:117] "RemoveContainer" containerID="b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3"
Jun 14 03:18:57.053580 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.053559    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3"} err="failed to get container status \"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3\": rpc error: code = NotFound desc = could not find container \"b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3\": container with ID starting with b8b9a8db2724659b6013c46c5d0e6407a3f8603c71009bf66d3cbae5580d60e3 not found: ID does not exist"
Jun 14 03:18:57.053666 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.053582    2516 scope.go:117] "RemoveContainer" containerID="4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960"
Jun 14 03:18:57.053861 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.053843    2516 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960"} err="failed to get container status \"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960\": rpc error: code = NotFound desc = could not find container \"4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960\": container with ID starting with 4a24a3453d344706096c7f24c04361bce9c2faa0aa747de82fb36955b7b83960 not found: ID does not exist"
Jun 14 03:18:57.054866 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.054849    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 14 03:18:57.055155 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055143    2516 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="kube-rbac-proxy"
Jun 14 03:18:57.055197 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055157    2516 state_mem.go:107] "Deleted CPUSet assignment" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="kube-rbac-proxy"
Jun 14 03:18:57.055197 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055171    2516 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="prometheus"
Jun 14 03:18:57.055197 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055177    2516 state_mem.go:107] "Deleted CPUSet assignment" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="prometheus"
Jun 14 03:18:57.055197 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055187    2516 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="init-config-reloader"
Jun 14 03:18:57.055197 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055193    2516 state_mem.go:107] "Deleted CPUSet assignment" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="init-config-reloader"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055199    2516 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="config-reloader"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055205    2516 state_mem.go:107] "Deleted CPUSet assignment" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="config-reloader"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055211    2516 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="thanos-sidecar"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055216    2516 state_mem.go:107] "Deleted CPUSet assignment" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="thanos-sidecar"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055224    2516 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="kube-rbac-proxy-web"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055230    2516 state_mem.go:107] "Deleted CPUSet assignment" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="kube-rbac-proxy-web"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055236    2516 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="785ada15-72a0-4d3a-b899-b442c0b7d3e4" containerName="registry"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055242    2516 state_mem.go:107] "Deleted CPUSet assignment" podUID="785ada15-72a0-4d3a-b899-b442c0b7d3e4" containerName="registry"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055248    2516 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="kube-rbac-proxy-thanos"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055253    2516 state_mem.go:107] "Deleted CPUSet assignment" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="kube-rbac-proxy-thanos"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055295    2516 memory_manager.go:368] "RemoveStaleState removing state" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="config-reloader"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055302    2516 memory_manager.go:368] "RemoveStaleState removing state" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="kube-rbac-proxy"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055309    2516 memory_manager.go:368] "RemoveStaleState removing state" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="thanos-sidecar"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055315    2516 memory_manager.go:368] "RemoveStaleState removing state" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="kube-rbac-proxy-thanos"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055321    2516 memory_manager.go:368] "RemoveStaleState removing state" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="kube-rbac-proxy-web"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055328    2516 memory_manager.go:368] "RemoveStaleState removing state" podUID="785ada15-72a0-4d3a-b899-b442c0b7d3e4" containerName="registry"
Jun 14 03:18:57.055346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.055334    2516 memory_manager.go:368] "RemoveStaleState removing state" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" containerName="prometheus"
Jun 14 03:18:57.060431 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.060415    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.064023 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.063632    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 14 03:18:57.064023 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.063998    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 14 03:18:57.064600 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.064207    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 14 03:18:57.064600 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.064234    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 14 03:18:57.064600 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.064462    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 14 03:18:57.064600 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.064465    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jun 14 03:18:57.064600 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.064479    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1mg0g7dpdejs6\""
Jun 14 03:18:57.064600 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.064562    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 14 03:18:57.065436 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.064674    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 14 03:18:57.065436 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.064802    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 14 03:18:57.065436 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.064891    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 14 03:18:57.065436 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.065023    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hpm8z\""
Jun 14 03:18:57.065436 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.065021    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 14 03:18:57.065436 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.065110    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jun 14 03:18:57.065436 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.065354    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 14 03:18:57.070231 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.070214    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 14 03:18:57.074420 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.074399    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 14 03:18:57.078375 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.078355    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 14 03:18:57.158406 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158374    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.158406 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158405    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.158615 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158427    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.158615 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158446    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.158615 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158488    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.158615 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158557    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.158615 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158580    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-config\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.158615 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158597    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-config-out\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.158800 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158617    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqtvd\" (UniqueName: \"kubernetes.io/projected/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-kube-api-access-lqtvd\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.158800 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158637    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.158800 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158655    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.158800 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158680    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.158800 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158701    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.158800 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158723    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.158800 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158740    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-web-config\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.158800 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158779    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.159038 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158820    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.159038 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158841    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.159038 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158864    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.159038 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.158881    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.259803 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.259719    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.259803 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.259760    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.259803 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.259783    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.259803 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.259801    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-web-config\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260122 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.259827    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260122 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.259865    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260122 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.259892    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260122 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.259927    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260122 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.259954    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260122 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.259985    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260122 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.260008    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260122 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.260038    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260122 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.260066    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260122 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.260113    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260592 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.260149    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260592 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.260184    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-config\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260592 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.260208    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-config-out\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260592 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.260234    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqtvd\" (UniqueName: \"kubernetes.io/projected/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-kube-api-access-lqtvd\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260592 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.260261    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260592 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.260289    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.260884 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.260791    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.261209 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.261186    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.261490 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.261463    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.262502 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.262163    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.263197 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.262626    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.263197 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.262791    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-web-config\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.263197 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.262948    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.263197 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.263133    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.263197 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.263150    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.263518 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.263216    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.263918 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.263641    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.263918 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.263740    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.263918 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.263764    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.264159 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.264133    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.264929 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.264903    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.265178 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.265158    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.265693 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.265668    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-config\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.265772 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.265744    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-config-out\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.265865 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.265850    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.272012 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.271985    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqtvd\" (UniqueName: \"kubernetes.io/projected/d679ea6a-69d9-49d8-88f3-f7aa53ddddb9-kube-api-access-lqtvd\") pod \"prometheus-k8s-0\" (UID: \"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.372254 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.372224    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:18:57.510493 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.510421    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 14 03:18:57.513629 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:18:57.513601    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd679ea6a_69d9_49d8_88f3_f7aa53ddddb9.slice/crio-a159932d237dc05851948802f67438f22f8d2ce75499a2d88d86c9779d7ddd60 WatchSource:0}: Error finding container a159932d237dc05851948802f67438f22f8d2ce75499a2d88d86c9779d7ddd60: Status 404 returned error can't find the container with id a159932d237dc05851948802f67438f22f8d2ce75499a2d88d86c9779d7ddd60
Jun 14 03:18:57.658574 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:57.658534    2516 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fefb219d-e1ac-4a90-890c-ae282cd0589c" path="/var/lib/kubelet/pods/fefb219d-e1ac-4a90-890c-ae282cd0589c/volumes"
Jun 14 03:18:58.000488 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:58.000457    2516 generic.go:356] "Generic (PLEG): container finished" podID="d679ea6a-69d9-49d8-88f3-f7aa53ddddb9" containerID="98202a65305737ae2f5f569a1f654a6413697156241142ee39d3b2e01f21a4e1" exitCode=0
Jun 14 03:18:58.000634 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:58.000545    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9","Type":"ContainerDied","Data":"98202a65305737ae2f5f569a1f654a6413697156241142ee39d3b2e01f21a4e1"}
Jun 14 03:18:58.000634 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:58.000618    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9","Type":"ContainerStarted","Data":"a159932d237dc05851948802f67438f22f8d2ce75499a2d88d86c9779d7ddd60"}
Jun 14 03:18:59.008916 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:59.008882    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9","Type":"ContainerStarted","Data":"f144eead34af6adca027d4daed5908766ba2990448dd8139e1865b0e1bfafb47"}
Jun 14 03:18:59.009319 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:59.008971    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9","Type":"ContainerStarted","Data":"3cd6d4d7d5c8dac60bec9310a49683fe2ecb5db9d158758c49b21d9f014b8bff"}
Jun 14 03:18:59.009319 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:59.008998    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9","Type":"ContainerStarted","Data":"70ed1e3ff8e9fec39d893c1fb99177c9ec8df64581d6c02fb308ea054adfe9ca"}
Jun 14 03:18:59.009319 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:59.009026    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9","Type":"ContainerStarted","Data":"d10d74687a312ca3cc451d54e7ef790212c8a54eb37dc0a3434b18cc4624ffb4"}
Jun 14 03:18:59.009319 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:59.009051    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9","Type":"ContainerStarted","Data":"884dfd7420a1dcb191e25c597409d2a415b53f556b67d628e2e2d489c4e9c095"}
Jun 14 03:18:59.009319 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:59.009074    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d679ea6a-69d9-49d8-88f3-f7aa53ddddb9","Type":"ContainerStarted","Data":"96e9fbcbd7a8cde1abf848d719d5a9eeef76c9cd259c7078acff75dd8952debd"}
Jun 14 03:18:59.038402 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:18:59.038345    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.018902461 podStartE2EDuration="2.038327201s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.42474ms" isStatefulPod=false podCreationTimestamp="2026-06-14 03:18:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:18:59.035954872 +0000 UTC m=+381.813399712" watchObservedRunningTime="2026-06-14 03:18:59.038327201 +0000 UTC m=+381.815772024"
Jun 14 03:19:02.372742 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:19:02.372703    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:19:57.373205 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:19:57.373114    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:19:57.388572 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:19:57.388548    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:19:58.253013 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:19:58.252985    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 14 03:20:31.809261 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:31.809226    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-69jcn"]
Jun 14 03:20:31.812432 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:31.812417    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-69jcn"
Jun 14 03:20:31.816538 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:31.816516    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 14 03:20:31.817529 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:31.817512    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-hhb4d\""
Jun 14 03:20:31.817627 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:31.817533    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 14 03:20:31.822743 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:31.822720    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-69jcn"]
Jun 14 03:20:31.840370 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:31.840338    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tzsk\" (UniqueName: \"kubernetes.io/projected/e91f5029-e0a1-4143-828f-aa673e0b8a2d-kube-api-access-6tzsk\") pod \"openshift-lws-operator-fd8ccff4c-69jcn\" (UID: \"e91f5029-e0a1-4143-828f-aa673e0b8a2d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-69jcn"
Jun 14 03:20:31.840463 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:31.840398    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e91f5029-e0a1-4143-828f-aa673e0b8a2d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-69jcn\" (UID: \"e91f5029-e0a1-4143-828f-aa673e0b8a2d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-69jcn"
Jun 14 03:20:31.941398 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:31.941355    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e91f5029-e0a1-4143-828f-aa673e0b8a2d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-69jcn\" (UID: \"e91f5029-e0a1-4143-828f-aa673e0b8a2d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-69jcn"
Jun 14 03:20:31.941544 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:31.941431    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tzsk\" (UniqueName: \"kubernetes.io/projected/e91f5029-e0a1-4143-828f-aa673e0b8a2d-kube-api-access-6tzsk\") pod \"openshift-lws-operator-fd8ccff4c-69jcn\" (UID: \"e91f5029-e0a1-4143-828f-aa673e0b8a2d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-69jcn"
Jun 14 03:20:31.941723 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:31.941705    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e91f5029-e0a1-4143-828f-aa673e0b8a2d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-69jcn\" (UID: \"e91f5029-e0a1-4143-828f-aa673e0b8a2d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-69jcn"
Jun 14 03:20:31.949761 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:31.949742    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tzsk\" (UniqueName: \"kubernetes.io/projected/e91f5029-e0a1-4143-828f-aa673e0b8a2d-kube-api-access-6tzsk\") pod \"openshift-lws-operator-fd8ccff4c-69jcn\" (UID: \"e91f5029-e0a1-4143-828f-aa673e0b8a2d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-69jcn"
Jun 14 03:20:32.129260 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:32.129236    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-69jcn"
Jun 14 03:20:32.252598 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:32.252542    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-69jcn"]
Jun 14 03:20:32.255477 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:20:32.255455    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode91f5029_e0a1_4143_828f_aa673e0b8a2d.slice/crio-1cc79dfa9f0ba1854adcfb39eab1d0310e77773edbf39743b6e4ce9a52575ede WatchSource:0}: Error finding container 1cc79dfa9f0ba1854adcfb39eab1d0310e77773edbf39743b6e4ce9a52575ede: Status 404 returned error can't find the container with id 1cc79dfa9f0ba1854adcfb39eab1d0310e77773edbf39743b6e4ce9a52575ede
Jun 14 03:20:32.369505 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:32.369473    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-69jcn" event={"ID":"e91f5029-e0a1-4143-828f-aa673e0b8a2d","Type":"ContainerStarted","Data":"1cc79dfa9f0ba1854adcfb39eab1d0310e77773edbf39743b6e4ce9a52575ede"}
Jun 14 03:20:35.386844 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:35.386811    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-69jcn" event={"ID":"e91f5029-e0a1-4143-828f-aa673e0b8a2d","Type":"ContainerStarted","Data":"b6f63f74e002a05ce8f2dac6fdb63514fd7c172359f3dd555f6126cb40c60b55"}
Jun 14 03:20:52.765520 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.765467    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-69jcn" podStartSLOduration=18.865768877 podStartE2EDuration="21.765451752s" totalImagesPullingTime="2.899682875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:20:35.403423098 +0000 UTC m=+478.180867914" watchObservedRunningTime="2026-06-14 03:20:52.765451752 +0000 UTC m=+495.542896570"
Jun 14 03:20:52.766872 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.766852    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"]
Jun 14 03:20:52.772727 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.772708    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"
Jun 14 03:20:52.776439 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.776420    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jun 14 03:20:52.776541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.776424    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-drth5\""
Jun 14 03:20:52.776541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.776461    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jun 14 03:20:52.776541 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.776424    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jun 14 03:20:52.781656 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.781633    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"]
Jun 14 03:20:52.798595 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.798564    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fctmx\" (UniqueName: \"kubernetes.io/projected/92c53fbc-bacd-4e20-ae82-c7e885ca8a1e-kube-api-access-fctmx\") pod \"lws-controller-manager-7bfc4d86bf-jtrwj\" (UID: \"92c53fbc-bacd-4e20-ae82-c7e885ca8a1e\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"
Jun 14 03:20:52.798719 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.798599    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92c53fbc-bacd-4e20-ae82-c7e885ca8a1e-cert\") pod \"lws-controller-manager-7bfc4d86bf-jtrwj\" (UID: \"92c53fbc-bacd-4e20-ae82-c7e885ca8a1e\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"
Jun 14 03:20:52.798719 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.798710    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/92c53fbc-bacd-4e20-ae82-c7e885ca8a1e-manager-config\") pod \"lws-controller-manager-7bfc4d86bf-jtrwj\" (UID: \"92c53fbc-bacd-4e20-ae82-c7e885ca8a1e\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"
Jun 14 03:20:52.798832 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.798764    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/92c53fbc-bacd-4e20-ae82-c7e885ca8a1e-metrics-cert\") pod \"lws-controller-manager-7bfc4d86bf-jtrwj\" (UID: \"92c53fbc-bacd-4e20-ae82-c7e885ca8a1e\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"
Jun 14 03:20:52.899607 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.899565    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/92c53fbc-bacd-4e20-ae82-c7e885ca8a1e-manager-config\") pod \"lws-controller-manager-7bfc4d86bf-jtrwj\" (UID: \"92c53fbc-bacd-4e20-ae82-c7e885ca8a1e\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"
Jun 14 03:20:52.899607 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.899616    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/92c53fbc-bacd-4e20-ae82-c7e885ca8a1e-metrics-cert\") pod \"lws-controller-manager-7bfc4d86bf-jtrwj\" (UID: \"92c53fbc-bacd-4e20-ae82-c7e885ca8a1e\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"
Jun 14 03:20:52.899860 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.899639    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fctmx\" (UniqueName: \"kubernetes.io/projected/92c53fbc-bacd-4e20-ae82-c7e885ca8a1e-kube-api-access-fctmx\") pod \"lws-controller-manager-7bfc4d86bf-jtrwj\" (UID: \"92c53fbc-bacd-4e20-ae82-c7e885ca8a1e\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"
Jun 14 03:20:52.899860 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.899750    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92c53fbc-bacd-4e20-ae82-c7e885ca8a1e-cert\") pod \"lws-controller-manager-7bfc4d86bf-jtrwj\" (UID: \"92c53fbc-bacd-4e20-ae82-c7e885ca8a1e\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"
Jun 14 03:20:52.900344 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.900322    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/92c53fbc-bacd-4e20-ae82-c7e885ca8a1e-manager-config\") pod \"lws-controller-manager-7bfc4d86bf-jtrwj\" (UID: \"92c53fbc-bacd-4e20-ae82-c7e885ca8a1e\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"
Jun 14 03:20:52.902005 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.901984    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92c53fbc-bacd-4e20-ae82-c7e885ca8a1e-cert\") pod \"lws-controller-manager-7bfc4d86bf-jtrwj\" (UID: \"92c53fbc-bacd-4e20-ae82-c7e885ca8a1e\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"
Jun 14 03:20:52.902163 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.902147    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/92c53fbc-bacd-4e20-ae82-c7e885ca8a1e-metrics-cert\") pod \"lws-controller-manager-7bfc4d86bf-jtrwj\" (UID: \"92c53fbc-bacd-4e20-ae82-c7e885ca8a1e\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"
Jun 14 03:20:52.915894 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:52.915867    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fctmx\" (UniqueName: \"kubernetes.io/projected/92c53fbc-bacd-4e20-ae82-c7e885ca8a1e-kube-api-access-fctmx\") pod \"lws-controller-manager-7bfc4d86bf-jtrwj\" (UID: \"92c53fbc-bacd-4e20-ae82-c7e885ca8a1e\") " pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"
Jun 14 03:20:53.082652 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:53.082573    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"
Jun 14 03:20:53.227135 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:53.227108    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"]
Jun 14 03:20:53.229521 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:20:53.229497    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c53fbc_bacd_4e20_ae82_c7e885ca8a1e.slice/crio-0abfa99a562953d422987bd381d98c67d2475c1d19db95dff305020de72e44a0 WatchSource:0}: Error finding container 0abfa99a562953d422987bd381d98c67d2475c1d19db95dff305020de72e44a0: Status 404 returned error can't find the container with id 0abfa99a562953d422987bd381d98c67d2475c1d19db95dff305020de72e44a0
Jun 14 03:20:53.462478 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:53.462438    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj" event={"ID":"92c53fbc-bacd-4e20-ae82-c7e885ca8a1e","Type":"ContainerStarted","Data":"0abfa99a562953d422987bd381d98c67d2475c1d19db95dff305020de72e44a0"}
Jun 14 03:20:54.978303 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:54.978274    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"]
Jun 14 03:20:54.981830 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:54.981813    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:54.984757 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:54.984737    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jbsvm\""
Jun 14 03:20:54.985337 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:54.985320    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 14 03:20:54.985470 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:54.985453    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 14 03:20:54.985698 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:54.985677    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 14 03:20:54.985762 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:54.985686    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 14 03:20:54.996988 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:54.996963    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"]
Jun 14 03:20:55.018442 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.018416    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f2cba15a-7abb-4094-971f-423e3f9b1865-manifests\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q\" (UID: \"f2cba15a-7abb-4094-971f-423e3f9b1865\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:55.018687 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.018668    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2cba15a-7abb-4094-971f-423e3f9b1865-tmp\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q\" (UID: \"f2cba15a-7abb-4094-971f-423e3f9b1865\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:55.018745 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.018699    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f2cba15a-7abb-4094-971f-423e3f9b1865-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q\" (UID: \"f2cba15a-7abb-4094-971f-423e3f9b1865\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:55.018745 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.018720    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2cba15a-7abb-4094-971f-423e3f9b1865-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q\" (UID: \"f2cba15a-7abb-4094-971f-423e3f9b1865\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:55.018842 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.018757    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk942\" (UniqueName: \"kubernetes.io/projected/f2cba15a-7abb-4094-971f-423e3f9b1865-kube-api-access-qk942\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q\" (UID: \"f2cba15a-7abb-4094-971f-423e3f9b1865\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:55.119899 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.119863    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2cba15a-7abb-4094-971f-423e3f9b1865-tmp\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q\" (UID: \"f2cba15a-7abb-4094-971f-423e3f9b1865\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:55.119899 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.119899    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f2cba15a-7abb-4094-971f-423e3f9b1865-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q\" (UID: \"f2cba15a-7abb-4094-971f-423e3f9b1865\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:55.120149 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.119920    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2cba15a-7abb-4094-971f-423e3f9b1865-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q\" (UID: \"f2cba15a-7abb-4094-971f-423e3f9b1865\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:55.120149 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.119937    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk942\" (UniqueName: \"kubernetes.io/projected/f2cba15a-7abb-4094-971f-423e3f9b1865-kube-api-access-qk942\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q\" (UID: \"f2cba15a-7abb-4094-971f-423e3f9b1865\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:55.120149 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.119962    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f2cba15a-7abb-4094-971f-423e3f9b1865-manifests\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q\" (UID: \"f2cba15a-7abb-4094-971f-423e3f9b1865\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:55.120395 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.120367    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f2cba15a-7abb-4094-971f-423e3f9b1865-manifests\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q\" (UID: \"f2cba15a-7abb-4094-971f-423e3f9b1865\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:55.122352 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.122329    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2cba15a-7abb-4094-971f-423e3f9b1865-tmp\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q\" (UID: \"f2cba15a-7abb-4094-971f-423e3f9b1865\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:55.122712 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.122690    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2cba15a-7abb-4094-971f-423e3f9b1865-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q\" (UID: \"f2cba15a-7abb-4094-971f-423e3f9b1865\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:55.122784 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.122690    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f2cba15a-7abb-4094-971f-423e3f9b1865-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q\" (UID: \"f2cba15a-7abb-4094-971f-423e3f9b1865\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:55.129306 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.129282    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk942\" (UniqueName: \"kubernetes.io/projected/f2cba15a-7abb-4094-971f-423e3f9b1865-kube-api-access-qk942\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q\" (UID: \"f2cba15a-7abb-4094-971f-423e3f9b1865\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:55.292378 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.292294    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:20:55.424527 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.424492    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"]
Jun 14 03:20:55.427577 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:20:55.427547    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2cba15a_7abb_4094_971f_423e3f9b1865.slice/crio-254f5dbba79d859a999255d189183114000b5ea6ab68e70601a1982fa06c58f8 WatchSource:0}: Error finding container 254f5dbba79d859a999255d189183114000b5ea6ab68e70601a1982fa06c58f8: Status 404 returned error can't find the container with id 254f5dbba79d859a999255d189183114000b5ea6ab68e70601a1982fa06c58f8
Jun 14 03:20:55.471414 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.471383    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj" event={"ID":"92c53fbc-bacd-4e20-ae82-c7e885ca8a1e","Type":"ContainerStarted","Data":"f5cc621084f7c586cd7e96715e1b2a3fa95bbb2d46ff646766aa506f7f2f8959"}
Jun 14 03:20:55.471543 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.471515    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"
Jun 14 03:20:55.472775 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.472754    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q" event={"ID":"f2cba15a-7abb-4094-971f-423e3f9b1865","Type":"ContainerStarted","Data":"254f5dbba79d859a999255d189183114000b5ea6ab68e70601a1982fa06c58f8"}
Jun 14 03:20:55.489987 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:55.489919    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj" podStartSLOduration=1.829279275 podStartE2EDuration="3.489904399s" totalImagesPullingTime="1.660625124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:20:55.489275062 +0000 UTC m=+498.266719888" watchObservedRunningTime="2026-06-14 03:20:55.489904399 +0000 UTC m=+498.267349222"
Jun 14 03:20:59.493260 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:20:59.493218    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q" event={"ID":"f2cba15a-7abb-4094-971f-423e3f9b1865","Type":"ContainerStarted","Data":"6bef30365454e7d17271cc053f04e54b8cf06f4bfbef574c5c917d7b639920b5"}
Jun 14 03:21:00.499391 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:00.499355    2516 generic.go:356] "Generic (PLEG): container finished" podID="f2cba15a-7abb-4094-971f-423e3f9b1865" containerID="6bef30365454e7d17271cc053f04e54b8cf06f4bfbef574c5c917d7b639920b5" exitCode=0
Jun 14 03:21:00.499800 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:00.499436    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q" event={"ID":"f2cba15a-7abb-4094-971f-423e3f9b1865","Type":"ContainerDied","Data":"6bef30365454e7d17271cc053f04e54b8cf06f4bfbef574c5c917d7b639920b5"}
Jun 14 03:21:01.505595 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:01.505557    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q" event={"ID":"f2cba15a-7abb-4094-971f-423e3f9b1865","Type":"ContainerStarted","Data":"0da213d701696dd42e629bcd10b71f834d6a2dc00a389d157b65462d3618f367"}
Jun 14 03:21:01.506011 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:01.505705    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:21:01.529553 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:01.529504    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q" podStartSLOduration=3.170764031 podStartE2EDuration="7.529488305s" totalImagesPullingTime="3.367176941s" totalInitContainerRuntime="991.547333ms" isStatefulPod=false podCreationTimestamp="2026-06-14 03:20:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:21:01.527274491 +0000 UTC m=+504.304719315" watchObservedRunningTime="2026-06-14 03:21:01.529488305 +0000 UTC m=+504.306933128"
Jun 14 03:21:06.481185 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:06.481154    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7bfc4d86bf-jtrwj"
Jun 14 03:21:12.512010 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:12.511981    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q"
Jun 14 03:21:14.761021 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:14.760985    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms"]
Jun 14 03:21:14.769181 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:14.769155    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms"
Jun 14 03:21:14.772191 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:14.772161    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 14 03:21:14.772314 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:14.772203    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 14 03:21:14.773068 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:14.773051    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jxgfs\""
Jun 14 03:21:14.780771 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:14.780749    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms"]
Jun 14 03:21:14.887595 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:14.887559    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49621422-51d7-4728-9559-756a2679406a-tmp\") pod \"kube-auth-proxy-5b6fc8f5d7-2n6ms\" (UID: \"49621422-51d7-4728-9559-756a2679406a\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms"
Jun 14 03:21:14.887743 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:14.887627    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9kwv\" (UniqueName: \"kubernetes.io/projected/49621422-51d7-4728-9559-756a2679406a-kube-api-access-c9kwv\") pod \"kube-auth-proxy-5b6fc8f5d7-2n6ms\" (UID: \"49621422-51d7-4728-9559-756a2679406a\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms"
Jun 14 03:21:14.887743 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:14.887670    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49621422-51d7-4728-9559-756a2679406a-tls-certs\") pod \"kube-auth-proxy-5b6fc8f5d7-2n6ms\" (UID: \"49621422-51d7-4728-9559-756a2679406a\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms"
Jun 14 03:21:14.988419 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:14.988382    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49621422-51d7-4728-9559-756a2679406a-tmp\") pod \"kube-auth-proxy-5b6fc8f5d7-2n6ms\" (UID: \"49621422-51d7-4728-9559-756a2679406a\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms"
Jun 14 03:21:14.988592 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:14.988442    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9kwv\" (UniqueName: \"kubernetes.io/projected/49621422-51d7-4728-9559-756a2679406a-kube-api-access-c9kwv\") pod \"kube-auth-proxy-5b6fc8f5d7-2n6ms\" (UID: \"49621422-51d7-4728-9559-756a2679406a\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms"
Jun 14 03:21:14.988592 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:14.988465    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49621422-51d7-4728-9559-756a2679406a-tls-certs\") pod \"kube-auth-proxy-5b6fc8f5d7-2n6ms\" (UID: \"49621422-51d7-4728-9559-756a2679406a\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms"
Jun 14 03:21:14.990695 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:14.990666    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49621422-51d7-4728-9559-756a2679406a-tmp\") pod \"kube-auth-proxy-5b6fc8f5d7-2n6ms\" (UID: \"49621422-51d7-4728-9559-756a2679406a\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms"
Jun 14 03:21:14.990838 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:14.990823    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49621422-51d7-4728-9559-756a2679406a-tls-certs\") pod \"kube-auth-proxy-5b6fc8f5d7-2n6ms\" (UID: \"49621422-51d7-4728-9559-756a2679406a\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms"
Jun 14 03:21:14.997821 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:14.997795    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9kwv\" (UniqueName: \"kubernetes.io/projected/49621422-51d7-4728-9559-756a2679406a-kube-api-access-c9kwv\") pod \"kube-auth-proxy-5b6fc8f5d7-2n6ms\" (UID: \"49621422-51d7-4728-9559-756a2679406a\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms"
Jun 14 03:21:15.079028 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:15.078944    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms"
Jun 14 03:21:15.218587 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:15.218560    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms"]
Jun 14 03:21:15.220880 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:21:15.220849    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49621422_51d7_4728_9559_756a2679406a.slice/crio-90704abbbbc4a4a7d0f50a6f2902177355dfc605736a401ac56bc63ee030abce WatchSource:0}: Error finding container 90704abbbbc4a4a7d0f50a6f2902177355dfc605736a401ac56bc63ee030abce: Status 404 returned error can't find the container with id 90704abbbbc4a4a7d0f50a6f2902177355dfc605736a401ac56bc63ee030abce
Jun 14 03:21:15.568116 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:15.568067    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms" event={"ID":"49621422-51d7-4728-9559-756a2679406a","Type":"ContainerStarted","Data":"90704abbbbc4a4a7d0f50a6f2902177355dfc605736a401ac56bc63ee030abce"}
Jun 14 03:21:18.583805 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:18.583773    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms" event={"ID":"49621422-51d7-4728-9559-756a2679406a","Type":"ContainerStarted","Data":"3992b418275baff9f66828fd5527068c849c4e9d912229f0f939e9925603c73e"}
Jun 14 03:21:18.600282 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:21:18.600238    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-2n6ms" podStartSLOduration=1.37411604 podStartE2EDuration="4.600223193s" totalImagesPullingTime="3.226107153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:21:18.59899353 +0000 UTC m=+521.376438356" watchObservedRunningTime="2026-06-14 03:21:18.600223193 +0000 UTC m=+521.377668056"
Jun 14 03:22:37.649701 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:22:37.649671    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:22:37.652011 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:22:37.651985    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:22:37.657221 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:22:37.657196    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:22:37.659841 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:22:37.659823    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:23:01.012308 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.012273    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m"]
Jun 14 03:23:01.014448 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.014427    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m"
Jun 14 03:23:01.016833 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.016813    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 14 03:23:01.017838 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.017821    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5gm2z\""
Jun 14 03:23:01.017974 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.017857    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 14 03:23:01.017974 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.017912    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jun 14 03:23:01.017974 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.017919    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jun 14 03:23:01.023109 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.023064    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m"]
Jun 14 03:23:01.099274 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.099240    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b27d9eb5-a364-41d1-b758-9ca9524fe54f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-96l7m\" (UID: \"b27d9eb5-a364-41d1-b758-9ca9524fe54f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m"
Jun 14 03:23:01.099458 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.099283    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b27d9eb5-a364-41d1-b758-9ca9524fe54f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-96l7m\" (UID: \"b27d9eb5-a364-41d1-b758-9ca9524fe54f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m"
Jun 14 03:23:01.099458 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.099302    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69g88\" (UniqueName: \"kubernetes.io/projected/b27d9eb5-a364-41d1-b758-9ca9524fe54f-kube-api-access-69g88\") pod \"kuadrant-console-plugin-66b5774985-96l7m\" (UID: \"b27d9eb5-a364-41d1-b758-9ca9524fe54f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m"
Jun 14 03:23:01.200100 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.200042    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b27d9eb5-a364-41d1-b758-9ca9524fe54f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-96l7m\" (UID: \"b27d9eb5-a364-41d1-b758-9ca9524fe54f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m"
Jun 14 03:23:01.200100 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.200097    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69g88\" (UniqueName: \"kubernetes.io/projected/b27d9eb5-a364-41d1-b758-9ca9524fe54f-kube-api-access-69g88\") pod \"kuadrant-console-plugin-66b5774985-96l7m\" (UID: \"b27d9eb5-a364-41d1-b758-9ca9524fe54f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m"
Jun 14 03:23:01.200350 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.200215    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b27d9eb5-a364-41d1-b758-9ca9524fe54f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-96l7m\" (UID: \"b27d9eb5-a364-41d1-b758-9ca9524fe54f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m"
Jun 14 03:23:01.200350 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:23:01.200323    2516 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jun 14 03:23:01.200467 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:23:01.200397    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b27d9eb5-a364-41d1-b758-9ca9524fe54f-plugin-serving-cert podName:b27d9eb5-a364-41d1-b758-9ca9524fe54f nodeName:}" failed. No retries permitted until 2026-06-14 03:23:01.700376838 +0000 UTC m=+624.477821657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/b27d9eb5-a364-41d1-b758-9ca9524fe54f-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-96l7m" (UID: "b27d9eb5-a364-41d1-b758-9ca9524fe54f") : secret "plugin-serving-cert" not found
Jun 14 03:23:01.200642 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.200620    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b27d9eb5-a364-41d1-b758-9ca9524fe54f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-96l7m\" (UID: \"b27d9eb5-a364-41d1-b758-9ca9524fe54f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m"
Jun 14 03:23:01.209977 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.209952    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69g88\" (UniqueName: \"kubernetes.io/projected/b27d9eb5-a364-41d1-b758-9ca9524fe54f-kube-api-access-69g88\") pod \"kuadrant-console-plugin-66b5774985-96l7m\" (UID: \"b27d9eb5-a364-41d1-b758-9ca9524fe54f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m"
Jun 14 03:23:01.704354 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.704299    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b27d9eb5-a364-41d1-b758-9ca9524fe54f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-96l7m\" (UID: \"b27d9eb5-a364-41d1-b758-9ca9524fe54f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m"
Jun 14 03:23:01.712187 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.712153    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b27d9eb5-a364-41d1-b758-9ca9524fe54f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-96l7m\" (UID: \"b27d9eb5-a364-41d1-b758-9ca9524fe54f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m"
Jun 14 03:23:01.924171 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:01.924138    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m"
Jun 14 03:23:02.054543 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:02.054513    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m"]
Jun 14 03:23:02.057003 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:23:02.056975    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb27d9eb5_a364_41d1_b758_9ca9524fe54f.slice/crio-c0d526a9ae89faa65bb2f906a52608cd4fcc7ca28d52b0a710a388e030aeed4b WatchSource:0}: Error finding container c0d526a9ae89faa65bb2f906a52608cd4fcc7ca28d52b0a710a388e030aeed4b: Status 404 returned error can't find the container with id c0d526a9ae89faa65bb2f906a52608cd4fcc7ca28d52b0a710a388e030aeed4b
Jun 14 03:23:02.058309 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:02.058290    2516 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 14 03:23:03.044928 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:03.044891    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m" event={"ID":"b27d9eb5-a364-41d1-b758-9ca9524fe54f","Type":"ContainerStarted","Data":"c0d526a9ae89faa65bb2f906a52608cd4fcc7ca28d52b0a710a388e030aeed4b"}
Jun 14 03:23:10.508583 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:10.508541    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"]
Jun 14 03:23:10.516174 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:10.516144    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"
Jun 14 03:23:10.519263 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:10.519232    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6nm8r\""
Jun 14 03:23:10.524462 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:10.524435    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"]
Jun 14 03:23:10.616403 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:10.616359    2516 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"]
Jun 14 03:23:10.616709 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:23:10.616680    2516 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-x2jb8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t" podUID="832c53f7-ce3a-4099-845a-3576c7078ba7"
Jun 14 03:23:10.681891 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:10.681860    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/832c53f7-ce3a-4099-845a-3576c7078ba7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6gk7t\" (UID: \"832c53f7-ce3a-4099-845a-3576c7078ba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"
Jun 14 03:23:10.682062 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:10.681897    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2jb8\" (UniqueName: \"kubernetes.io/projected/832c53f7-ce3a-4099-845a-3576c7078ba7-kube-api-access-x2jb8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6gk7t\" (UID: \"832c53f7-ce3a-4099-845a-3576c7078ba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"
Jun 14 03:23:10.783322 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:10.783228    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/832c53f7-ce3a-4099-845a-3576c7078ba7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6gk7t\" (UID: \"832c53f7-ce3a-4099-845a-3576c7078ba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"
Jun 14 03:23:10.783322 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:10.783287    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2jb8\" (UniqueName: \"kubernetes.io/projected/832c53f7-ce3a-4099-845a-3576c7078ba7-kube-api-access-x2jb8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6gk7t\" (UID: \"832c53f7-ce3a-4099-845a-3576c7078ba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"
Jun 14 03:23:10.783687 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:10.783654    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/832c53f7-ce3a-4099-845a-3576c7078ba7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6gk7t\" (UID: \"832c53f7-ce3a-4099-845a-3576c7078ba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"
Jun 14 03:23:10.793023 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:10.792995    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2jb8\" (UniqueName: \"kubernetes.io/projected/832c53f7-ce3a-4099-845a-3576c7078ba7-kube-api-access-x2jb8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6gk7t\" (UID: \"832c53f7-ce3a-4099-845a-3576c7078ba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"
Jun 14 03:23:11.090010 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.089931    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"
Jun 14 03:23:11.091061 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.091032    2516 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"]
Jun 14 03:23:11.100394 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.100364    2516 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"]
Jun 14 03:23:11.100951 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.100928    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"
Jun 14 03:23:11.114130 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:23:11.114066    2516 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"832c53f7-ce3a-4099-845a-3576c7078ba7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-6fb7879bc9-6gk7t\": pods \"kuadrant-operator-controller-manager-6fb7879bc9-6gk7t\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"
Jun 14 03:23:11.116319 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:23:11.116275    2516 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6gk7t\" is forbidden: User \"system:node:ip-10-0-141-194.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-194.ec2.internal' and this object" podUID="832c53f7-ce3a-4099-845a-3576c7078ba7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"
Jun 14 03:23:11.213690 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.213656    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9fv5"]
Jun 14 03:23:11.218687 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.218662    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9fv5"
Jun 14 03:23:11.224579 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.224383    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qmxg8\""
Jun 14 03:23:11.259499 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.259468    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9fv5"]
Jun 14 03:23:11.289013 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.288985    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2jb8\" (UniqueName: \"kubernetes.io/projected/832c53f7-ce3a-4099-845a-3576c7078ba7-kube-api-access-x2jb8\") pod \"832c53f7-ce3a-4099-845a-3576c7078ba7\" (UID: \"832c53f7-ce3a-4099-845a-3576c7078ba7\") "
Jun 14 03:23:11.289188 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.289036    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/832c53f7-ce3a-4099-845a-3576c7078ba7-extensions-socket-volume\") pod \"832c53f7-ce3a-4099-845a-3576c7078ba7\" (UID: \"832c53f7-ce3a-4099-845a-3576c7078ba7\") "
Jun 14 03:23:11.289349 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.289316    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/832c53f7-ce3a-4099-845a-3576c7078ba7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "832c53f7-ce3a-4099-845a-3576c7078ba7" (UID: "832c53f7-ce3a-4099-845a-3576c7078ba7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 14 03:23:11.291240 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.291212    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/832c53f7-ce3a-4099-845a-3576c7078ba7-kube-api-access-x2jb8" (OuterVolumeSpecName: "kube-api-access-x2jb8") pod "832c53f7-ce3a-4099-845a-3576c7078ba7" (UID: "832c53f7-ce3a-4099-845a-3576c7078ba7"). InnerVolumeSpecName "kube-api-access-x2jb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 14 03:23:11.318492 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:23:11.318456    2516 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6gk7t\" is forbidden: User \"system:node:ip-10-0-141-194.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-194.ec2.internal' and this object" podUID="832c53f7-ce3a-4099-845a-3576c7078ba7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"
Jun 14 03:23:11.390606 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.390562    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9nfk\" (UniqueName: \"kubernetes.io/projected/49044c9b-2ba1-4feb-a7e0-d88b7d83da3a-kube-api-access-q9nfk\") pod \"limitador-operator-controller-manager-859d7b78bd-n9fv5\" (UID: \"49044c9b-2ba1-4feb-a7e0-d88b7d83da3a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9fv5"
Jun 14 03:23:11.390791 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.390773    2516 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2jb8\" (UniqueName: \"kubernetes.io/projected/832c53f7-ce3a-4099-845a-3576c7078ba7-kube-api-access-x2jb8\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:23:11.390855 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.390800    2516 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/832c53f7-ce3a-4099-845a-3576c7078ba7-extensions-socket-volume\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:23:11.491596 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.491559    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9nfk\" (UniqueName: \"kubernetes.io/projected/49044c9b-2ba1-4feb-a7e0-d88b7d83da3a-kube-api-access-q9nfk\") pod \"limitador-operator-controller-manager-859d7b78bd-n9fv5\" (UID: \"49044c9b-2ba1-4feb-a7e0-d88b7d83da3a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9fv5"
Jun 14 03:23:11.508226 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.508194    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9nfk\" (UniqueName: \"kubernetes.io/projected/49044c9b-2ba1-4feb-a7e0-d88b7d83da3a-kube-api-access-q9nfk\") pod \"limitador-operator-controller-manager-859d7b78bd-n9fv5\" (UID: \"49044c9b-2ba1-4feb-a7e0-d88b7d83da3a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9fv5"
Jun 14 03:23:11.532613 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.532580    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9fv5"
Jun 14 03:23:11.661271 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:11.661198    2516 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="832c53f7-ce3a-4099-845a-3576c7078ba7" path="/var/lib/kubelet/pods/832c53f7-ce3a-4099-845a-3576c7078ba7/volumes"
Jun 14 03:23:12.094806 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:12.094730    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"
Jun 14 03:23:12.100115 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:23:12.100067    2516 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6gk7t\" is forbidden: User \"system:node:ip-10-0-141-194.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-194.ec2.internal' and this object" podUID="832c53f7-ce3a-4099-845a-3576c7078ba7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gk7t"
Jun 14 03:23:24.442651 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:24.442622    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9fv5"]
Jun 14 03:23:24.445565 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:23:24.445540    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49044c9b_2ba1_4feb_a7e0_d88b7d83da3a.slice/crio-96bd12a8676bf260b557a4869f411ad6b45b0a90beb01aef17e1aa9b6e223902 WatchSource:0}: Error finding container 96bd12a8676bf260b557a4869f411ad6b45b0a90beb01aef17e1aa9b6e223902: Status 404 returned error can't find the container with id 96bd12a8676bf260b557a4869f411ad6b45b0a90beb01aef17e1aa9b6e223902
Jun 14 03:23:25.165453 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:25.165423    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9fv5" event={"ID":"49044c9b-2ba1-4feb-a7e0-d88b7d83da3a","Type":"ContainerStarted","Data":"96bd12a8676bf260b557a4869f411ad6b45b0a90beb01aef17e1aa9b6e223902"}
Jun 14 03:23:25.166966 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:25.166932    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m" event={"ID":"b27d9eb5-a364-41d1-b758-9ca9524fe54f","Type":"ContainerStarted","Data":"da77120048d86a4cca697920fd85e0899977dd7a27658cbb8d8a8af7df7eb4ae"}
Jun 14 03:23:25.182329 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:25.182282    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-96l7m" podStartSLOduration=2.835775325 podStartE2EDuration="25.182266147s" totalImagesPullingTime="22.346490822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:23:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:23:25.181570625 +0000 UTC m=+647.959015444" watchObservedRunningTime="2026-06-14 03:23:25.182266147 +0000 UTC m=+647.959710996"
Jun 14 03:23:27.177383 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:27.177340    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9fv5" event={"ID":"49044c9b-2ba1-4feb-a7e0-d88b7d83da3a","Type":"ContainerStarted","Data":"7e5b235993a4523d720e231d9df3800cbdc5256444783b9741c6ae8d1c53a314"}
Jun 14 03:23:27.177761 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:27.177480    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9fv5"
Jun 14 03:23:27.195340 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:27.195299    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9fv5" podStartSLOduration=14.318451079 podStartE2EDuration="16.195286086s" totalImagesPullingTime="1.876835007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:23:27.194654231 +0000 UTC m=+649.972099055" watchObservedRunningTime="2026-06-14 03:23:27.195286086 +0000 UTC m=+649.972730911"
Jun 14 03:23:38.184358 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:23:38.184326    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9fv5"
Jun 14 03:24:45.731802 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:45.731765    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 14 03:24:45.734177 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:45.734159    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 14 03:24:45.736545 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:45.736522    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-p6rbl\""
Jun 14 03:24:45.736545 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:45.736525    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 14 03:24:45.736723 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:45.736547    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 14 03:24:45.737652 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:45.737599    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 14 03:24:45.743529 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:45.743508    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 14 03:24:45.812971 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:45.812940    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lgrq\" (UniqueName: \"kubernetes.io/projected/32d9d73d-dafc-479b-841b-ca04e990dff7-kube-api-access-8lgrq\") pod \"maas-keycloak-0\" (UID: \"32d9d73d-dafc-479b-841b-ca04e990dff7\") " pod="keycloak-system/maas-keycloak-0"
Jun 14 03:24:45.914015 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:45.913977    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lgrq\" (UniqueName: \"kubernetes.io/projected/32d9d73d-dafc-479b-841b-ca04e990dff7-kube-api-access-8lgrq\") pod \"maas-keycloak-0\" (UID: \"32d9d73d-dafc-479b-841b-ca04e990dff7\") " pod="keycloak-system/maas-keycloak-0"
Jun 14 03:24:45.921821 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:45.921795    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lgrq\" (UniqueName: \"kubernetes.io/projected/32d9d73d-dafc-479b-841b-ca04e990dff7-kube-api-access-8lgrq\") pod \"maas-keycloak-0\" (UID: \"32d9d73d-dafc-479b-841b-ca04e990dff7\") " pod="keycloak-system/maas-keycloak-0"
Jun 14 03:24:46.044444 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:46.044347    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 14 03:24:46.171555 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:46.171531    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 14 03:24:46.174327 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:24:46.174301    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d9d73d_dafc_479b_841b_ca04e990dff7.slice/crio-f51e729ede17c5f48ff52f2f67c4a13246f413089afdbbca2d389fe16fef4250 WatchSource:0}: Error finding container f51e729ede17c5f48ff52f2f67c4a13246f413089afdbbca2d389fe16fef4250: Status 404 returned error can't find the container with id f51e729ede17c5f48ff52f2f67c4a13246f413089afdbbca2d389fe16fef4250
Jun 14 03:24:46.547449 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:46.547412    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"32d9d73d-dafc-479b-841b-ca04e990dff7","Type":"ContainerStarted","Data":"f51e729ede17c5f48ff52f2f67c4a13246f413089afdbbca2d389fe16fef4250"}
Jun 14 03:24:51.576985 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:51.576947    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"32d9d73d-dafc-479b-841b-ca04e990dff7","Type":"ContainerStarted","Data":"fe00353925decf85e4fc2e47ecc7dbf32cf404c24ee3561c5927944860448110"}
Jun 14 03:24:51.612886 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:51.612830    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.315431571 podStartE2EDuration="6.612813081s" totalImagesPullingTime="5.29738151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:24:51.61235327 +0000 UTC m=+734.389798094" watchObservedRunningTime="2026-06-14 03:24:51.612813081 +0000 UTC m=+734.390257963"
Jun 14 03:24:52.045387 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:52.045345    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 14 03:24:52.046806 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:52.046769    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused"
Jun 14 03:24:53.044791 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:53.044741    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused"
Jun 14 03:24:54.045351 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:54.045308    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused"
Jun 14 03:24:55.045585 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:55.045527    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused"
Jun 14 03:24:56.045137 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:56.045091    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 14 03:24:56.045463 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:56.045435    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused"
Jun 14 03:24:57.045008 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:57.044960    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused"
Jun 14 03:24:58.045911 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:58.045858    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused"
Jun 14 03:24:59.045180 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:24:59.045124    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused"
Jun 14 03:25:00.045722 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:00.045676    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused"
Jun 14 03:25:01.045723 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:01.045666    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused"
Jun 14 03:25:02.045035 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:02.044984    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused"
Jun 14 03:25:03.045443 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:03.045387    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused"
Jun 14 03:25:04.045131 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:04.045060    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused"
Jun 14 03:25:05.158319 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:05.158274    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 14 03:25:05.175378 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:05.175072    2516 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 14 03:25:15.164587 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:15.164550    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 14 03:25:55.909141 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:55.909109    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-84c4497745-vdvcq"]
Jun 14 03:25:55.911484 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:55.911468    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-84c4497745-vdvcq"
Jun 14 03:25:55.913792 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:55.913774    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jun 14 03:25:55.913792 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:55.913788    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2mrj7\""
Jun 14 03:25:55.922192 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:55.922174    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-84c4497745-vdvcq"]
Jun 14 03:25:56.046839 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.046804    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48d8dc9c-359b-4679-ac6e-71ff0e38c779-openshift-service-ca\") pod \"maas-api-84c4497745-vdvcq\" (UID: \"48d8dc9c-359b-4679-ac6e-71ff0e38c779\") " pod="opendatahub/maas-api-84c4497745-vdvcq"
Jun 14 03:25:56.047017 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.046847    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ntk4\" (UniqueName: \"kubernetes.io/projected/48d8dc9c-359b-4679-ac6e-71ff0e38c779-kube-api-access-5ntk4\") pod \"maas-api-84c4497745-vdvcq\" (UID: \"48d8dc9c-359b-4679-ac6e-71ff0e38c779\") " pod="opendatahub/maas-api-84c4497745-vdvcq"
Jun 14 03:25:56.047017 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.046867    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48d8dc9c-359b-4679-ac6e-71ff0e38c779-maas-api-tls\") pod \"maas-api-84c4497745-vdvcq\" (UID: \"48d8dc9c-359b-4679-ac6e-71ff0e38c779\") " pod="opendatahub/maas-api-84c4497745-vdvcq"
Jun 14 03:25:56.147904 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.147874    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48d8dc9c-359b-4679-ac6e-71ff0e38c779-openshift-service-ca\") pod \"maas-api-84c4497745-vdvcq\" (UID: \"48d8dc9c-359b-4679-ac6e-71ff0e38c779\") " pod="opendatahub/maas-api-84c4497745-vdvcq"
Jun 14 03:25:56.148053 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.147914    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ntk4\" (UniqueName: \"kubernetes.io/projected/48d8dc9c-359b-4679-ac6e-71ff0e38c779-kube-api-access-5ntk4\") pod \"maas-api-84c4497745-vdvcq\" (UID: \"48d8dc9c-359b-4679-ac6e-71ff0e38c779\") " pod="opendatahub/maas-api-84c4497745-vdvcq"
Jun 14 03:25:56.148053 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.147934    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48d8dc9c-359b-4679-ac6e-71ff0e38c779-maas-api-tls\") pod \"maas-api-84c4497745-vdvcq\" (UID: \"48d8dc9c-359b-4679-ac6e-71ff0e38c779\") " pod="opendatahub/maas-api-84c4497745-vdvcq"
Jun 14 03:25:56.148053 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:25:56.148036    2516 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jun 14 03:25:56.148205 ip-10-0-141-194 kubenswrapper[2516]: E0614 03:25:56.148131    2516 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48d8dc9c-359b-4679-ac6e-71ff0e38c779-maas-api-tls podName:48d8dc9c-359b-4679-ac6e-71ff0e38c779 nodeName:}" failed. No retries permitted until 2026-06-14 03:25:56.648112733 +0000 UTC m=+799.425557536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/48d8dc9c-359b-4679-ac6e-71ff0e38c779-maas-api-tls") pod "maas-api-84c4497745-vdvcq" (UID: "48d8dc9c-359b-4679-ac6e-71ff0e38c779") : secret "maas-api-serving-cert" not found
Jun 14 03:25:56.148503 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.148484    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48d8dc9c-359b-4679-ac6e-71ff0e38c779-openshift-service-ca\") pod \"maas-api-84c4497745-vdvcq\" (UID: \"48d8dc9c-359b-4679-ac6e-71ff0e38c779\") " pod="opendatahub/maas-api-84c4497745-vdvcq"
Jun 14 03:25:56.156437 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.156416    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ntk4\" (UniqueName: \"kubernetes.io/projected/48d8dc9c-359b-4679-ac6e-71ff0e38c779-kube-api-access-5ntk4\") pod \"maas-api-84c4497745-vdvcq\" (UID: \"48d8dc9c-359b-4679-ac6e-71ff0e38c779\") " pod="opendatahub/maas-api-84c4497745-vdvcq"
Jun 14 03:25:56.351830 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.351727    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-wtcg9"]
Jun 14 03:25:56.354202 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.354186    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-wtcg9"
Jun 14 03:25:56.356499 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.356482    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jun 14 03:25:56.364449 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.364425    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-wtcg9"]
Jun 14 03:25:56.451483 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.451456    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbzf9\" (UniqueName: \"kubernetes.io/projected/dd78c942-fd44-4f26-b5d9-316195f4bc2a-kube-api-access-mbzf9\") pod \"payload-pre-processing-579785bc64-wtcg9\" (UID: \"dd78c942-fd44-4f26-b5d9-316195f4bc2a\") " pod="openshift-ingress/payload-pre-processing-579785bc64-wtcg9"
Jun 14 03:25:56.552446 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.552411    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbzf9\" (UniqueName: \"kubernetes.io/projected/dd78c942-fd44-4f26-b5d9-316195f4bc2a-kube-api-access-mbzf9\") pod \"payload-pre-processing-579785bc64-wtcg9\" (UID: \"dd78c942-fd44-4f26-b5d9-316195f4bc2a\") " pod="openshift-ingress/payload-pre-processing-579785bc64-wtcg9"
Jun 14 03:25:56.560290 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.560257    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbzf9\" (UniqueName: \"kubernetes.io/projected/dd78c942-fd44-4f26-b5d9-316195f4bc2a-kube-api-access-mbzf9\") pod \"payload-pre-processing-579785bc64-wtcg9\" (UID: \"dd78c942-fd44-4f26-b5d9-316195f4bc2a\") " pod="openshift-ingress/payload-pre-processing-579785bc64-wtcg9"
Jun 14 03:25:56.653125 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.653062    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48d8dc9c-359b-4679-ac6e-71ff0e38c779-maas-api-tls\") pod \"maas-api-84c4497745-vdvcq\" (UID: \"48d8dc9c-359b-4679-ac6e-71ff0e38c779\") " pod="opendatahub/maas-api-84c4497745-vdvcq"
Jun 14 03:25:56.655496 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.655475    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48d8dc9c-359b-4679-ac6e-71ff0e38c779-maas-api-tls\") pod \"maas-api-84c4497745-vdvcq\" (UID: \"48d8dc9c-359b-4679-ac6e-71ff0e38c779\") " pod="opendatahub/maas-api-84c4497745-vdvcq"
Jun 14 03:25:56.665332 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.665307    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-wtcg9"
Jun 14 03:25:56.792259 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.792235    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-wtcg9"]
Jun 14 03:25:56.794314 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:25:56.794290    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd78c942_fd44_4f26_b5d9_316195f4bc2a.slice/crio-c4d83c60d2f0ba4e39fce5bb479ade9aa0f9050943e32905937c653d9e8953da WatchSource:0}: Error finding container c4d83c60d2f0ba4e39fce5bb479ade9aa0f9050943e32905937c653d9e8953da: Status 404 returned error can't find the container with id c4d83c60d2f0ba4e39fce5bb479ade9aa0f9050943e32905937c653d9e8953da
Jun 14 03:25:56.822385 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.822352    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-84c4497745-vdvcq"
Jun 14 03:25:56.903367 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.903285    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-wtcg9" event={"ID":"dd78c942-fd44-4f26-b5d9-316195f4bc2a","Type":"ContainerStarted","Data":"c4d83c60d2f0ba4e39fce5bb479ade9aa0f9050943e32905937c653d9e8953da"}
Jun 14 03:25:56.956786 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:56.956742    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-84c4497745-vdvcq"]
Jun 14 03:25:56.959900 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:25:56.959868    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d8dc9c_359b_4679_ac6e_71ff0e38c779.slice/crio-e922141cff2cd3ffe711773aa939f52d0008d35d0d7e5a68f15ce7c55900f782 WatchSource:0}: Error finding container e922141cff2cd3ffe711773aa939f52d0008d35d0d7e5a68f15ce7c55900f782: Status 404 returned error can't find the container with id e922141cff2cd3ffe711773aa939f52d0008d35d0d7e5a68f15ce7c55900f782
Jun 14 03:25:57.912974 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:25:57.912935    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-84c4497745-vdvcq" event={"ID":"48d8dc9c-359b-4679-ac6e-71ff0e38c779","Type":"ContainerStarted","Data":"e922141cff2cd3ffe711773aa939f52d0008d35d0d7e5a68f15ce7c55900f782"}
Jun 14 03:26:00.929312 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:00.929273    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-wtcg9" event={"ID":"dd78c942-fd44-4f26-b5d9-316195f4bc2a","Type":"ContainerStarted","Data":"0a48d9474907f0cdde773ba7250acc63becbb78c6f81f01088ac4aef5d85250a"}
Jun 14 03:26:00.929745 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:00.929342    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-wtcg9"
Jun 14 03:26:00.930875 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:00.930853    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-84c4497745-vdvcq" event={"ID":"48d8dc9c-359b-4679-ac6e-71ff0e38c779","Type":"ContainerStarted","Data":"46d56639844d47a276945312c543b2e381f2ab9e3db818e5e2087680e07ccb15"}
Jun 14 03:26:00.930994 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:00.930960    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-84c4497745-vdvcq"
Jun 14 03:26:00.944513 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:00.944467    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-wtcg9" podStartSLOduration=1.595421221 podStartE2EDuration="4.944454708s" totalImagesPullingTime="3.349033487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:26:00.943672361 +0000 UTC m=+803.721117206" watchObservedRunningTime="2026-06-14 03:26:00.944454708 +0000 UTC m=+803.721899531"
Jun 14 03:26:00.960774 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:00.960732    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-84c4497745-vdvcq" podStartSLOduration=2.7680100530000002 podStartE2EDuration="5.960715405s" totalImagesPullingTime="3.192705352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:26:00.959023454 +0000 UTC m=+803.736468299" watchObservedRunningTime="2026-06-14 03:26:00.960715405 +0000 UTC m=+803.738160228"
Jun 14 03:26:06.946771 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:06.946734    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-84c4497745-vdvcq"
Jun 14 03:26:08.213716 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:08.213683    2516 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 14 03:26:08.214140 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:08.213864    2516 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak" containerID="cri-o://fe00353925decf85e4fc2e47ecc7dbf32cf404c24ee3561c5927944860448110" gracePeriod=30
Jun 14 03:26:09.979032 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:09.978943    2516 generic.go:356] "Generic (PLEG): container finished" podID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerID="fe00353925decf85e4fc2e47ecc7dbf32cf404c24ee3561c5927944860448110" exitCode=143
Jun 14 03:26:09.979032 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:09.979016    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"32d9d73d-dafc-479b-841b-ca04e990dff7","Type":"ContainerDied","Data":"fe00353925decf85e4fc2e47ecc7dbf32cf404c24ee3561c5927944860448110"}
Jun 14 03:26:10.258118 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:10.258094    2516 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 14 03:26:10.378373 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:10.378336    2516 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lgrq\" (UniqueName: \"kubernetes.io/projected/32d9d73d-dafc-479b-841b-ca04e990dff7-kube-api-access-8lgrq\") pod \"32d9d73d-dafc-479b-841b-ca04e990dff7\" (UID: \"32d9d73d-dafc-479b-841b-ca04e990dff7\") "
Jun 14 03:26:10.380500 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:10.380474    2516 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32d9d73d-dafc-479b-841b-ca04e990dff7-kube-api-access-8lgrq" (OuterVolumeSpecName: "kube-api-access-8lgrq") pod "32d9d73d-dafc-479b-841b-ca04e990dff7" (UID: "32d9d73d-dafc-479b-841b-ca04e990dff7"). InnerVolumeSpecName "kube-api-access-8lgrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 14 03:26:10.479376 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:10.479339    2516 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lgrq\" (UniqueName: \"kubernetes.io/projected/32d9d73d-dafc-479b-841b-ca04e990dff7-kube-api-access-8lgrq\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\""
Jun 14 03:26:10.985155 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:10.985126    2516 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 14 03:26:10.985612 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:10.985152    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"32d9d73d-dafc-479b-841b-ca04e990dff7","Type":"ContainerDied","Data":"f51e729ede17c5f48ff52f2f67c4a13246f413089afdbbca2d389fe16fef4250"}
Jun 14 03:26:10.985612 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:10.985220    2516 scope.go:117] "RemoveContainer" containerID="fe00353925decf85e4fc2e47ecc7dbf32cf404c24ee3561c5927944860448110"
Jun 14 03:26:11.005847 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.005820    2516 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 14 03:26:11.008825 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.008802    2516 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 14 03:26:11.028612 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.028591    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 14 03:26:11.028931 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.028919    2516 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak"
Jun 14 03:26:11.028975 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.028933    2516 state_mem.go:107] "Deleted CPUSet assignment" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak"
Jun 14 03:26:11.029017 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.029009    2516 memory_manager.go:368] "RemoveStaleState removing state" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" containerName="keycloak"
Jun 14 03:26:11.033345 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.033329    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 14 03:26:11.035805 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.035781    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 14 03:26:11.035805 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.035793    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-p6rbl\""
Jun 14 03:26:11.035944 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.035819    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 14 03:26:11.035944 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.035803    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 14 03:26:11.035944 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.035794    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\""
Jun 14 03:26:11.042316 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.042294    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 14 03:26:11.185890 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.185860    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e6bdaeb8-b72c-4321-9f1a-6c420964b53a-test-realms\") pod \"maas-keycloak-0\" (UID: \"e6bdaeb8-b72c-4321-9f1a-6c420964b53a\") " pod="keycloak-system/maas-keycloak-0"
Jun 14 03:26:11.186044 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.185905    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxwjh\" (UniqueName: \"kubernetes.io/projected/e6bdaeb8-b72c-4321-9f1a-6c420964b53a-kube-api-access-vxwjh\") pod \"maas-keycloak-0\" (UID: \"e6bdaeb8-b72c-4321-9f1a-6c420964b53a\") " pod="keycloak-system/maas-keycloak-0"
Jun 14 03:26:11.286709 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.286626    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e6bdaeb8-b72c-4321-9f1a-6c420964b53a-test-realms\") pod \"maas-keycloak-0\" (UID: \"e6bdaeb8-b72c-4321-9f1a-6c420964b53a\") " pod="keycloak-system/maas-keycloak-0"
Jun 14 03:26:11.286709 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.286674    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxwjh\" (UniqueName: \"kubernetes.io/projected/e6bdaeb8-b72c-4321-9f1a-6c420964b53a-kube-api-access-vxwjh\") pod \"maas-keycloak-0\" (UID: \"e6bdaeb8-b72c-4321-9f1a-6c420964b53a\") " pod="keycloak-system/maas-keycloak-0"
Jun 14 03:26:11.287341 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.287323    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e6bdaeb8-b72c-4321-9f1a-6c420964b53a-test-realms\") pod \"maas-keycloak-0\" (UID: \"e6bdaeb8-b72c-4321-9f1a-6c420964b53a\") " pod="keycloak-system/maas-keycloak-0"
Jun 14 03:26:11.295253 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.295227    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxwjh\" (UniqueName: \"kubernetes.io/projected/e6bdaeb8-b72c-4321-9f1a-6c420964b53a-kube-api-access-vxwjh\") pod \"maas-keycloak-0\" (UID: \"e6bdaeb8-b72c-4321-9f1a-6c420964b53a\") " pod="keycloak-system/maas-keycloak-0"
Jun 14 03:26:11.343926 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.343899    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 14 03:26:11.478543 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.478504    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 14 03:26:11.479527 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:26:11.479501    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6bdaeb8_b72c_4321_9f1a_6c420964b53a.slice/crio-1cd4d3f2902e4b76e4ecf37ab92992aa95c547dc304556c1497ee1cb551193d3 WatchSource:0}: Error finding container 1cd4d3f2902e4b76e4ecf37ab92992aa95c547dc304556c1497ee1cb551193d3: Status 404 returned error can't find the container with id 1cd4d3f2902e4b76e4ecf37ab92992aa95c547dc304556c1497ee1cb551193d3
Jun 14 03:26:11.658750 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.658722    2516 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32d9d73d-dafc-479b-841b-ca04e990dff7" path="/var/lib/kubelet/pods/32d9d73d-dafc-479b-841b-ca04e990dff7/volumes"
Jun 14 03:26:11.944165 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.944066    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-wtcg9"
Jun 14 03:26:11.994570 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.994531    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e6bdaeb8-b72c-4321-9f1a-6c420964b53a","Type":"ContainerStarted","Data":"7e3f47bc52ac91250cb8d5e35402c197d4b1c7c0f73b08fe033ab83b4c14ba8d"}
Jun 14 03:26:11.995030 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:11.994592    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e6bdaeb8-b72c-4321-9f1a-6c420964b53a","Type":"ContainerStarted","Data":"1cd4d3f2902e4b76e4ecf37ab92992aa95c547dc304556c1497ee1cb551193d3"}
Jun 14 03:26:12.013015 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:12.012952    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.676975059 podStartE2EDuration="1.01293082s" totalImagesPullingTime="335.955761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:26:12.010435779 +0000 UTC m=+814.787880603" watchObservedRunningTime="2026-06-14 03:26:12.01293082 +0000 UTC m=+814.790375644"
Jun 14 03:26:12.345088 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:12.344967    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 14 03:26:12.346766 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:12.346731    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6bdaeb8-b72c-4321-9f1a-6c420964b53a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused"
Jun 14 03:26:13.345070 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:13.345016    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6bdaeb8-b72c-4321-9f1a-6c420964b53a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused"
Jun 14 03:26:14.345093 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:14.345035    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6bdaeb8-b72c-4321-9f1a-6c420964b53a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused"
Jun 14 03:26:15.345218 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:15.345163    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6bdaeb8-b72c-4321-9f1a-6c420964b53a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused"
Jun 14 03:26:16.344518 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:16.344464    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6bdaeb8-b72c-4321-9f1a-6c420964b53a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused"
Jun 14 03:26:17.345433 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:17.345375    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6bdaeb8-b72c-4321-9f1a-6c420964b53a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused"
Jun 14 03:26:18.344758 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:18.344704    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6bdaeb8-b72c-4321-9f1a-6c420964b53a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused"
Jun 14 03:26:19.345401 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:19.345354    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6bdaeb8-b72c-4321-9f1a-6c420964b53a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused"
Jun 14 03:26:20.345182 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:20.345135    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6bdaeb8-b72c-4321-9f1a-6c420964b53a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused"
Jun 14 03:26:21.344427 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:21.344384    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 14 03:26:21.344908 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:21.344734    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6bdaeb8-b72c-4321-9f1a-6c420964b53a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused"
Jun 14 03:26:22.345328 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:22.345277    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6bdaeb8-b72c-4321-9f1a-6c420964b53a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused"
Jun 14 03:26:23.345103 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:23.345019    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6bdaeb8-b72c-4321-9f1a-6c420964b53a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused"
Jun 14 03:26:24.344620 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:24.344576    2516 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6bdaeb8-b72c-4321-9f1a-6c420964b53a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused"
Jun 14 03:26:25.466292 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:25.466240    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 14 03:26:25.483177 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:25.483132    2516 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="e6bdaeb8-b72c-4321-9f1a-6c420964b53a" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 14 03:26:35.472517 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:26:35.472477    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 14 03:27:00.509885 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.509852    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"]
Jun 14 03:27:00.513500 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.513484    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.516170 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.516144    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dbmmh\""
Jun 14 03:27:00.516170 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.516159    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 14 03:27:00.516346 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.516188    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 14 03:27:00.517071 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.517054    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jun 14 03:27:00.527750 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.527726    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"]
Jun 14 03:27:00.626910 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.626829    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe9fe595-487a-47cf-9393-40962f799240-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.626910 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.626871    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe9fe595-487a-47cf-9393-40962f799240-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.627159 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.626950    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe9fe595-487a-47cf-9393-40962f799240-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.627159 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.626994    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe9fe595-487a-47cf-9393-40962f799240-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.627159 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.627045    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe9fe595-487a-47cf-9393-40962f799240-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.627159 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.627145    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf5mt\" (UniqueName: \"kubernetes.io/projected/fe9fe595-487a-47cf-9393-40962f799240-kube-api-access-cf5mt\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.728050 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.728014    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe9fe595-487a-47cf-9393-40962f799240-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.728050 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.728050    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe9fe595-487a-47cf-9393-40962f799240-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.728251 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.728104    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe9fe595-487a-47cf-9393-40962f799240-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.728251 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.728130    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf5mt\" (UniqueName: \"kubernetes.io/projected/fe9fe595-487a-47cf-9393-40962f799240-kube-api-access-cf5mt\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.728251 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.728164    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe9fe595-487a-47cf-9393-40962f799240-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.728251 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.728209    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe9fe595-487a-47cf-9393-40962f799240-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.728558 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.728534    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe9fe595-487a-47cf-9393-40962f799240-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.728637 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.728570    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe9fe595-487a-47cf-9393-40962f799240-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.728637 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.728597    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe9fe595-487a-47cf-9393-40962f799240-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.730524 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.730500    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe9fe595-487a-47cf-9393-40962f799240-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.730647 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.730630    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe9fe595-487a-47cf-9393-40962f799240-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.735863 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.735840    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf5mt\" (UniqueName: \"kubernetes.io/projected/fe9fe595-487a-47cf-9393-40962f799240-kube-api-access-cf5mt\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whr99\" (UID: \"fe9fe595-487a-47cf-9393-40962f799240\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.823960 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.823922    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:00.954370 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:00.954285    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"]
Jun 14 03:27:00.957093 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:27:00.957054    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9fe595_487a_47cf_9393_40962f799240.slice/crio-aabfd9acc3135733f074740aed9444ba8383ab94f13f8743bff5d21c48dece47 WatchSource:0}: Error finding container aabfd9acc3135733f074740aed9444ba8383ab94f13f8743bff5d21c48dece47: Status 404 returned error can't find the container with id aabfd9acc3135733f074740aed9444ba8383ab94f13f8743bff5d21c48dece47
Jun 14 03:27:01.264618 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:01.264531    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99" event={"ID":"fe9fe595-487a-47cf-9393-40962f799240","Type":"ContainerStarted","Data":"aabfd9acc3135733f074740aed9444ba8383ab94f13f8743bff5d21c48dece47"}
Jun 14 03:27:05.287378 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:05.287299    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99" event={"ID":"fe9fe595-487a-47cf-9393-40962f799240","Type":"ContainerStarted","Data":"4236685ede14727401c2b8cf71939ae94d8063e81f39ffe3f831a1b8d0674909"}
Jun 14 03:27:07.297547 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:07.297515    2516 generic.go:356] "Generic (PLEG): container finished" podID="fe9fe595-487a-47cf-9393-40962f799240" containerID="4236685ede14727401c2b8cf71939ae94d8063e81f39ffe3f831a1b8d0674909" exitCode=0
Jun 14 03:27:07.297920 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:07.297586    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99" event={"ID":"fe9fe595-487a-47cf-9393-40962f799240","Type":"ContainerDied","Data":"4236685ede14727401c2b8cf71939ae94d8063e81f39ffe3f831a1b8d0674909"}
Jun 14 03:27:09.311322 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:09.311289    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99" event={"ID":"fe9fe595-487a-47cf-9393-40962f799240","Type":"ContainerStarted","Data":"bc82ffb5b1dff48338e28e16328957d656e805421ea46aa7eb75e688320f45cf"}
Jun 14 03:27:09.330423 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:09.330379    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99" podStartSLOduration=2.856333826 podStartE2EDuration="9.330363136s" totalImagesPullingTime="5.078129813s" totalInitContainerRuntime="1.395899497s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:27:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:27:09.329603661 +0000 UTC m=+872.107048488" watchObservedRunningTime="2026-06-14 03:27:09.330363136 +0000 UTC m=+872.107807959"
Jun 14 03:27:10.824712 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:10.824679    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:10.825122 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:10.824762    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:10.837048 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:10.837028    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:11.331883 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:11.331852    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whr99"
Jun 14 03:27:20.305984 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.305951    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"]
Jun 14 03:27:20.321585 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.321559    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"]
Jun 14 03:27:20.321717 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.321651    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.324389 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.324365    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jun 14 03:27:20.394323 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.394290    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6612295e-5207-4c89-8c9c-1b9e661e3810-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.394429 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.394331    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6612295e-5207-4c89-8c9c-1b9e661e3810-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.394429 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.394354    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg94n\" (UniqueName: \"kubernetes.io/projected/6612295e-5207-4c89-8c9c-1b9e661e3810-kube-api-access-tg94n\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.394519 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.394461    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6612295e-5207-4c89-8c9c-1b9e661e3810-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.394519 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.394498    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6612295e-5207-4c89-8c9c-1b9e661e3810-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.394623 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.394603    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6612295e-5207-4c89-8c9c-1b9e661e3810-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.495498 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.495463    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6612295e-5207-4c89-8c9c-1b9e661e3810-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.495686 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.495519    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6612295e-5207-4c89-8c9c-1b9e661e3810-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.495686 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.495549    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6612295e-5207-4c89-8c9c-1b9e661e3810-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.495686 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.495566    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6612295e-5207-4c89-8c9c-1b9e661e3810-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.495686 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.495581    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg94n\" (UniqueName: \"kubernetes.io/projected/6612295e-5207-4c89-8c9c-1b9e661e3810-kube-api-access-tg94n\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.495686 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.495650    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6612295e-5207-4c89-8c9c-1b9e661e3810-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.495949 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.495933    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6612295e-5207-4c89-8c9c-1b9e661e3810-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.496001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.495974    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6612295e-5207-4c89-8c9c-1b9e661e3810-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.496001 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.495986    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6612295e-5207-4c89-8c9c-1b9e661e3810-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.497831 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.497810    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6612295e-5207-4c89-8c9c-1b9e661e3810-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.498118 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.498099    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6612295e-5207-4c89-8c9c-1b9e661e3810-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.503021 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.503001    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg94n\" (UniqueName: \"kubernetes.io/projected/6612295e-5207-4c89-8c9c-1b9e661e3810-kube-api-access-tg94n\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd\" (UID: \"6612295e-5207-4c89-8c9c-1b9e661e3810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.650480 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.650442    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:20.784060 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:20.784019    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"]
Jun 14 03:27:20.786898 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:27:20.786868    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6612295e_5207_4c89_8c9c_1b9e661e3810.slice/crio-fbc8acc9c63f01593e8547eced6878dc2c73467384f519ca761fcf56500c88a6 WatchSource:0}: Error finding container fbc8acc9c63f01593e8547eced6878dc2c73467384f519ca761fcf56500c88a6: Status 404 returned error can't find the container with id fbc8acc9c63f01593e8547eced6878dc2c73467384f519ca761fcf56500c88a6
Jun 14 03:27:21.372164 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:21.372126    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd" event={"ID":"6612295e-5207-4c89-8c9c-1b9e661e3810","Type":"ContainerStarted","Data":"dd098bf5ced349cdd74c0bcb4c3a8422ed030077411fcd9e422aeca2c3eb4be3"}
Jun 14 03:27:21.372560 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:21.372177    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd" event={"ID":"6612295e-5207-4c89-8c9c-1b9e661e3810","Type":"ContainerStarted","Data":"fbc8acc9c63f01593e8547eced6878dc2c73467384f519ca761fcf56500c88a6"}
Jun 14 03:27:22.378527 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:22.378493    2516 generic.go:356] "Generic (PLEG): container finished" podID="6612295e-5207-4c89-8c9c-1b9e661e3810" containerID="dd098bf5ced349cdd74c0bcb4c3a8422ed030077411fcd9e422aeca2c3eb4be3" exitCode=0
Jun 14 03:27:22.378884 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:22.378562    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd" event={"ID":"6612295e-5207-4c89-8c9c-1b9e661e3810","Type":"ContainerDied","Data":"dd098bf5ced349cdd74c0bcb4c3a8422ed030077411fcd9e422aeca2c3eb4be3"}
Jun 14 03:27:23.384605 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:23.384568    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd" event={"ID":"6612295e-5207-4c89-8c9c-1b9e661e3810","Type":"ContainerStarted","Data":"7be3f599ad6efd86c53e790d514b168d0e3f17bb6b14f28147b507e0f1589281"}
Jun 14 03:27:23.402391 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:23.402342    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd" podStartSLOduration=2.028241297 podStartE2EDuration="3.402327461s" totalImagesPullingTime="153.076142ms" totalInitContainerRuntime="1.221010022s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:27:23.401671936 +0000 UTC m=+886.179116782" watchObservedRunningTime="2026-06-14 03:27:23.402327461 +0000 UTC m=+886.179772285"
Jun 14 03:27:30.651378 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:30.651286    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:30.651378 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:30.651377    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:30.664173 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:30.664141    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:31.433527 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:31.433493    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd"
Jun 14 03:27:37.681623 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:37.681592    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:27:37.684817 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:37.684796    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:27:37.688633 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:37.688612    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:27:37.691686 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:37.691662    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:27:50.308494 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.308459    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"]
Jun 14 03:27:50.312287 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.312270    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.314665 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.314645    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jun 14 03:27:50.322159 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.322136    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"]
Jun 14 03:27:50.463323 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.463289    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abc70d1b-9053-4c65-b4ca-6ec27e005631-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.463503 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.463343    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abc70d1b-9053-4c65-b4ca-6ec27e005631-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.463503 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.463367    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/abc70d1b-9053-4c65-b4ca-6ec27e005631-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.463503 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.463396    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abc70d1b-9053-4c65-b4ca-6ec27e005631-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.463503 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.463428    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abc70d1b-9053-4c65-b4ca-6ec27e005631-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.463503 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.463466    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxzh6\" (UniqueName: \"kubernetes.io/projected/abc70d1b-9053-4c65-b4ca-6ec27e005631-kube-api-access-xxzh6\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.564189 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.564102    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abc70d1b-9053-4c65-b4ca-6ec27e005631-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.564189 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.564141    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/abc70d1b-9053-4c65-b4ca-6ec27e005631-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.564189 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.564165    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abc70d1b-9053-4c65-b4ca-6ec27e005631-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.564454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.564196    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abc70d1b-9053-4c65-b4ca-6ec27e005631-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.564454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.564217    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxzh6\" (UniqueName: \"kubernetes.io/projected/abc70d1b-9053-4c65-b4ca-6ec27e005631-kube-api-access-xxzh6\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.564454 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.564251    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abc70d1b-9053-4c65-b4ca-6ec27e005631-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.564676 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.564653    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/abc70d1b-9053-4c65-b4ca-6ec27e005631-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.564736 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.564703    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abc70d1b-9053-4c65-b4ca-6ec27e005631-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.564787 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.564734    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abc70d1b-9053-4c65-b4ca-6ec27e005631-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.566473 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.566455    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abc70d1b-9053-4c65-b4ca-6ec27e005631-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.566649 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.566632    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abc70d1b-9053-4c65-b4ca-6ec27e005631-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.571635 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.571604    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxzh6\" (UniqueName: \"kubernetes.io/projected/abc70d1b-9053-4c65-b4ca-6ec27e005631-kube-api-access-xxzh6\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gswjd\" (UID: \"abc70d1b-9053-4c65-b4ca-6ec27e005631\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.623680 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.623642    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:27:50.755800 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:50.755771    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"]
Jun 14 03:27:50.758421 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:27:50.758393    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc70d1b_9053_4c65_b4ca_6ec27e005631.slice/crio-f2112fd90851e9e626f7f87bf02392596cac2b7b683547671a8bd8bbd7b8be28 WatchSource:0}: Error finding container f2112fd90851e9e626f7f87bf02392596cac2b7b683547671a8bd8bbd7b8be28: Status 404 returned error can't find the container with id f2112fd90851e9e626f7f87bf02392596cac2b7b683547671a8bd8bbd7b8be28
Jun 14 03:27:51.520253 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:51.520217    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd" event={"ID":"abc70d1b-9053-4c65-b4ca-6ec27e005631","Type":"ContainerStarted","Data":"d5de9f30c539acf3b589fba7e158002f230b4fad2341493d3157b7d0ead800d7"}
Jun 14 03:27:51.520650 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:27:51.520303    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd" event={"ID":"abc70d1b-9053-4c65-b4ca-6ec27e005631","Type":"ContainerStarted","Data":"f2112fd90851e9e626f7f87bf02392596cac2b7b683547671a8bd8bbd7b8be28"}
Jun 14 03:28:12.016505 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.016470    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"]
Jun 14 03:28:12.019777 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.019759    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.022139 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.022114    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jun 14 03:28:12.029635 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.029612    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"]
Jun 14 03:28:12.062669 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.062643    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c703a2c-58fe-4222-bcc9-675cc0467faf-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.062802 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.062674    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c703a2c-58fe-4222-bcc9-675cc0467faf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.062802 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.062744    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j7qn\" (UniqueName: \"kubernetes.io/projected/7c703a2c-58fe-4222-bcc9-675cc0467faf-kube-api-access-5j7qn\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.062886 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.062841    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c703a2c-58fe-4222-bcc9-675cc0467faf-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.062886 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.062867    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c703a2c-58fe-4222-bcc9-675cc0467faf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.062967 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.062899    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7c703a2c-58fe-4222-bcc9-675cc0467faf-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.163429 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.163393    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j7qn\" (UniqueName: \"kubernetes.io/projected/7c703a2c-58fe-4222-bcc9-675cc0467faf-kube-api-access-5j7qn\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.163625 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.163487    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c703a2c-58fe-4222-bcc9-675cc0467faf-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.163625 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.163516    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c703a2c-58fe-4222-bcc9-675cc0467faf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.163625 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.163550    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7c703a2c-58fe-4222-bcc9-675cc0467faf-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.163625 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.163579    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c703a2c-58fe-4222-bcc9-675cc0467faf-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.163625 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.163604    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c703a2c-58fe-4222-bcc9-675cc0467faf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.163965 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.163938    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c703a2c-58fe-4222-bcc9-675cc0467faf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.164114 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.163965    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c703a2c-58fe-4222-bcc9-675cc0467faf-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.164114 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.163982    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7c703a2c-58fe-4222-bcc9-675cc0467faf-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.166519 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.166497    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c703a2c-58fe-4222-bcc9-675cc0467faf-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.166914 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.166895    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c703a2c-58fe-4222-bcc9-675cc0467faf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.171426 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.171404    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j7qn\" (UniqueName: \"kubernetes.io/projected/7c703a2c-58fe-4222-bcc9-675cc0467faf-kube-api-access-5j7qn\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ndzkc\" (UID: \"7c703a2c-58fe-4222-bcc9-675cc0467faf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.330477 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.330400    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:12.462342 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.462274    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"]
Jun 14 03:28:12.463892 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:28:12.463864    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c703a2c_58fe_4222_bcc9_675cc0467faf.slice/crio-f23081a87b45a15b8d742a1b73c3505dd170af93e90f1e2d7d30be6f53714771 WatchSource:0}: Error finding container f23081a87b45a15b8d742a1b73c3505dd170af93e90f1e2d7d30be6f53714771: Status 404 returned error can't find the container with id f23081a87b45a15b8d742a1b73c3505dd170af93e90f1e2d7d30be6f53714771
Jun 14 03:28:12.624203 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.624169    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc" event={"ID":"7c703a2c-58fe-4222-bcc9-675cc0467faf","Type":"ContainerStarted","Data":"4030eb04af4db3f03381e9afdab08fde5bc3a704a43a94968bf07ae69c0515b4"}
Jun 14 03:28:12.624410 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:12.624212    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc" event={"ID":"7c703a2c-58fe-4222-bcc9-675cc0467faf","Type":"ContainerStarted","Data":"f23081a87b45a15b8d742a1b73c3505dd170af93e90f1e2d7d30be6f53714771"}
Jun 14 03:28:21.669567 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:21.669533    2516 generic.go:356] "Generic (PLEG): container finished" podID="7c703a2c-58fe-4222-bcc9-675cc0467faf" containerID="4030eb04af4db3f03381e9afdab08fde5bc3a704a43a94968bf07ae69c0515b4" exitCode=0
Jun 14 03:28:21.670141 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:21.669602    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc" event={"ID":"7c703a2c-58fe-4222-bcc9-675cc0467faf","Type":"ContainerDied","Data":"4030eb04af4db3f03381e9afdab08fde5bc3a704a43a94968bf07ae69c0515b4"}
Jun 14 03:28:21.670348 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:21.670331    2516 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 14 03:28:22.676103 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:22.676053    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc" event={"ID":"7c703a2c-58fe-4222-bcc9-675cc0467faf","Type":"ContainerStarted","Data":"49109f76fa8aa5965749b3065bea74f11ed4ca8a9c9a88ccccf234feeaaf6d9c"}
Jun 14 03:28:22.693265 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:22.693137    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc" podStartSLOduration=2.502393664 podStartE2EDuration="11.693116379s" totalImagesPullingTime="166.165649ms" totalInitContainerRuntime="9.024557066s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:28:22.692389277 +0000 UTC m=+945.469834099" watchObservedRunningTime="2026-06-14 03:28:22.693116379 +0000 UTC m=+945.470561213"
Jun 14 03:28:32.331561 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:32.331509    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:32.331978 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:32.331589    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:32.344074 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:32.344052    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:28:32.735816 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:28:32.735790    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ndzkc"
Jun 14 03:31:31.603444 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:31:31.603410    2516 generic.go:356] "Generic (PLEG): container finished" podID="abc70d1b-9053-4c65-b4ca-6ec27e005631" containerID="d5de9f30c539acf3b589fba7e158002f230b4fad2341493d3157b7d0ead800d7" exitCode=0
Jun 14 03:31:31.603884 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:31:31.603481    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd" event={"ID":"abc70d1b-9053-4c65-b4ca-6ec27e005631","Type":"ContainerDied","Data":"d5de9f30c539acf3b589fba7e158002f230b4fad2341493d3157b7d0ead800d7"}
Jun 14 03:31:32.609816 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:31:32.609783    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd" event={"ID":"abc70d1b-9053-4c65-b4ca-6ec27e005631","Type":"ContainerStarted","Data":"5cd5d50ebad53c6be7190d3124aa71cea262d3ceca736f462261967e37a62bfb"}
Jun 14 03:31:32.628401 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:31:32.628335    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd" podStartSLOduration=2.484775438 podStartE2EDuration="3m42.628319348s" totalImagesPullingTime="158.105342ms" totalInitContainerRuntime="3m39.985438568s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:27:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:31:32.626880683 +0000 UTC m=+1135.404325524" watchObservedRunningTime="2026-06-14 03:31:32.628319348 +0000 UTC m=+1135.405764205"
Jun 14 03:31:40.624613 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:31:40.624577    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:31:40.625011 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:31:40.624639    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:31:40.637259 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:31:40.637234    2516 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:31:40.663052 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:31:40.663024    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gswjd"
Jun 14 03:32:37.711959 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:32:37.711932    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:32:37.716336 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:32:37.716314    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:32:37.719124 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:32:37.719104    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:32:37.723181 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:32:37.723165    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:37:37.742796 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:37:37.742765    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:37:37.748499 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:37:37.748476    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:37:37.750451 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:37:37.750422    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:37:37.755144 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:37:37.755128    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:42:37.774787 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:42:37.774760    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:42:37.785022 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:42:37.784997    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:42:37.785355 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:42:37.785329    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:42:37.792287 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:42:37.792270    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:47:37.811248 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:47:37.811221    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:47:37.818581 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:47:37.818558    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:47:37.818734 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:47:37.818708    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:47:37.825858 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:47:37.825839    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:52:37.847798 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:52:37.847699    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:52:37.851733 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:52:37.851711    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:52:37.854934 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:52:37.854917    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:52:37.858412 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:52:37.858396    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdpjm_2a47fb2c-2e21-4947-86d3-20cf83361345/ovn-acl-logging/0.log"
Jun 14 03:54:22.992938 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:22.992908    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-84c4497745-vdvcq_48d8dc9c-359b-4679-ac6e-71ff0e38c779/maas-api/0.log"
Jun 14 03:54:23.805894 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:23.805867    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q_f2cba15a-7abb-4094-971f-423e3f9b1865/copy-manifests/0.log"
Jun 14 03:54:23.812801 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:23.812779    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q_f2cba15a-7abb-4094-971f-423e3f9b1865/manager/0.log"
Jun 14 03:54:25.665840 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:25.665816    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-96l7m_b27d9eb5-a364-41d1-b758-9ca9524fe54f/kuadrant-console-plugin/0.log"
Jun 14 03:54:26.147507 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:26.147472    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n9fv5_49044c9b-2ba1-4feb-a7e0-d88b7d83da3a/manager/0.log"
Jun 14 03:54:26.717057 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:26.717023    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6fc8f5d7-2n6ms_49621422-51d7-4728-9559-756a2679406a/kube-auth-proxy/0.log"
Jun 14 03:54:27.061753 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:27.061680    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-wtcg9_dd78c942-fd44-4f26-b5d9-316195f4bc2a/payload-pre-processing/0.log"
Jun 14 03:54:27.282047 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:27.281998    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-775bdfb79b-5kgtp_d13e7b69-fc43-4106-81dc-286e6f6cc59c/router/0.log"
Jun 14 03:54:27.616056 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:27.616026    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-whr99_fe9fe595-487a-47cf-9393-40962f799240/storage-initializer/0.log"
Jun 14 03:54:27.623151 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:27.623126    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-whr99_fe9fe595-487a-47cf-9393-40962f799240/main/0.log"
Jun 14 03:54:27.849696 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:27.849663    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd_6612295e-5207-4c89-8c9c-1b9e661e3810/main/0.log"
Jun 14 03:54:27.856588 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:27.856562    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-v77qd_6612295e-5207-4c89-8c9c-1b9e661e3810/storage-initializer/0.log"
Jun 14 03:54:28.088720 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:28.088688    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-gswjd_abc70d1b-9053-4c65-b4ca-6ec27e005631/storage-initializer/0.log"
Jun 14 03:54:28.095241 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:28.095222    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-gswjd_abc70d1b-9053-4c65-b4ca-6ec27e005631/main/0.log"
Jun 14 03:54:28.206491 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:28.206458    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-ndzkc_7c703a2c-58fe-4222-bcc9-675cc0467faf/storage-initializer/0.log"
Jun 14 03:54:28.213271 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:28.213237    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-ndzkc_7c703a2c-58fe-4222-bcc9-675cc0467faf/main/0.log"
Jun 14 03:54:34.858229 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:34.858196    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xqgzv_58fb4ed6-26bd-43a3-a1d1-fbfa9a0aa81e/global-pull-secret-syncer/0.log"
Jun 14 03:54:34.930175 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:34.930142    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8vprh_e91468e4-f06a-4102-968e-3f963db5b774/konnectivity-agent/0.log"
Jun 14 03:54:35.032403 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:35.032375    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-194.ec2.internal_a64a0089d96df9e7686766c7f0343b5c/haproxy/0.log"
Jun 14 03:54:40.343677 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:40.343649    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-96l7m_b27d9eb5-a364-41d1-b758-9ca9524fe54f/kuadrant-console-plugin/0.log"
Jun 14 03:54:40.565965 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:40.565934    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n9fv5_49044c9b-2ba1-4feb-a7e0-d88b7d83da3a/manager/0.log"
Jun 14 03:54:42.515220 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:42.515195    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qmsgr_2c94a1ab-6730-4b36-928d-5582b2655ad4/node-exporter/0.log"
Jun 14 03:54:42.537033 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:42.537008    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qmsgr_2c94a1ab-6730-4b36-928d-5582b2655ad4/kube-rbac-proxy/0.log"
Jun 14 03:54:42.558125 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:42.558101    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qmsgr_2c94a1ab-6730-4b36-928d-5582b2655ad4/init-textfile/0.log"
Jun 14 03:54:42.782201 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:42.782176    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-549pr_18192158-800a-4b9c-9ce0-a8d6ff97fe2e/kube-rbac-proxy-main/0.log"
Jun 14 03:54:42.807523 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:42.807499    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-549pr_18192158-800a-4b9c-9ce0-a8d6ff97fe2e/kube-rbac-proxy-self/0.log"
Jun 14 03:54:42.832288 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:42.832267    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-549pr_18192158-800a-4b9c-9ce0-a8d6ff97fe2e/openshift-state-metrics/0.log"
Jun 14 03:54:42.873666 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:42.873640    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d679ea6a-69d9-49d8-88f3-f7aa53ddddb9/prometheus/0.log"
Jun 14 03:54:42.903385 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:42.903365    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d679ea6a-69d9-49d8-88f3-f7aa53ddddb9/config-reloader/0.log"
Jun 14 03:54:42.925091 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:42.925064    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d679ea6a-69d9-49d8-88f3-f7aa53ddddb9/thanos-sidecar/0.log"
Jun 14 03:54:42.947110 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:42.947086    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d679ea6a-69d9-49d8-88f3-f7aa53ddddb9/kube-rbac-proxy-web/0.log"
Jun 14 03:54:42.973991 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:42.973974    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d679ea6a-69d9-49d8-88f3-f7aa53ddddb9/kube-rbac-proxy/0.log"
Jun 14 03:54:42.995945 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:42.995899    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d679ea6a-69d9-49d8-88f3-f7aa53ddddb9/kube-rbac-proxy-thanos/0.log"
Jun 14 03:54:43.019910 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:43.019888    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d679ea6a-69d9-49d8-88f3-f7aa53ddddb9/init-config-reloader/0.log"
Jun 14 03:54:43.047787 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:43.047767    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-l9gxr_afe0f4d6-b1e2-483f-ace1-5483185a195a/prometheus-operator/0.log"
Jun 14 03:54:43.065005 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:43.064982    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-l9gxr_afe0f4d6-b1e2-483f-ace1-5483185a195a/kube-rbac-proxy/0.log"
Jun 14 03:54:43.097442 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:43.097422    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-dcl7x_1d05d1e6-5aab-4201-a3c6-2eaa3e7ef008/prometheus-operator-admission-webhook/0.log"
Jun 14 03:54:43.211909 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:43.211882    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b95b445f5-rv7wl_a590ae68-37d9-469f-92c9-9c1adff7fe95/thanos-query/0.log"
Jun 14 03:54:43.236424 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:43.236399    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b95b445f5-rv7wl_a590ae68-37d9-469f-92c9-9c1adff7fe95/kube-rbac-proxy-web/0.log"
Jun 14 03:54:43.262340 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:43.262274    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b95b445f5-rv7wl_a590ae68-37d9-469f-92c9-9c1adff7fe95/kube-rbac-proxy/0.log"
Jun 14 03:54:43.283632 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:43.283605    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b95b445f5-rv7wl_a590ae68-37d9-469f-92c9-9c1adff7fe95/prom-label-proxy/0.log"
Jun 14 03:54:43.305636 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:43.305614    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b95b445f5-rv7wl_a590ae68-37d9-469f-92c9-9c1adff7fe95/kube-rbac-proxy-rules/0.log"
Jun 14 03:54:43.330779 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:43.330758    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b95b445f5-rv7wl_a590ae68-37d9-469f-92c9-9c1adff7fe95/kube-rbac-proxy-metrics/0.log"
Jun 14 03:54:44.745194 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:44.745165    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-s4qdr_0e07ac22-26c0-4234-90b8-f52f2c22c896/networking-console-plugin/0.log"
Jun 14 03:54:45.421262 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:45.421220    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/2.log"
Jun 14 03:54:45.424493 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:45.424473    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-g9m86_b9fddd80-a36b-4069-82a5-25b8f9332e38/console-operator/3.log"
Jun 14 03:54:46.644997 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.644960    2516 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"]
Jun 14 03:54:46.648855 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.648832    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:46.651190 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.651172    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hm758\"/\"kube-root-ca.crt\""
Jun 14 03:54:46.652156 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.652139    2516 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hm758\"/\"default-dockercfg-xdkrk\""
Jun 14 03:54:46.652250 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.652192    2516 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hm758\"/\"openshift-service-ca.crt\""
Jun 14 03:54:46.655809 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.655783    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"]
Jun 14 03:54:46.703667 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.703641    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-jk9zm_3556d3e2-30f5-4112-b2c4-eec9f15b066c/volume-data-source-validator/0.log"
Jun 14 03:54:46.749617 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.749588    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f845e831-b6a7-4e7b-b9dd-5f78af8767ec-proc\") pod \"perf-node-gather-daemonset-jsxcj\" (UID: \"f845e831-b6a7-4e7b-b9dd-5f78af8767ec\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:46.749746 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.749622    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f845e831-b6a7-4e7b-b9dd-5f78af8767ec-podres\") pod \"perf-node-gather-daemonset-jsxcj\" (UID: \"f845e831-b6a7-4e7b-b9dd-5f78af8767ec\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:46.749746 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.749650    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f845e831-b6a7-4e7b-b9dd-5f78af8767ec-sys\") pod \"perf-node-gather-daemonset-jsxcj\" (UID: \"f845e831-b6a7-4e7b-b9dd-5f78af8767ec\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:46.749820 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.749786    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f845e831-b6a7-4e7b-b9dd-5f78af8767ec-lib-modules\") pod \"perf-node-gather-daemonset-jsxcj\" (UID: \"f845e831-b6a7-4e7b-b9dd-5f78af8767ec\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:46.749852 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.749833    2516 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmp8x\" (UniqueName: \"kubernetes.io/projected/f845e831-b6a7-4e7b-b9dd-5f78af8767ec-kube-api-access-dmp8x\") pod \"perf-node-gather-daemonset-jsxcj\" (UID: \"f845e831-b6a7-4e7b-b9dd-5f78af8767ec\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:46.851002 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.850969    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f845e831-b6a7-4e7b-b9dd-5f78af8767ec-lib-modules\") pod \"perf-node-gather-daemonset-jsxcj\" (UID: \"f845e831-b6a7-4e7b-b9dd-5f78af8767ec\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:46.851199 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.851013    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmp8x\" (UniqueName: \"kubernetes.io/projected/f845e831-b6a7-4e7b-b9dd-5f78af8767ec-kube-api-access-dmp8x\") pod \"perf-node-gather-daemonset-jsxcj\" (UID: \"f845e831-b6a7-4e7b-b9dd-5f78af8767ec\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:46.851199 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.851042    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f845e831-b6a7-4e7b-b9dd-5f78af8767ec-proc\") pod \"perf-node-gather-daemonset-jsxcj\" (UID: \"f845e831-b6a7-4e7b-b9dd-5f78af8767ec\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:46.851199 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.851058    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f845e831-b6a7-4e7b-b9dd-5f78af8767ec-podres\") pod \"perf-node-gather-daemonset-jsxcj\" (UID: \"f845e831-b6a7-4e7b-b9dd-5f78af8767ec\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:46.851199 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.851102    2516 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f845e831-b6a7-4e7b-b9dd-5f78af8767ec-sys\") pod \"perf-node-gather-daemonset-jsxcj\" (UID: \"f845e831-b6a7-4e7b-b9dd-5f78af8767ec\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:46.851199 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.851166    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f845e831-b6a7-4e7b-b9dd-5f78af8767ec-proc\") pod \"perf-node-gather-daemonset-jsxcj\" (UID: \"f845e831-b6a7-4e7b-b9dd-5f78af8767ec\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:46.851199 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.851170    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f845e831-b6a7-4e7b-b9dd-5f78af8767ec-lib-modules\") pod \"perf-node-gather-daemonset-jsxcj\" (UID: \"f845e831-b6a7-4e7b-b9dd-5f78af8767ec\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:46.851479 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.851202    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f845e831-b6a7-4e7b-b9dd-5f78af8767ec-sys\") pod \"perf-node-gather-daemonset-jsxcj\" (UID: \"f845e831-b6a7-4e7b-b9dd-5f78af8767ec\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:46.851479 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.851228    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f845e831-b6a7-4e7b-b9dd-5f78af8767ec-podres\") pod \"perf-node-gather-daemonset-jsxcj\" (UID: \"f845e831-b6a7-4e7b-b9dd-5f78af8767ec\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:46.859915 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.859891    2516 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmp8x\" (UniqueName: \"kubernetes.io/projected/f845e831-b6a7-4e7b-b9dd-5f78af8767ec-kube-api-access-dmp8x\") pod \"perf-node-gather-daemonset-jsxcj\" (UID: \"f845e831-b6a7-4e7b-b9dd-5f78af8767ec\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:46.961201 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:46.961129    2516 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:47.093465 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:47.093440    2516 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"]
Jun 14 03:54:47.095806 ip-10-0-141-194 kubenswrapper[2516]: W0614 03:54:47.095777    2516 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf845e831_b6a7_4e7b_b9dd_5f78af8767ec.slice/crio-b04330292e1668b0d6370e8ecd934ef1ff5b82341ad47ae0805dbc51c796d0f5 WatchSource:0}: Error finding container b04330292e1668b0d6370e8ecd934ef1ff5b82341ad47ae0805dbc51c796d0f5: Status 404 returned error can't find the container with id b04330292e1668b0d6370e8ecd934ef1ff5b82341ad47ae0805dbc51c796d0f5
Jun 14 03:54:47.516522 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:47.516418    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj" event={"ID":"f845e831-b6a7-4e7b-b9dd-5f78af8767ec","Type":"ContainerStarted","Data":"7244e397b097fe8508802675fa16f578990b5016ef3c7b43265a6ae753541dd5"}
Jun 14 03:54:47.516694 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:47.516548    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:47.516694 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:47.516582    2516 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj" event={"ID":"f845e831-b6a7-4e7b-b9dd-5f78af8767ec","Type":"ContainerStarted","Data":"b04330292e1668b0d6370e8ecd934ef1ff5b82341ad47ae0805dbc51c796d0f5"}
Jun 14 03:54:47.532395 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:47.532347    2516 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj" podStartSLOduration=1.532330005 podStartE2EDuration="1.532330005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:54:47.530736684 +0000 UTC m=+2530.308181507" watchObservedRunningTime="2026-06-14 03:54:47.532330005 +0000 UTC m=+2530.309774838"
Jun 14 03:54:47.855387 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:47.855282    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2pxlj_59b69d24-0cbf-41a4-a252-647f088ec7bf/dns/0.log"
Jun 14 03:54:47.875026 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:47.875000    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2pxlj_59b69d24-0cbf-41a4-a252-647f088ec7bf/kube-rbac-proxy/0.log"
Jun 14 03:54:48.010760 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:48.010733    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nvmbb_bf38e71f-f179-4e4d-95be-b9954e1b2605/dns-node-resolver/0.log"
Jun 14 03:54:48.575242 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:48.575213    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l4567_0e55a15d-3244-4d6d-a7c0-82b2c0758f6f/node-ca/0.log"
Jun 14 03:54:49.633616 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:49.633589    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6fc8f5d7-2n6ms_49621422-51d7-4728-9559-756a2679406a/kube-auth-proxy/0.log"
Jun 14 03:54:49.758754 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:49.758720    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-wtcg9_dd78c942-fd44-4f26-b5d9-316195f4bc2a/payload-pre-processing/0.log"
Jun 14 03:54:49.851550 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:49.851521    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-775bdfb79b-5kgtp_d13e7b69-fc43-4106-81dc-286e6f6cc59c/router/0.log"
Jun 14 03:54:50.468224 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:50.468172    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5z9bc_af4c2972-fca9-4bab-b645-44b2b1e876d0/serve-healthcheck-canary/0.log"
Jun 14 03:54:51.177980 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:51.177952    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x8hrf_bdfaeb97-a275-4495-b142-9cc10b93fa35/kube-rbac-proxy/0.log"
Jun 14 03:54:51.202263 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:51.202234    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x8hrf_bdfaeb97-a275-4495-b142-9cc10b93fa35/exporter/0.log"
Jun 14 03:54:51.222917 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:51.222894    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x8hrf_bdfaeb97-a275-4495-b142-9cc10b93fa35/extractor/0.log"
Jun 14 03:54:53.531670 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:53.531644    2516 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-jsxcj"
Jun 14 03:54:53.659468 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:53.659444    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-84c4497745-vdvcq_48d8dc9c-359b-4679-ac6e-71ff0e38c779/maas-api/0.log"
Jun 14 03:54:53.913369 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:53.913337    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q_f2cba15a-7abb-4094-971f-423e3f9b1865/manager/0.log"
Jun 14 03:54:53.933646 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:53.933623    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb65bb8c8-h2v2q_f2cba15a-7abb-4094-971f-423e3f9b1865/copy-manifests/0.log"
Jun 14 03:54:55.686041 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:55.686011    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7bfc4d86bf-jtrwj_92c53fbc-bacd-4e20-ae82-c7e885ca8a1e/manager/0.log"
Jun 14 03:54:55.741608 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:54:55.741586    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-69jcn_e91f5029-e0a1-4143-828f-aa673e0b8a2d/openshift-lws-operator/0.log"
Jun 14 03:55:00.163290 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:00.163260    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6fc8f5d7-2n6ms_49621422-51d7-4728-9559-756a2679406a/kube-auth-proxy/0.log"
Jun 14 03:55:00.268040 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:00.268013    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-wtcg9_dd78c942-fd44-4f26-b5d9-316195f4bc2a/payload-pre-processing/0.log"
Jun 14 03:55:00.353483 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:00.353444    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-775bdfb79b-5kgtp_d13e7b69-fc43-4106-81dc-286e6f6cc59c/router/0.log"
Jun 14 03:55:01.060372 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:01.060340    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-rvt2z_09caee24-ceb8-4cc6-bee1-76dec37ce2b1/migrator/0.log"
Jun 14 03:55:01.080137 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:01.080111    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-rvt2z_09caee24-ceb8-4cc6-bee1-76dec37ce2b1/graceful-termination/0.log"
Jun 14 03:55:01.654092 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:01.654042    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6fc8f5d7-2n6ms_49621422-51d7-4728-9559-756a2679406a/kube-auth-proxy/0.log"
Jun 14 03:55:01.757915 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:01.757889    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-wtcg9_dd78c942-fd44-4f26-b5d9-316195f4bc2a/payload-pre-processing/0.log"
Jun 14 03:55:01.840512 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:01.840479    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-775bdfb79b-5kgtp_d13e7b69-fc43-4106-81dc-286e6f6cc59c/router/0.log"
Jun 14 03:55:02.857022 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:02.856997    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9cw2_b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c/kube-multus-additional-cni-plugins/0.log"
Jun 14 03:55:02.877194 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:02.877171    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9cw2_b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c/egress-router-binary-copy/0.log"
Jun 14 03:55:02.897298 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:02.897274    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9cw2_b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c/cni-plugins/0.log"
Jun 14 03:55:02.916595 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:02.916574    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9cw2_b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c/bond-cni-plugin/0.log"
Jun 14 03:55:02.936209 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:02.936174    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9cw2_b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c/routeoverride-cni/0.log"
Jun 14 03:55:02.955784 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:02.955763    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9cw2_b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c/whereabouts-cni-bincopy/0.log"
Jun 14 03:55:02.976351 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:02.976332    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9cw2_b8267e59-45f3-4f8b-9e3f-8a8b0f444c8c/whereabouts-cni/0.log"
Jun 14 03:55:03.209108 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:03.209069    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fl99x_f9a8e832-4cf1-4469-b58d-3703c0585d9e/kube-multus/0.log"
Jun 14 03:55:03.227579 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:03.227550    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c7zzq_a7812b72-9313-42ca-96cf-cde0c84e41d6/network-metrics-daemon/0.log"
Jun 14 03:55:03.246249 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:03.246227    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c7zzq_a7812b72-9313-42ca-96cf-cde0c84e41d6/kube-rbac-proxy/0.log"
Jun 14 03:55:03.663021 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:03.662992    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6fc8f5d7-2n6ms_49621422-51d7-4728-9559-756a2679406a/kube-auth-proxy/0.log"
Jun 14 03:55:03.757012 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:03.756975    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-wtcg9_dd78c942-fd44-4f26-b5d9-316195f4bc2a/payload-pre-processing/0.log"
Jun 14 03:55:03.835440 ip-10-0-141-194 kubenswrapper[2516]: I0614 03:55:03.835413    2516 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-775bdfb79b-5kgtp_d13e7b69-fc43-4106-81dc-286e6f6cc59c/router/0.log"