Jun 11 09:34:32.743044 ip-10-0-138-252 systemd[1]: Starting Kubernetes Kubelet...
Jun 11 09:34:33.219445 ip-10-0-138-252 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 11 09:34:33.219445 ip-10-0-138-252 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 11 09:34:33.219445 ip-10-0-138-252 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 11 09:34:33.219445 ip-10-0-138-252 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 11 09:34:33.219445 ip-10-0-138-252 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 11 09:34:33.221411 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.221324    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 11 09:34:33.225898 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225882    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 09:34:33.225898 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225897    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 09:34:33.225898 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225901    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225904    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225909    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225913    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225917    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225920    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225923    2561 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225926    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225930    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225934    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225937    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225940    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225942    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225945    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225947    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225950    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225953    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225955    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225958    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225960    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 09:34:33.225995 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225963    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225966    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225968    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225971    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225974    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225976    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225979    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225981    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225984    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225986    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225989    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225992    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225994    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.225998    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226001    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226003    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226008    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226011    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226013    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226016    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 09:34:33.226477 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226018    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226021    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226031    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226034    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226037    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226040    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226043    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226045    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226048    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226050    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226053    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226055    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226058    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226060    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226065    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226068    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226071    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226074    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226076    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226079    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 09:34:33.226979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226081    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226084    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226088    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226090    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226093    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226096    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226098    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226101    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226104    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226107    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226110    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226112    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226115    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226118    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226120    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226125    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226129    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226132    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226135    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 09:34:33.227513 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226137    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226140    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226142    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226145    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226147    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226150    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226152    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226156    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226158    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226161    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226164    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226166    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226169    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226172    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226174    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226177    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226180    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226182    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226895    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 09:34:33.227976 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226902    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226905    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226910    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226914    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226917    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226920    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226923    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226926    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226929    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226932    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226935    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226938    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226940    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226943    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226946    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226950    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226953    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226957    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226959    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 09:34:33.228434 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226962    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226965    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226968    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226971    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226974    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226978    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226981    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226984    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226987    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226990    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226993    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226996    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.226999    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227001    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227004    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227007    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227009    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227012    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227015    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227017    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 09:34:33.228926 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227020    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227022    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227025    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227028    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227030    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227033    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227036    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227038    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227041    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227043    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227046    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227048    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227051    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227055    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227058    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227060    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227063    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227065    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227068    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227070    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 09:34:33.229421 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227073    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227076    2561 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227079    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227081    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227084    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227086    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227089    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227091    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227094    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227096    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227099    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227101    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227104    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227107    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227109    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227112    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227114    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227116    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227119    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227122    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 09:34:33.229933 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227124    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227126    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227129    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227133    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227135    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227139    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227143    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227145    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227148    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227151    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227154    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227157    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227159    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227162    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227164    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227167    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227169    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227172    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227174    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227533    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 09:34:33.230411 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227538    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227541    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227544    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227551    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227554    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227557    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227560    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227563    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227565    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227570    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227573    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227577    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227580    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227583    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227586    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227589    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227592    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227613    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227619    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 09:34:33.230905 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227626    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227630    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227633    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227638    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227641    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227644    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227647    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227650    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227652    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227655    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227658    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227660    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227663    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227665    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227668    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227670    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227673    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227676    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227679    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227682    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 09:34:33.231371 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227684    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227686    2561 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227689    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227692    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227695    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227697    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227700    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227702    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227705    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227707    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227711    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227714    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227716    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227719    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227721    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227724    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227726    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227729    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227732    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227734    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 09:34:33.231868 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227736    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227739    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227741    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227744    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227747    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227749    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227752    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227754    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227757    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227760    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227763    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227765    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227768    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227771    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227773    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227776    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227778    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227781    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227783    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227787    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 09:34:33.232405 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227790    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227792    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227795    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227798    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227800    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227803    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227805    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227807    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227810    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227813    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227834    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227837    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227840    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227843    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227845    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227848    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227851    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227853    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.227856    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227930    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jun 11 09:34:33.232897 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227937    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227943    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227947    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227953    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227956    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227960    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227967    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227970    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227974    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227978    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227981    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227984    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227988    2561 flags.go:64] FLAG: --cgroup-root=""
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227991    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227994    2561 flags.go:64] FLAG: --client-ca-file=""
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.227997    2561 flags.go:64] FLAG: --cloud-provider="external"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228000    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228008    2561 flags.go:64] FLAG: --cluster-domain=""
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228011    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228014    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228018    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228021    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228025    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 11 09:34:33.233375 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228028    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228031    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228034    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228038    2561 flags.go:64] FLAG: --contention-profiling="false"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228041    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228044    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228047    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228050    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228054    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228057    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228060    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228063    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228066    2561 flags.go:64] FLAG: --enable-server="true"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228074    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228081    2561 flags.go:64] FLAG: --event-burst="100"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228085    2561 flags.go:64] FLAG: --event-qps="50"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228088    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228091    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228095    2561 flags.go:64] FLAG: --eviction-hard=""
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228098    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228101    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228104    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228107    2561 flags.go:64] FLAG: --eviction-soft=""
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228113    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228116    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 11 09:34:33.233991 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228119    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228122    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228125    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228127    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228131    2561 flags.go:64] FLAG: --feature-gates=""
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228135    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228138    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228141    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228144    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228147    2561 flags.go:64] FLAG: --healthz-port="10248"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228150    2561 flags.go:64] FLAG: --help="false"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228153    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228156    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228159    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228162    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228165    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228169    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228172    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228174    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228177    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228180    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228191    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228200    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228202    2561 flags.go:64] FLAG: --kube-reserved=""
Jun 11 09:34:33.234681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228205    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228208    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228211    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228214    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228217    2561 flags.go:64] FLAG: --lock-file=""
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228220    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228224    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228227    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228233    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228236    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228239    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228242    2561 flags.go:64] FLAG: --logging-format="text"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228245    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228248    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228251    2561 flags.go:64] FLAG: --manifest-url=""
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228254    2561 flags.go:64] FLAG: --manifest-url-header=""
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228258    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228261    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228265    2561 flags.go:64] FLAG: --max-pods="110"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228268    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228271    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228274    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228277    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228280    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228283    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 11 09:34:33.235298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228286    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228293    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228295    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228298    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228301    2561 flags.go:64] FLAG: --pod-cidr=""
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228311    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228317    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228320    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228324    2561 flags.go:64] FLAG: --pods-per-core="0"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228326    2561 flags.go:64] FLAG: --port="10250"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228329    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228333    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0adcfb720a709643f"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228336    2561 flags.go:64] FLAG: --qos-reserved=""
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228339    2561 flags.go:64] FLAG: --read-only-port="10255"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228343    2561 flags.go:64] FLAG: --register-node="true"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228346    2561 flags.go:64] FLAG: --register-with-taints=""
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228350    2561 flags.go:64] FLAG: --registry-burst="10"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228353    2561 flags.go:64] FLAG: --registry-qps="5"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228356    2561 flags.go:64] FLAG: --reserved-cpus=""
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228359    2561 flags.go:64] FLAG: --reserved-memory=""
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228363    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228366    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228368    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228372    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228374    2561 flags.go:64] FLAG: --runonce="false"
Jun 11 09:34:33.235915 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228377    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228380    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228383    2561 flags.go:64] FLAG: --seccomp-default="false"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228386    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228389    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228392    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228395    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228398    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228401    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228404    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228407    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228409    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228414    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228417    2561 flags.go:64] FLAG: --system-cgroups=""
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228420    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228425    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228428    2561 flags.go:64] FLAG: --tls-cert-file=""
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228431    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228436    2561 flags.go:64] FLAG: --tls-min-version=""
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228439    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228442    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228446    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228449    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228452    2561 flags.go:64] FLAG: --v="2"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228456    2561 flags.go:64] FLAG: --version="false"
Jun 11 09:34:33.236662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228460    2561 flags.go:64] FLAG: --vmodule=""
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228464    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.228467    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228589    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228593    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228613    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228617    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228620    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228623    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228626    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228629    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228632    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228635    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228637    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228640    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228643    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228645    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228648    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228650    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 09:34:33.237271 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228656    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228659    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228663    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228666    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228669    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228671    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228674    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228677    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228680    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228683    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228686    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228689    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228692    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228695    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228697    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228700    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228702    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228705    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228708    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228710    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228713    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 09:34:33.237758 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228715    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228718    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228720    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228723    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228725    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228728    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228730    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228733    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228736    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228738    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228741    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228746    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228749    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228752    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228758    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228761    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228763    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228767    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228770    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 09:34:33.238281 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228773    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228776    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228779    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228782    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228784    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228787    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228789    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228792    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228794    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228797    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228800    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228803    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228806    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228809    2561 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228811    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228814    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228816    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228819    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228822    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228824    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 09:34:33.238769 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228827    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228829    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228832    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228834    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228838    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228841    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228843    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228846    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228849    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228851    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228855    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228857    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228860    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228863    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228866    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228869    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228871    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228874    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228876    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 09:34:33.239289 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228879    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 09:34:33.239768 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228882    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 09:34:33.239768 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228884    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 09:34:33.239768 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.228887    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 09:34:33.239768 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.229652    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 11 09:34:33.239768 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.236199    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 11 09:34:33.239768 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.236219    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 11 09:34:33.239768 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.237098    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 11 09:34:33.239768 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.237107    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 11 09:34:33.239768 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237170    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 09:34:33.239768 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237177    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 09:34:33.239768 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237181    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 09:34:33.239768 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237185    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 09:34:33.239768 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237188    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 09:34:33.239768 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237191    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237193    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237196    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237199    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237202    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237204    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237207    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237210    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237212    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237215    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237219    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237223    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237227    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237231    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237235    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237238    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237241    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237243    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237245    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237248    2561 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 09:34:33.240121 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237250    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237253    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237256    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237259    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237263    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237266    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237270    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237274    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237277    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237280    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237284    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237288    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237291    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237293    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237297    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237301    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237306    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237311    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237315    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 09:34:33.240659 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237318    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237321    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237323    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237326    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237330    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237333    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237336    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237339    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237341    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237344    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237347    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237351    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237353    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237356    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237358    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237362    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237365    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237367    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237371    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237374    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 09:34:33.241114 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237377    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237382    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237386    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237390    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237394    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237396    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237399    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237401    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237404    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237407    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237409    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237412    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237414    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237417    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237419    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237422    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237424    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237435    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237438    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237441    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 09:34:33.241683 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237444    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 09:34:33.242189 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237447    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 09:34:33.242189 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237449    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 09:34:33.242189 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237452    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 09:34:33.242189 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237455    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 09:34:33.242189 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237460    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 09:34:33.242189 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237464    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 09:34:33.242189 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237469    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 09:34:33.242189 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237473    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 09:34:33.242189 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237476    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 09:34:33.242189 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237478    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 09:34:33.242189 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237482    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 09:34:33.242189 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237484    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 09:34:33.242189 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237487    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 09:34:33.242189 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237490    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 09:34:33.242189 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.237495    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237657    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237663    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237666    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237669    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237673    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237675    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237679    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237682    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237685    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237687    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237690    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237693    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237696    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237700    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237704    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237709    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237713    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237716    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237719    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 09:34:33.242554 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237721    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237724    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237726    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237730    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237732    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237735    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237738    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237740    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237743    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237746    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237749    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237752    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237755    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237757    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237760    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237763    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237766    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237768    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237771    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237774    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 09:34:33.243066 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237777    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237781    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237785    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237789    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237793    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237809    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237812    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237816    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237819    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237822    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237824    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237827    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237829    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237832    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237836    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237840    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237843    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237846    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237849    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 09:34:33.243536 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237853    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237855    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237860    2561 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237866    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237870    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237875    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237878    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237880    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237883    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237886    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237888    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237891    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237894    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237896    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237899    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237901    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237905    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237909    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237912    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 09:34:33.244006 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237915    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237917    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237920    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237923    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237926    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237929    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237933    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237937    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237941    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237945    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237950    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237954    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237956    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237959    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237962    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237965    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237967    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237971    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237973    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 09:34:33.244469 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237976    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 09:34:33.245016 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237978    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 09:34:33.245016 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:33.237981    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 09:34:33.245016 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.237985    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 11 09:34:33.245016 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.238117    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 11 09:34:33.245016 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.240226    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 11 09:34:33.245016 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.241661    2561 server.go:1019] "Starting client certificate rotation"
Jun 11 09:34:33.245016 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.241768    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 11 09:34:33.245016 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.241837    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 11 09:34:33.245016 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.244816    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 11 09:34:33.249099 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.249067    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 11 09:34:33.261697 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.261674    2561 log.go:25] "Validated CRI v1 runtime API"
Jun 11 09:34:33.264196 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.264182    2561 log.go:25] "Validated CRI v1 image API"
Jun 11 09:34:33.264993 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.264979    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 11 09:34:33.268669 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.268644    2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7db06156-7f63-48bc-b489-c4b57d78d1a0:/dev/nvme0n1p4 de36b199-5f88-40c8-8d27-149e247031ab:/dev/nvme0n1p3]
Jun 11 09:34:33.268729 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.268668    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 11 09:34:33.274355 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.274237    2561 manager.go:216] Machine: {Timestamp:2026-06-11 09:34:33.272714611 +0000 UTC m=+0.393431246 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099417 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fb5932ce4a948bd78a78ab79223dd SystemUUID:ec2fb593-2ce4-a948-bd78-a78ab79223dd BootID:2169f2f5-afa1-43a3-b427-5992b44edcf9 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f6:5a:3c:0f:59 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f6:5a:3c:0f:59 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:96:85:a3:24:9e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 11 09:34:33.274355 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.274351    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 11 09:34:33.274449 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.274433    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 11 09:34:33.275545 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.275393    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 11 09:34:33.277631 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.277586    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 11 09:34:33.277772 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.277635    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-252.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 11 09:34:33.278363 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.278353    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jun 11 09:34:33.278395 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.278366    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jun 11 09:34:33.278395 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.278373    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 11 09:34:33.279063 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.279053    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 11 09:34:33.279849 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.279840    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 11 09:34:33.282751 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.282740    2561 state_mem.go:36] "Initialized new in-memory state store"
Jun 11 09:34:33.282881 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.282872    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 11 09:34:33.282919 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.282901    2561 kubelet.go:486] "Attempting to sync node with API server"
Jun 11 09:34:33.282919 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.282911    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 11 09:34:33.282974 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.282921    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 11 09:34:33.282974 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.282931    2561 kubelet.go:398] "Adding apiserver pod source"
Jun 11 09:34:33.282974 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.282940    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 11 09:34:33.283312 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.283300    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 11 09:34:33.283361 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.283323    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 11 09:34:33.285572 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.285552    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 11 09:34:33.286891 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.286873    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 11 09:34:33.286990 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.286906    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 11 09:34:33.288022 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.288011    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 11 09:34:33.288058 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.288029    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 11 09:34:33.288058 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.288035    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 11 09:34:33.288058 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.288041    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 11 09:34:33.288058 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.288050    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 11 09:34:33.288058 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.288056    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 11 09:34:33.288195 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.288065    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 11 09:34:33.288195 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.288071    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 11 09:34:33.288195 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.288078    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 11 09:34:33.288195 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.288083    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 11 09:34:33.288195 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.288091    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 11 09:34:33.288195 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.288096    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 11 09:34:33.288852 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.288843    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 11 09:34:33.288888 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.288853    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 11 09:34:33.292090 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.292076    2561 server.go:1268] "Started kubelet"
Jun 11 09:34:33.292306 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.292251    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 11 09:34:33.292539 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.292245    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 11 09:34:33.292539 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.292526    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 11 09:34:33.293070 ip-10-0-138-252 systemd[1]: Started Kubernetes Kubelet.
Jun 11 09:34:33.297728 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.297677    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 11 09:34:33.297728 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.297715    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 11 09:34:33.298018 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.298002    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-252.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 11 09:34:33.298312 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.298232    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-252.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 11 09:34:33.299851 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.299825    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 11 09:34:33.299940 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.299854    2561 server.go:310] "Adding debug handlers to kubelet server"
Jun 11 09:34:33.303256 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.302103    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-252.ec2.internal.18b7fd1bc0fca21c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-252.ec2.internal,UID:ip-10-0-138-252.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-252.ec2.internal,},FirstTimestamp:2026-06-11 09:34:33.292046876 +0000 UTC m=+0.412763512,LastTimestamp:2026-06-11 09:34:33.292046876 +0000 UTC m=+0.412763512,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-252.ec2.internal,}"
Jun 11 09:34:33.303851 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.303836    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 11 09:34:33.303921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.303850    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 11 09:34:33.303921 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.303908    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-252.ec2.internal\" not found"
Jun 11 09:34:33.304453 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.304436    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 11 09:34:33.304613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.304576    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 11 09:34:33.304613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.304614    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 11 09:34:33.304760 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.304683    2561 reconstruct.go:97] "Volume reconstruction finished"
Jun 11 09:34:33.304760 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.304694    2561 reconciler.go:29] "Reconciler: start to sync state"
Jun 11 09:34:33.304849 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.304838    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 11 09:34:33.304903 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.304854    2561 factory.go:55] Registering systemd factory
Jun 11 09:34:33.304903 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.304863    2561 factory.go:223] Registration of the systemd container factory successfully
Jun 11 09:34:33.305122 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.305094    2561 factory.go:153] Registering CRI-O factory
Jun 11 09:34:33.305122 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.305116    2561 factory.go:223] Registration of the crio container factory successfully
Jun 11 09:34:33.305244 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.305138    2561 factory.go:103] Registering Raw factory
Jun 11 09:34:33.305244 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.305154    2561 manager.go:1196] Started watching for new ooms in manager
Jun 11 09:34:33.305559 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.305547    2561 manager.go:349] Starting recovery of all containers
Jun 11 09:34:33.307075 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.307050    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-252.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 11 09:34:33.307196 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.307169    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 11 09:34:33.317411 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.317390    2561 manager.go:354] Recovery completed
Jun 11 09:34:33.318874 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.318857    2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jun 11 09:34:33.321245 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.321227    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5f8nz"
Jun 11 09:34:33.321762 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.321750    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 09:34:33.324391 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.324371    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 09:34:33.324494 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.324409    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 09:34:33.324494 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.324424    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasSufficientPID"
Jun 11 09:34:33.325312 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.325297    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 11 09:34:33.325312 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.325308    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 11 09:34:33.325412 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.325328    2561 state_mem.go:36] "Initialized new in-memory state store"
Jun 11 09:34:33.325412 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.325302    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 09:34:33.326295 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.326265    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 09:34:33.326346 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.326303    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 09:34:33.326346 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.326316    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasSufficientPID"
Jun 11 09:34:33.326520 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.326454    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-252.ec2.internal.18b7fd1bc2ea2ca3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-252.ec2.internal,UID:ip-10-0-138-252.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-252.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-252.ec2.internal,},FirstTimestamp:2026-06-11 09:34:33.324391587 +0000 UTC m=+0.445108234,LastTimestamp:2026-06-11 09:34:33.324391587 +0000 UTC m=+0.445108234,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-252.ec2.internal,}"
Jun 11 09:34:33.326916 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.326903    2561 policy_none.go:49] "None policy: Start"
Jun 11 09:34:33.326975 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.326922    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 11 09:34:33.326975 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.326935    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 11 09:34:33.327948 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.327934    2561 policy_none.go:47] "Start"
Jun 11 09:34:33.329047 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.329032    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5f8nz"
Jun 11 09:34:33.370380 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.370350    2561 manager.go:337] "Starting Device Plugin manager"
Jun 11 09:34:33.374015 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.370450    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 11 09:34:33.374015 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.370466    2561 server.go:87] "Starting device plugin registration server"
Jun 11 09:34:33.374015 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.370778    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 11 09:34:33.374015 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.370790    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 11 09:34:33.374015 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.370859    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 11 09:34:33.374015 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.370976    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 11 09:34:33.374015 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.370986    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 11 09:34:33.374015 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.371054    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 11 09:34:33.374015 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.372544    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 11 09:34:33.374015 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.372582    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 11 09:34:33.374015 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.372619    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 11 09:34:33.374015 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.372657    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 11 09:34:33.374015 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.372654    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 11 09:34:33.374015 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.372707    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-252.ec2.internal\" not found"
Jun 11 09:34:33.375232 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.375208    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 09:34:33.471571 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.471486    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 09:34:33.472819 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.472796    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-252.ec2.internal"]
Jun 11 09:34:33.472900 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.472874    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 09:34:33.472957 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.472928    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 09:34:33.473007 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.472964    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 09:34:33.473007 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.472979    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasSufficientPID"
Jun 11 09:34:33.473007 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.473002    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.476448 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.476429    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 09:34:33.476528 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.476459    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 09:34:33.476528 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.476471    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasSufficientPID"
Jun 11 09:34:33.477650 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.477637    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 09:34:33.477703 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.477691    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.477738 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.477724    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 09:34:33.478943 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.478927    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 09:34:33.479035 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.478957    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 09:34:33.479035 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.478970    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasSufficientPID"
Jun 11 09:34:33.479035 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.478930    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 09:34:33.479035 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.479029    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 09:34:33.479211 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.479039    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasSufficientPID"
Jun 11 09:34:33.480245 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.480229    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.480326 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.480259    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 09:34:33.480963 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.480937    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 09:34:33.481051 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.480966    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 09:34:33.481051 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.480979    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeHasSufficientPID"
Jun 11 09:34:33.482134 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.482119    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.482199 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.482141    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-252.ec2.internal\": node \"ip-10-0-138-252.ec2.internal\" not found"
Jun 11 09:34:33.505385 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.505360    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-252.ec2.internal\" not found"
Jun 11 09:34:33.506390 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.506374    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14939c246b3bf39ed82743c2c00160bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal\" (UID: \"14939c246b3bf39ed82743c2c00160bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.506443 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.506398    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14939c246b3bf39ed82743c2c00160bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal\" (UID: \"14939c246b3bf39ed82743c2c00160bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.506443 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.506423    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac22370277cd46b7ea9e7dd75889a79e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-252.ec2.internal\" (UID: \"ac22370277cd46b7ea9e7dd75889a79e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.511370 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.511353    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-252.ec2.internal\" not found" node="ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.516027 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.516009    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-252.ec2.internal\" not found" node="ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.605760 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.605729    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-252.ec2.internal\" not found"
Jun 11 09:34:33.606869 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.606848    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac22370277cd46b7ea9e7dd75889a79e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-252.ec2.internal\" (UID: \"ac22370277cd46b7ea9e7dd75889a79e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.606957 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.606881    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14939c246b3bf39ed82743c2c00160bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal\" (UID: \"14939c246b3bf39ed82743c2c00160bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.606957 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.606906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14939c246b3bf39ed82743c2c00160bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal\" (UID: \"14939c246b3bf39ed82743c2c00160bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.607054 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.606959    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14939c246b3bf39ed82743c2c00160bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal\" (UID: \"14939c246b3bf39ed82743c2c00160bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.607054 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.606964    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14939c246b3bf39ed82743c2c00160bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal\" (UID: \"14939c246b3bf39ed82743c2c00160bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.607054 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.606969    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac22370277cd46b7ea9e7dd75889a79e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-252.ec2.internal\" (UID: \"ac22370277cd46b7ea9e7dd75889a79e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.705839 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.705802    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-252.ec2.internal\" not found"
Jun 11 09:34:33.806627 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.806580    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-252.ec2.internal\" not found"
Jun 11 09:34:33.816919 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.816891    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.819900 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:33.819872    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-252.ec2.internal"
Jun 11 09:34:33.906702 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:33.906663    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-252.ec2.internal\" not found"
Jun 11 09:34:34.007160 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:34.007135    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-252.ec2.internal\" not found"
Jun 11 09:34:34.107782 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:34.107712    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-252.ec2.internal\" not found"
Jun 11 09:34:34.208444 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:34.208401    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-252.ec2.internal\" not found"
Jun 11 09:34:34.240745 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:34.240716    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 11 09:34:34.241390 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:34.240887    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 11 09:34:34.297974 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:34.297941    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 09:34:34.309410 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:34.309383    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-252.ec2.internal\" not found"
Jun 11 09:34:34.331738 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:34.331679    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 09:29:33 +0000 UTC" deadline="2028-01-03 18:58:47.464960377 +0000 UTC"
Jun 11 09:34:34.331738 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:34.331734    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13713h24m13.133230698s"
Jun 11 09:34:34.365715 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:34.365643    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14939c246b3bf39ed82743c2c00160bc.slice/crio-fd4c2d3686db273893be887595abacf753e5dececa6695df0f6c1fcced1160de WatchSource:0}: Error finding container fd4c2d3686db273893be887595abacf753e5dececa6695df0f6c1fcced1160de: Status 404 returned error can't find the container with id fd4c2d3686db273893be887595abacf753e5dececa6695df0f6c1fcced1160de
Jun 11 09:34:34.367701 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:34.367666    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac22370277cd46b7ea9e7dd75889a79e.slice/crio-5f15fce189db67a98d726e517c696433ddccce423bc23ec554ea34cb7b9c53de WatchSource:0}: Error finding container 5f15fce189db67a98d726e517c696433ddccce423bc23ec554ea34cb7b9c53de: Status 404 returned error can't find the container with id 5f15fce189db67a98d726e517c696433ddccce423bc23ec554ea34cb7b9c53de
Jun 11 09:34:34.371952 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:34.371937    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 11 09:34:34.376352 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:34.376309    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-252.ec2.internal" event={"ID":"ac22370277cd46b7ea9e7dd75889a79e","Type":"ContainerStarted","Data":"5f15fce189db67a98d726e517c696433ddccce423bc23ec554ea34cb7b9c53de"}
Jun 11 09:34:34.377288 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:34.377266    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal" event={"ID":"14939c246b3bf39ed82743c2c00160bc","Type":"ContainerStarted","Data":"fd4c2d3686db273893be887595abacf753e5dececa6695df0f6c1fcced1160de"}
Jun 11 09:34:34.409931 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:34.409899    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-252.ec2.internal\" not found"
Jun 11 09:34:34.510107 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:34.510074    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-252.ec2.internal\" not found"
Jun 11 09:34:34.556697 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:34.556666    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 09:34:34.605012 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:34.604981    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-252.ec2.internal"
Jun 11 09:34:34.636029 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:34.635946    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 11 09:34:34.637096 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:34.637081    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal"
Jun 11 09:34:34.643088 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:34.643073    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 09:34:34.670654 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:34.670625    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 11 09:34:35.283725 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.283689    2561 apiserver.go:52] "Watching apiserver"
Jun 11 09:34:35.294655 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.294619    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 11 09:34:35.296522 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.296496    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-ggzwc","kube-system/global-pull-secret-syncer-tgj2b","kube-system/kube-apiserver-proxy-ip-10-0-138-252.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qwzvt","openshift-multus/multus-95th7","openshift-network-diagnostics/network-check-target-rnwsp","openshift-ovn-kubernetes/ovnkube-node-7zrp8","kube-system/konnectivity-agent-llbqf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc","openshift-dns/node-resolver-lmpvz","openshift-image-registry/node-ca-fmjh8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal","openshift-multus/multus-additional-cni-plugins-2hrr2","openshift-multus/network-metrics-daemon-cfj5p"]
Jun 11 09:34:35.298160 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.298139    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.299513 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.299491    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.300837 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.300787    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:35.300837 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.300807    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 11 09:34:35.300977 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.300850    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j5vp6\""
Jun 11 09:34:35.301210 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.301080    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 11 09:34:35.301210 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.301086    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 11 09:34:35.301210 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:35.301092    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:34:35.301900 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.301687    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 11 09:34:35.301900 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.301711    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 11 09:34:35.301900 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.301710    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 11 09:34:35.301900 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.301747    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 11 09:34:35.301900 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.301815    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 11 09:34:35.302174 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.302028    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-699f2\""
Jun 11 09:34:35.302174 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.302077    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.302174 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.302083    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 11 09:34:35.302321 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.302201    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 11 09:34:35.302956 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.302938    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 11 09:34:35.303819 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.303775    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.304376 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.304361    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 11 09:34:35.305105 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.305010    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:35.305105 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:35.305072    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:34:35.306114 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.306014    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 11 09:34:35.306114 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.306061    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kt48r\""
Jun 11 09:34:35.306304 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.306285    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 11 09:34:35.306399 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.306289    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mpwxh\""
Jun 11 09:34:35.306399 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.306325    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.306399 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.306359    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 11 09:34:35.307466 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.307451    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ggzwc"
Jun 11 09:34:35.308650 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.308631    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:35.308744 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:35.308691    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:34:35.309918 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.309892    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lmpvz"
Jun 11 09:34:35.310436 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.310413    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 11 09:34:35.310548 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.310472    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 11 09:34:35.310769 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.310750    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 11 09:34:35.310769 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.310774    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2lltp\""
Jun 11 09:34:35.310909 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.310847    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4wd48\""
Jun 11 09:34:35.311344 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.311327    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 11 09:34:35.311435 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.311374    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 11 09:34:35.311501 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.311452    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fmjh8"
Jun 11 09:34:35.312890 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.312870    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 11 09:34:35.313039 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.313016    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-llbqf"
Jun 11 09:34:35.313714 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.313628    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 11 09:34:35.316351 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.316329    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 11 09:34:35.316727 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.316711    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mqln4\""
Jun 11 09:34:35.317265 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.317240    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8h888\""
Jun 11 09:34:35.317502 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.317479    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-sys\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.317573 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.317523    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 11 09:34:35.317659 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.317569    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 11 09:34:35.317659 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.317577    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 11 09:34:35.317755 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.317686    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 11 09:34:35.317755 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.317526    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-multus-socket-dir-parent\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.317755 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.317727    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 11 09:34:35.317885 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.317761    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgrdp\" (UniqueName: \"kubernetes.io/projected/dfebb8d0-c009-4be3-9d8a-36100da43c39-kube-api-access-fgrdp\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.317931 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.317877    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-host\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.317931 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.317919    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2862586-aa82-4ee0-9c74-53feb7254237-cni-binary-copy\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.318023 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.317950    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-run-netns\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.318023 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.317973    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-multus-conf-dir\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.318087 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.318061    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfztw\" (UniqueName: \"kubernetes.io/projected/f2862586-aa82-4ee0-9c74-53feb7254237-kube-api-access-lfztw\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.318139 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.318094    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-var-lib-kubelet\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.318139 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.318123    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-var-lib-kubelet\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.318221 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.318147    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-run-openvswitch\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.318263 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.318243    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfebb8d0-c009-4be3-9d8a-36100da43c39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.318313 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.318297    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-kubernetes\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.318367 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.318308    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-25lzh\""
Jun 11 09:34:35.318416 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.318369    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-tuned\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.318416 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.318396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-system-cni-dir\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.318549 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.318531    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-cnibin\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.318743 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.318715    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-slash\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.318792 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.318779    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-cni-netd\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.318840 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.318818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-var-lib-openvswitch\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.318895 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.318879    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.318945 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.318912    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxqp9\" (UniqueName: \"kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9\") pod \"network-check-target-rnwsp\" (UID: \"4a11ac7e-41cc-4546-944a-cf3ad7866a76\") " pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:35.319306 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-log-socket\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.319379 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319318    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ccffbfc-8341-49eb-9082-723d34c5a8bd-ovnkube-script-lib\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.319379 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319335    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttz8b\" (UniqueName: \"kubernetes.io/projected/2ccffbfc-8341-49eb-9082-723d34c5a8bd-kube-api-access-ttz8b\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.319379 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319354    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfebb8d0-c009-4be3-9d8a-36100da43c39-cnibin\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.319379 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319377    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-sysconfig\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.319551 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319414    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-systemd\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.319551 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-run-systemd\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.319551 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319472    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.319551 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319492    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-cni-bin\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.319551 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319506    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ccffbfc-8341-49eb-9082-723d34c5a8bd-ovnkube-config\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.319551 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319520    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-var-lib-cni-bin\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.319816 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319539    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-etc-openvswitch\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.319816 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-tmp\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.319816 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319640    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfebb8d0-c009-4be3-9d8a-36100da43c39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.319816 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319658    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-run\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.319816 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319676    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddkfp\" (UniqueName: \"kubernetes.io/projected/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-kube-api-access-ddkfp\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.319816 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319715    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-hostroot\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.319816 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319740    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-os-release\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.319816 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319761    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2862586-aa82-4ee0-9c74-53feb7254237-multus-daemon-config\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.319816 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-etc-kubernetes\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.319816 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319801    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-systemd-units\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.320203 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319832    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-run-ovn\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.320203 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319854    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ccffbfc-8341-49eb-9082-723d34c5a8bd-ovn-node-metrics-cert\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.320203 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319877    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfebb8d0-c009-4be3-9d8a-36100da43c39-system-cni-dir\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.320203 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319904    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-multus-cni-dir\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.320203 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319934    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-run-multus-certs\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.320203 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.319972    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ccffbfc-8341-49eb-9082-723d34c5a8bd-env-overrides\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.320203 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.320005    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs\") pod \"network-metrics-daemon-cfj5p\" (UID: \"44a3719b-9e55-4619-bb8f-104095970f64\") " pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:35.320203 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.320027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-modprobe-d\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.320203 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.320044    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-sysctl-conf\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.320203 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.320063    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-var-lib-cni-multus\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.320203 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.320085    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfebb8d0-c009-4be3-9d8a-36100da43c39-os-release\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.320203 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.320106    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfebb8d0-c009-4be3-9d8a-36100da43c39-cni-binary-copy\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.320203 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.320132    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qf5b\" (UniqueName: \"kubernetes.io/projected/44a3719b-9e55-4619-bb8f-104095970f64-kube-api-access-2qf5b\") pod \"network-metrics-daemon-cfj5p\" (UID: \"44a3719b-9e55-4619-bb8f-104095970f64\") " pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:35.320203 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.320168    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-sysctl-d\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.320754 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.320202    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfebb8d0-c009-4be3-9d8a-36100da43c39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.320754 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.320232    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-lib-modules\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.320754 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.320273    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-run-k8s-cni-cncf-io\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.320754 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.320303    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-node-log\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.320754 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.320332    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-kubelet\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.320754 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.320436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-run-netns\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.322086 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.322066    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 11 09:34:35.358489 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.358465    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dfnff"
Jun 11 09:34:35.366175 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.366155    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dfnff"
Jun 11 09:34:35.406441 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.406410    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 11 09:34:35.421216 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgrdp\" (UniqueName: \"kubernetes.io/projected/dfebb8d0-c009-4be3-9d8a-36100da43c39-kube-api-access-fgrdp\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.421216 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.421474 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdhtl\" (UniqueName: \"kubernetes.io/projected/b28fa7f8-061b-482e-bfeb-f0e51364c83e-kube-api-access-vdhtl\") pod \"node-resolver-lmpvz\" (UID: \"b28fa7f8-061b-482e-bfeb-f0e51364c83e\") " pod="openshift-dns/node-resolver-lmpvz"
Jun 11 09:34:35.421474 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421259    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-host\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.421474 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421287    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2862586-aa82-4ee0-9c74-53feb7254237-cni-binary-copy\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.421474 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-run-netns\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.421474 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421355    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-multus-conf-dir\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.421474 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421370    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-host\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.421474 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421381    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfztw\" (UniqueName: \"kubernetes.io/projected/f2862586-aa82-4ee0-9c74-53feb7254237-kube-api-access-lfztw\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.421474 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421418    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-run-netns\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.421474 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421441    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b28fa7f8-061b-482e-bfeb-f0e51364c83e-hosts-file\") pod \"node-resolver-lmpvz\" (UID: \"b28fa7f8-061b-482e-bfeb-f0e51364c83e\") " pod="openshift-dns/node-resolver-lmpvz"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421480    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-var-lib-kubelet\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421425    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-multus-conf-dir\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-var-lib-kubelet\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-run-openvswitch\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421560    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-var-lib-kubelet\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421567    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfebb8d0-c009-4be3-9d8a-36100da43c39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421588    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-var-lib-kubelet\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421611    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-kubernetes\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421624    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-run-openvswitch\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421638    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-tuned\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421662    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-system-cni-dir\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421677    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-kubernetes\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-cnibin\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421714    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-slash\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421741    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-cni-netd\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421758    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-system-cni-dir\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421769    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-var-lib-openvswitch\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.421927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421805    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421817    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-var-lib-openvswitch\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret\") pod \"global-pull-secret-syncer-tgj2b\" (UID: \"10ed3813-aabe-4f27-b95e-cdb9121ae64c\") " pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421850    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-cnibin\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421806    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-slash\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421866    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqp9\" (UniqueName: \"kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9\") pod \"network-check-target-rnwsp\" (UID: \"4a11ac7e-41cc-4546-944a-cf3ad7866a76\") " pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421867    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-cni-netd\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-log-socket\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421995    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.421998    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422038    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ccffbfc-8341-49eb-9082-723d34c5a8bd-ovnkube-script-lib\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422055    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2862586-aa82-4ee0-9c74-53feb7254237-cni-binary-copy\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422068    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-log-socket\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422125    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttz8b\" (UniqueName: \"kubernetes.io/projected/2ccffbfc-8341-49eb-9082-723d34c5a8bd-kube-api-access-ttz8b\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422197    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfebb8d0-c009-4be3-9d8a-36100da43c39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422244    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfebb8d0-c009-4be3-9d8a-36100da43c39-cnibin\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422300    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53-host-slash\") pod \"iptables-alerter-ggzwc\" (UID: \"0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53\") " pod="openshift-network-operator/iptables-alerter-ggzwc"
Jun 11 09:34:35.422814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422330    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-sysconfig\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422347    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfebb8d0-c009-4be3-9d8a-36100da43c39-cnibin\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422352    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-systemd\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422394    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-systemd\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422398    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-run-systemd\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422425    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-sysconfig\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422474    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422426    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422502    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-run-systemd\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422519    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-cni-bin\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422549    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ccffbfc-8341-49eb-9082-723d34c5a8bd-ovnkube-config\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422561    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-cni-bin\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422576    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cadd281c-6a46-4e89-b608-ee346f7729ce-serviceca\") pod \"node-ca-fmjh8\" (UID: \"cadd281c-6a46-4e89-b608-ee346f7729ce\") " pod="openshift-image-registry/node-ca-fmjh8"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422617    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-var-lib-cni-bin\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422643    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-etc-openvswitch\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422667    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-device-dir\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422692    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jmck\" (UniqueName: \"kubernetes.io/projected/371e2496-f4cb-46bd-9d8b-24ed36933efc-kube-api-access-6jmck\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.423613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422704    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ccffbfc-8341-49eb-9082-723d34c5a8bd-ovnkube-script-lib\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-tmp\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422741    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-etc-openvswitch\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422735    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-var-lib-cni-bin\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422747    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfebb8d0-c009-4be3-9d8a-36100da43c39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422788    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ebe653ef-f4b8-4c0c-8a90-4ce77aecf4f6-konnectivity-ca\") pod \"konnectivity-agent-llbqf\" (UID: \"ebe653ef-f4b8-4c0c-8a90-4ce77aecf4f6\") " pod="kube-system/konnectivity-agent-llbqf"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422831    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-run\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422856    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddkfp\" (UniqueName: \"kubernetes.io/projected/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-kube-api-access-ddkfp\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-hostroot\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422897    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-run\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422929    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-os-release\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422926    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfebb8d0-c009-4be3-9d8a-36100da43c39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.422973    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-hostroot\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423003    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-os-release\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423024    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2862586-aa82-4ee0-9c74-53feb7254237-multus-daemon-config\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423063    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ccffbfc-8341-49eb-9082-723d34c5a8bd-ovnkube-config\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-etc-kubernetes\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423113    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-systemd-units\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.424394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423127    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-etc-kubernetes\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423155    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-run-ovn\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423177    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-systemd-units\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ccffbfc-8341-49eb-9082-723d34c5a8bd-ovn-node-metrics-cert\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423221    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-run-ovn\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfebb8d0-c009-4be3-9d8a-36100da43c39-system-cni-dir\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ebe653ef-f4b8-4c0c-8a90-4ce77aecf4f6-agent-certs\") pod \"konnectivity-agent-llbqf\" (UID: \"ebe653ef-f4b8-4c0c-8a90-4ce77aecf4f6\") " pod="kube-system/konnectivity-agent-llbqf"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423277    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfebb8d0-c009-4be3-9d8a-36100da43c39-system-cni-dir\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-multus-cni-dir\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-run-multus-certs\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ccffbfc-8341-49eb-9082-723d34c5a8bd-env-overrides\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423413    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs\") pod \"network-metrics-daemon-cfj5p\" (UID: \"44a3719b-9e55-4619-bb8f-104095970f64\") " pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423436    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-run-multus-certs\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423437    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-multus-cni-dir\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423440    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-sys-fs\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423512    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10ed3813-aabe-4f27-b95e-cdb9121ae64c-dbus\") pod \"global-pull-secret-syncer-tgj2b\" (UID: \"10ed3813-aabe-4f27-b95e-cdb9121ae64c\") " pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:35.423585    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423644    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b28fa7f8-061b-482e-bfeb-f0e51364c83e-tmp-dir\") pod \"node-resolver-lmpvz\" (UID: \"b28fa7f8-061b-482e-bfeb-f0e51364c83e\") " pod="openshift-dns/node-resolver-lmpvz"
Jun 11 09:34:35.425225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423785    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ccffbfc-8341-49eb-9082-723d34c5a8bd-env-overrides\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.426028 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:35.423895    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs podName:44a3719b-9e55-4619-bb8f-104095970f64 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:35.923858433 +0000 UTC m=+3.044575098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs") pod "network-metrics-daemon-cfj5p" (UID: "44a3719b-9e55-4619-bb8f-104095970f64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 09:34:35.426028 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cadd281c-6a46-4e89-b608-ee346f7729ce-host\") pod \"node-ca-fmjh8\" (UID: \"cadd281c-6a46-4e89-b608-ee346f7729ce\") " pod="openshift-image-registry/node-ca-fmjh8"
Jun 11 09:34:35.426028 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.423976    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-modprobe-d\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.426028 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424021    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-sysctl-conf\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.426028 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424048    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-var-lib-cni-multus\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.426028 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424072    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfebb8d0-c009-4be3-9d8a-36100da43c39-os-release\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.426028 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfebb8d0-c009-4be3-9d8a-36100da43c39-cni-binary-copy\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.426028 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424128    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-modprobe-d\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.426028 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qf5b\" (UniqueName: \"kubernetes.io/projected/44a3719b-9e55-4619-bb8f-104095970f64-kube-api-access-2qf5b\") pod \"network-metrics-daemon-cfj5p\" (UID: \"44a3719b-9e55-4619-bb8f-104095970f64\") " pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:35.426028 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10ed3813-aabe-4f27-b95e-cdb9121ae64c-kubelet-config\") pod \"global-pull-secret-syncer-tgj2b\" (UID: \"10ed3813-aabe-4f27-b95e-cdb9121ae64c\") " pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:35.426028 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424190    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-sysctl-d\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.426028 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424202    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfebb8d0-c009-4be3-9d8a-36100da43c39-os-release\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.426028 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424214    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfebb8d0-c009-4be3-9d8a-36100da43c39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.426028 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424240    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slxnq\" (UniqueName: \"kubernetes.io/projected/cadd281c-6a46-4e89-b608-ee346f7729ce-kube-api-access-slxnq\") pod \"node-ca-fmjh8\" (UID: \"cadd281c-6a46-4e89-b608-ee346f7729ce\") " pod="openshift-image-registry/node-ca-fmjh8"
Jun 11 09:34:35.426028 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424264    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53-iptables-alerter-script\") pod \"iptables-alerter-ggzwc\" (UID: \"0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53\") " pod="openshift-network-operator/iptables-alerter-ggzwc"
Jun 11 09:34:35.426028 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-lib-modules\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424298    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-sysctl-conf\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424310    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-run-k8s-cni-cncf-io\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-node-log\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424341    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-var-lib-cni-multus\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424350    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-socket-dir\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424372    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-registration-dir\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424395    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4vqs\" (UniqueName: \"kubernetes.io/projected/0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53-kube-api-access-d4vqs\") pod \"iptables-alerter-ggzwc\" (UID: \"0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53\") " pod="openshift-network-operator/iptables-alerter-ggzwc"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424423    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-kubelet\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424420    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-host-run-k8s-cni-cncf-io\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424451    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-run-netns\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424493    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-etc-selinux\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424517    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-sys\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424540    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-multus-socket-dir-parent\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424651    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2862586-aa82-4ee0-9c74-53feb7254237-multus-socket-dir-parent\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424696    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-node-log\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424865    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfebb8d0-c009-4be3-9d8a-36100da43c39-cni-binary-copy\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.426623 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.424372    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-sysctl-d\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.427185 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.425025    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-lib-modules\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.427185 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.425124    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-run-netns\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.427185 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.425133    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-sys\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.427185 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.425169    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ccffbfc-8341-49eb-9082-723d34c5a8bd-host-kubelet\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.427185 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.425168    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfebb8d0-c009-4be3-9d8a-36100da43c39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.427185 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.425432    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2862586-aa82-4ee0-9c74-53feb7254237-multus-daemon-config\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.427185 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.426134    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-tmp\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.427185 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.426198    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-etc-tuned\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.427185 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.426331    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ccffbfc-8341-49eb-9082-723d34c5a8bd-ovn-node-metrics-cert\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.438574 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:35.438548    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 09:34:35.438730 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:35.438584    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 09:34:35.438730 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:35.438634    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gxqp9 for pod openshift-network-diagnostics/network-check-target-rnwsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 09:34:35.438730 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.438679    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgrdp\" (UniqueName: \"kubernetes.io/projected/dfebb8d0-c009-4be3-9d8a-36100da43c39-kube-api-access-fgrdp\") pod \"multus-additional-cni-plugins-2hrr2\" (UID: \"dfebb8d0-c009-4be3-9d8a-36100da43c39\") " pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.438730 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:35.438720    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9 podName:4a11ac7e-41cc-4546-944a-cf3ad7866a76 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:35.938702142 +0000 UTC m=+3.059418784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gxqp9" (UniqueName: "kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9") pod "network-check-target-rnwsp" (UID: "4a11ac7e-41cc-4546-944a-cf3ad7866a76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 09:34:35.440617 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.440575    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfztw\" (UniqueName: \"kubernetes.io/projected/f2862586-aa82-4ee0-9c74-53feb7254237-kube-api-access-lfztw\") pod \"multus-95th7\" (UID: \"f2862586-aa82-4ee0-9c74-53feb7254237\") " pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.442443 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.442420    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttz8b\" (UniqueName: \"kubernetes.io/projected/2ccffbfc-8341-49eb-9082-723d34c5a8bd-kube-api-access-ttz8b\") pod \"ovnkube-node-7zrp8\" (UID: \"2ccffbfc-8341-49eb-9082-723d34c5a8bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.442540 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.442509    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qf5b\" (UniqueName: \"kubernetes.io/projected/44a3719b-9e55-4619-bb8f-104095970f64-kube-api-access-2qf5b\") pod \"network-metrics-daemon-cfj5p\" (UID: \"44a3719b-9e55-4619-bb8f-104095970f64\") " pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:35.442702 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.442680    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddkfp\" (UniqueName: \"kubernetes.io/projected/80146ee6-1a7c-414a-bac3-d48cdf1ecc8a-kube-api-access-ddkfp\") pod \"tuned-qwzvt\" (UID: \"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.488938 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.488909    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 09:34:35.525706 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.525667    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret\") pod \"global-pull-secret-syncer-tgj2b\" (UID: \"10ed3813-aabe-4f27-b95e-cdb9121ae64c\") " pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:35.525873 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.525725    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53-host-slash\") pod \"iptables-alerter-ggzwc\" (UID: \"0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53\") " pod="openshift-network-operator/iptables-alerter-ggzwc"
Jun 11 09:34:35.525873 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.525755    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cadd281c-6a46-4e89-b608-ee346f7729ce-serviceca\") pod \"node-ca-fmjh8\" (UID: \"cadd281c-6a46-4e89-b608-ee346f7729ce\") " pod="openshift-image-registry/node-ca-fmjh8"
Jun 11 09:34:35.525873 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.525775    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-device-dir\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.525873 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.525791    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jmck\" (UniqueName: \"kubernetes.io/projected/371e2496-f4cb-46bd-9d8b-24ed36933efc-kube-api-access-6jmck\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.525873 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.525817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ebe653ef-f4b8-4c0c-8a90-4ce77aecf4f6-konnectivity-ca\") pod \"konnectivity-agent-llbqf\" (UID: \"ebe653ef-f4b8-4c0c-8a90-4ce77aecf4f6\") " pod="kube-system/konnectivity-agent-llbqf"
Jun 11 09:34:35.525873 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.525846    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ebe653ef-f4b8-4c0c-8a90-4ce77aecf4f6-agent-certs\") pod \"konnectivity-agent-llbqf\" (UID: \"ebe653ef-f4b8-4c0c-8a90-4ce77aecf4f6\") " pod="kube-system/konnectivity-agent-llbqf"
Jun 11 09:34:35.525873 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:35.525856    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.525880    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-sys-fs\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.525902    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10ed3813-aabe-4f27-b95e-cdb9121ae64c-dbus\") pod \"global-pull-secret-syncer-tgj2b\" (UID: \"10ed3813-aabe-4f27-b95e-cdb9121ae64c\") " pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.525927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b28fa7f8-061b-482e-bfeb-f0e51364c83e-tmp-dir\") pod \"node-resolver-lmpvz\" (UID: \"b28fa7f8-061b-482e-bfeb-f0e51364c83e\") " pod="openshift-dns/node-resolver-lmpvz"
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.525948    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cadd281c-6a46-4e89-b608-ee346f7729ce-host\") pod \"node-ca-fmjh8\" (UID: \"cadd281c-6a46-4e89-b608-ee346f7729ce\") " pod="openshift-image-registry/node-ca-fmjh8"
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.525943    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-device-dir\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.525976    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10ed3813-aabe-4f27-b95e-cdb9121ae64c-kubelet-config\") pod \"global-pull-secret-syncer-tgj2b\" (UID: \"10ed3813-aabe-4f27-b95e-cdb9121ae64c\") " pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slxnq\" (UniqueName: \"kubernetes.io/projected/cadd281c-6a46-4e89-b608-ee346f7729ce-kube-api-access-slxnq\") pod \"node-ca-fmjh8\" (UID: \"cadd281c-6a46-4e89-b608-ee346f7729ce\") " pod="openshift-image-registry/node-ca-fmjh8"
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526004    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53-host-slash\") pod \"iptables-alerter-ggzwc\" (UID: \"0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53\") " pod="openshift-network-operator/iptables-alerter-ggzwc"
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526028    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53-iptables-alerter-script\") pod \"iptables-alerter-ggzwc\" (UID: \"0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53\") " pod="openshift-network-operator/iptables-alerter-ggzwc"
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526055    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-socket-dir\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526078    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-registration-dir\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526102    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4vqs\" (UniqueName: \"kubernetes.io/projected/0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53-kube-api-access-d4vqs\") pod \"iptables-alerter-ggzwc\" (UID: \"0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53\") " pod="openshift-network-operator/iptables-alerter-ggzwc"
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526129    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-etc-selinux\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526155    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526165    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cadd281c-6a46-4e89-b608-ee346f7729ce-host\") pod \"node-ca-fmjh8\" (UID: \"cadd281c-6a46-4e89-b608-ee346f7729ce\") " pod="openshift-image-registry/node-ca-fmjh8"
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdhtl\" (UniqueName: \"kubernetes.io/projected/b28fa7f8-061b-482e-bfeb-f0e51364c83e-kube-api-access-vdhtl\") pod \"node-resolver-lmpvz\" (UID: \"b28fa7f8-061b-482e-bfeb-f0e51364c83e\") " pod="openshift-dns/node-resolver-lmpvz"
Jun 11 09:34:35.526207 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b28fa7f8-061b-482e-bfeb-f0e51364c83e-hosts-file\") pod \"node-resolver-lmpvz\" (UID: \"b28fa7f8-061b-482e-bfeb-f0e51364c83e\") " pod="openshift-dns/node-resolver-lmpvz"
Jun 11 09:34:35.527010 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526314    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cadd281c-6a46-4e89-b608-ee346f7729ce-serviceca\") pod \"node-ca-fmjh8\" (UID: \"cadd281c-6a46-4e89-b608-ee346f7729ce\") " pod="openshift-image-registry/node-ca-fmjh8"
Jun 11 09:34:35.527010 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526432    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-etc-selinux\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.527010 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526434    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-socket-dir\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.527010 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526481    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.527010 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526498    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10ed3813-aabe-4f27-b95e-cdb9121ae64c-kubelet-config\") pod \"global-pull-secret-syncer-tgj2b\" (UID: \"10ed3813-aabe-4f27-b95e-cdb9121ae64c\") " pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:35.527010 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526498    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ebe653ef-f4b8-4c0c-8a90-4ce77aecf4f6-konnectivity-ca\") pod \"konnectivity-agent-llbqf\" (UID: \"ebe653ef-f4b8-4c0c-8a90-4ce77aecf4f6\") " pod="kube-system/konnectivity-agent-llbqf"
Jun 11 09:34:35.527010 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526548    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-registration-dir\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.527010 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:35.526618    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret podName:10ed3813-aabe-4f27-b95e-cdb9121ae64c nodeName:}" failed. No retries permitted until 2026-06-11 09:34:36.026582302 +0000 UTC m=+3.147298928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret") pod "global-pull-secret-syncer-tgj2b" (UID: "10ed3813-aabe-4f27-b95e-cdb9121ae64c") : object "kube-system"/"original-pull-secret" not registered
Jun 11 09:34:35.527010 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526626    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10ed3813-aabe-4f27-b95e-cdb9121ae64c-dbus\") pod \"global-pull-secret-syncer-tgj2b\" (UID: \"10ed3813-aabe-4f27-b95e-cdb9121ae64c\") " pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:35.527010 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526679    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b28fa7f8-061b-482e-bfeb-f0e51364c83e-hosts-file\") pod \"node-resolver-lmpvz\" (UID: \"b28fa7f8-061b-482e-bfeb-f0e51364c83e\") " pod="openshift-dns/node-resolver-lmpvz"
Jun 11 09:34:35.527010 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526680    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/371e2496-f4cb-46bd-9d8b-24ed36933efc-sys-fs\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.527010 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526847    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b28fa7f8-061b-482e-bfeb-f0e51364c83e-tmp-dir\") pod \"node-resolver-lmpvz\" (UID: \"b28fa7f8-061b-482e-bfeb-f0e51364c83e\") " pod="openshift-dns/node-resolver-lmpvz"
Jun 11 09:34:35.527010 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.526861    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53-iptables-alerter-script\") pod \"iptables-alerter-ggzwc\" (UID: \"0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53\") " pod="openshift-network-operator/iptables-alerter-ggzwc"
Jun 11 09:34:35.528934 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.528913    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ebe653ef-f4b8-4c0c-8a90-4ce77aecf4f6-agent-certs\") pod \"konnectivity-agent-llbqf\" (UID: \"ebe653ef-f4b8-4c0c-8a90-4ce77aecf4f6\") " pod="kube-system/konnectivity-agent-llbqf"
Jun 11 09:34:35.540032 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.539946    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jmck\" (UniqueName: \"kubernetes.io/projected/371e2496-f4cb-46bd-9d8b-24ed36933efc-kube-api-access-6jmck\") pod \"aws-ebs-csi-driver-node-5lxsc\" (UID: \"371e2496-f4cb-46bd-9d8b-24ed36933efc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.542296 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.542272    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4vqs\" (UniqueName: \"kubernetes.io/projected/0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53-kube-api-access-d4vqs\") pod \"iptables-alerter-ggzwc\" (UID: \"0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53\") " pod="openshift-network-operator/iptables-alerter-ggzwc"
Jun 11 09:34:35.542631 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.542614    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdhtl\" (UniqueName: \"kubernetes.io/projected/b28fa7f8-061b-482e-bfeb-f0e51364c83e-kube-api-access-vdhtl\") pod \"node-resolver-lmpvz\" (UID: \"b28fa7f8-061b-482e-bfeb-f0e51364c83e\") " pod="openshift-dns/node-resolver-lmpvz"
Jun 11 09:34:35.543891 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.543870    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slxnq\" (UniqueName: \"kubernetes.io/projected/cadd281c-6a46-4e89-b608-ee346f7729ce-kube-api-access-slxnq\") pod \"node-ca-fmjh8\" (UID: \"cadd281c-6a46-4e89-b608-ee346f7729ce\") " pod="openshift-image-registry/node-ca-fmjh8"
Jun 11 09:34:35.609699 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.609663    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:35.617535 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.617514    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2hrr2"
Jun 11 09:34:35.627425 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.627394    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qwzvt"
Jun 11 09:34:35.631765 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.631749    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-95th7"
Jun 11 09:34:35.638254 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.638233    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc"
Jun 11 09:34:35.645661 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.645645    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ggzwc"
Jun 11 09:34:35.652993 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.652977    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lmpvz"
Jun 11 09:34:35.658251 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.658237    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fmjh8"
Jun 11 09:34:35.664632 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.664616    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-llbqf"
Jun 11 09:34:35.929775 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:35.929658    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs\") pod \"network-metrics-daemon-cfj5p\" (UID: \"44a3719b-9e55-4619-bb8f-104095970f64\") " pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:35.929920 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:35.929788    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 09:34:35.929920 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:35.929878    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs podName:44a3719b-9e55-4619-bb8f-104095970f64 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:36.929852605 +0000 UTC m=+4.050569253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs") pod "network-metrics-daemon-cfj5p" (UID: "44a3719b-9e55-4619-bb8f-104095970f64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 09:34:36.030352 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:36.030314    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret\") pod \"global-pull-secret-syncer-tgj2b\" (UID: \"10ed3813-aabe-4f27-b95e-cdb9121ae64c\") " pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:36.030352 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:36.030355    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqp9\" (UniqueName: \"kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9\") pod \"network-check-target-rnwsp\" (UID: \"4a11ac7e-41cc-4546-944a-cf3ad7866a76\") " pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:36.030587 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:36.030468    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 09:34:36.030587 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:36.030499    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 09:34:36.030587 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:36.030513    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 09:34:36.030587 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:36.030526    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gxqp9 for pod openshift-network-diagnostics/network-check-target-rnwsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 09:34:36.030587 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:36.030539    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret podName:10ed3813-aabe-4f27-b95e-cdb9121ae64c nodeName:}" failed. No retries permitted until 2026-06-11 09:34:37.030519758 +0000 UTC m=+4.151236402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret") pod "global-pull-secret-syncer-tgj2b" (UID: "10ed3813-aabe-4f27-b95e-cdb9121ae64c") : object "kube-system"/"original-pull-secret" not registered
Jun 11 09:34:36.030587 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:36.030567    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9 podName:4a11ac7e-41cc-4546-944a-cf3ad7866a76 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:37.030556031 +0000 UTC m=+4.151272669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gxqp9" (UniqueName: "kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9") pod "network-check-target-rnwsp" (UID: "4a11ac7e-41cc-4546-944a-cf3ad7866a76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 09:34:36.213632 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:36.213586    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80146ee6_1a7c_414a_bac3_d48cdf1ecc8a.slice/crio-88dd4a1b88fe521b99790093ce7a28aa73f7e6d108138434e83da90c3a1987ce WatchSource:0}: Error finding container 88dd4a1b88fe521b99790093ce7a28aa73f7e6d108138434e83da90c3a1987ce: Status 404 returned error can't find the container with id 88dd4a1b88fe521b99790093ce7a28aa73f7e6d108138434e83da90c3a1987ce
Jun 11 09:34:36.214825 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:36.214770    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe653ef_f4b8_4c0c_8a90_4ce77aecf4f6.slice/crio-aaab4144a9994d05830540f4d8f694854f524fab366cf9c3105509091c6c5307 WatchSource:0}: Error finding container aaab4144a9994d05830540f4d8f694854f524fab366cf9c3105509091c6c5307: Status 404 returned error can't find the container with id aaab4144a9994d05830540f4d8f694854f524fab366cf9c3105509091c6c5307
Jun 11 09:34:36.217992 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:36.217970    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2862586_aa82_4ee0_9c74_53feb7254237.slice/crio-c50c75863354f46543acc36e0f1813b0d4cd7907cc8994c85bdcbb631120fd76 WatchSource:0}: Error finding container c50c75863354f46543acc36e0f1813b0d4cd7907cc8994c85bdcbb631120fd76: Status 404 returned error can't find the container with id c50c75863354f46543acc36e0f1813b0d4cd7907cc8994c85bdcbb631120fd76
Jun 11 09:34:36.219211 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:36.219188    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b5d3f03_bc6f_4a5f_abb0_b8ab6fa69b53.slice/crio-544e76aa548e40453a85f762a7af51389d5b02ea9bbacf721f7c6e870a775d3e WatchSource:0}: Error finding container 544e76aa548e40453a85f762a7af51389d5b02ea9bbacf721f7c6e870a775d3e: Status 404 returned error can't find the container with id 544e76aa548e40453a85f762a7af51389d5b02ea9bbacf721f7c6e870a775d3e
Jun 11 09:34:36.220126 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:36.220089    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ccffbfc_8341_49eb_9082_723d34c5a8bd.slice/crio-f4fb3ad471661193a449dbf8048b7b7024983ad3237ad711feac5ef49bcc54bd WatchSource:0}: Error finding container f4fb3ad471661193a449dbf8048b7b7024983ad3237ad711feac5ef49bcc54bd: Status 404 returned error can't find the container with id f4fb3ad471661193a449dbf8048b7b7024983ad3237ad711feac5ef49bcc54bd
Jun 11 09:34:36.221922 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:36.221741    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28fa7f8_061b_482e_bfeb_f0e51364c83e.slice/crio-d83d6a6b467a5542b76ebf52cdbf5b233f083e734b333d458b1a40db868d409a WatchSource:0}: Error finding container d83d6a6b467a5542b76ebf52cdbf5b233f083e734b333d458b1a40db868d409a: Status 404 returned error can't find the container with id d83d6a6b467a5542b76ebf52cdbf5b233f083e734b333d458b1a40db868d409a
Jun 11 09:34:36.223021 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:36.222998    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371e2496_f4cb_46bd_9d8b_24ed36933efc.slice/crio-1c5f99a6a3c460b5538c0e8237dc8da16d70c3d44e431efdc1d8e4d3d46ebae0 WatchSource:0}: Error finding container 1c5f99a6a3c460b5538c0e8237dc8da16d70c3d44e431efdc1d8e4d3d46ebae0: Status 404 returned error can't find the container with id 1c5f99a6a3c460b5538c0e8237dc8da16d70c3d44e431efdc1d8e4d3d46ebae0
Jun 11 09:34:36.223433 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:36.223410    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcadd281c_6a46_4e89_b608_ee346f7729ce.slice/crio-e4619e43a8c06e49d37ab2262d3675ad08ff93f17df4dd6debbf3fb8b80257d3 WatchSource:0}: Error finding container e4619e43a8c06e49d37ab2262d3675ad08ff93f17df4dd6debbf3fb8b80257d3: Status 404 returned error can't find the container with id e4619e43a8c06e49d37ab2262d3675ad08ff93f17df4dd6debbf3fb8b80257d3
Jun 11 09:34:36.224175 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:34:36.224082    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfebb8d0_c009_4be3_9d8a_36100da43c39.slice/crio-b91f2d0faee33334710a33c97ae69a6f86d2cd68afcc1f5753b287da97ae9ec2 WatchSource:0}: Error finding container b91f2d0faee33334710a33c97ae69a6f86d2cd68afcc1f5753b287da97ae9ec2: Status 404 returned error can't find the container with id b91f2d0faee33334710a33c97ae69a6f86d2cd68afcc1f5753b287da97ae9ec2
Jun 11 09:34:36.367924 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:36.367860    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 09:29:35 +0000 UTC" deadline="2028-03-25 21:09:02.059056904 +0000 UTC"
Jun 11 09:34:36.367924 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:36.367893    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15683h34m25.691168343s"
Jun 11 09:34:36.382975 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:36.382935    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8" event={"ID":"2ccffbfc-8341-49eb-9082-723d34c5a8bd","Type":"ContainerStarted","Data":"f4fb3ad471661193a449dbf8048b7b7024983ad3237ad711feac5ef49bcc54bd"}
Jun 11 09:34:36.384073 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:36.384047    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-95th7" event={"ID":"f2862586-aa82-4ee0-9c74-53feb7254237","Type":"ContainerStarted","Data":"c50c75863354f46543acc36e0f1813b0d4cd7907cc8994c85bdcbb631120fd76"}
Jun 11 09:34:36.385093 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:36.385070    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-llbqf" event={"ID":"ebe653ef-f4b8-4c0c-8a90-4ce77aecf4f6","Type":"ContainerStarted","Data":"aaab4144a9994d05830540f4d8f694854f524fab366cf9c3105509091c6c5307"}
Jun 11 09:34:36.387078 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:36.387055    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-252.ec2.internal" event={"ID":"ac22370277cd46b7ea9e7dd75889a79e","Type":"ContainerStarted","Data":"00ffcdce83b2815939c361d2f118de2b0aa0be143e6c1044df61200578a0efc0"}
Jun 11 09:34:36.390586 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:36.388473    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ggzwc" event={"ID":"0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53","Type":"ContainerStarted","Data":"544e76aa548e40453a85f762a7af51389d5b02ea9bbacf721f7c6e870a775d3e"}
Jun 11 09:34:36.392068 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:36.392045    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hrr2" event={"ID":"dfebb8d0-c009-4be3-9d8a-36100da43c39","Type":"ContainerStarted","Data":"b91f2d0faee33334710a33c97ae69a6f86d2cd68afcc1f5753b287da97ae9ec2"}
Jun 11 09:34:36.393129 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:36.393107    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fmjh8" event={"ID":"cadd281c-6a46-4e89-b608-ee346f7729ce","Type":"ContainerStarted","Data":"e4619e43a8c06e49d37ab2262d3675ad08ff93f17df4dd6debbf3fb8b80257d3"}
Jun 11 09:34:36.393984 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:36.393966    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc" event={"ID":"371e2496-f4cb-46bd-9d8b-24ed36933efc","Type":"ContainerStarted","Data":"1c5f99a6a3c460b5538c0e8237dc8da16d70c3d44e431efdc1d8e4d3d46ebae0"}
Jun 11 09:34:36.395867 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:36.395847    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lmpvz" event={"ID":"b28fa7f8-061b-482e-bfeb-f0e51364c83e","Type":"ContainerStarted","Data":"d83d6a6b467a5542b76ebf52cdbf5b233f083e734b333d458b1a40db868d409a"}
Jun 11 09:34:36.397410 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:36.397390    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qwzvt" event={"ID":"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a","Type":"ContainerStarted","Data":"88dd4a1b88fe521b99790093ce7a28aa73f7e6d108138434e83da90c3a1987ce"}
Jun 11 09:34:36.402669 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:36.402631    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-252.ec2.internal" podStartSLOduration=2.402619536 podStartE2EDuration="2.402619536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:36.402420713 +0000 UTC m=+3.523137375" watchObservedRunningTime="2026-06-11 09:34:36.402619536 +0000 UTC m=+3.523336170"
Jun 11 09:34:36.938110 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:36.938066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs\") pod \"network-metrics-daemon-cfj5p\" (UID: \"44a3719b-9e55-4619-bb8f-104095970f64\") " pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:36.938311 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:36.938277    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 09:34:36.938374 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:36.938343    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs podName:44a3719b-9e55-4619-bb8f-104095970f64 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:38.938324608 +0000 UTC m=+6.059041231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs") pod "network-metrics-daemon-cfj5p" (UID: "44a3719b-9e55-4619-bb8f-104095970f64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 09:34:37.040102 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:37.039215    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret\") pod \"global-pull-secret-syncer-tgj2b\" (UID: \"10ed3813-aabe-4f27-b95e-cdb9121ae64c\") " pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:37.040102 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:37.039269    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqp9\" (UniqueName: \"kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9\") pod \"network-check-target-rnwsp\" (UID: \"4a11ac7e-41cc-4546-944a-cf3ad7866a76\") " pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:37.040102 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:37.039456    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 09:34:37.040102 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:37.039483    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 09:34:37.040102 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:37.039496    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gxqp9 for pod openshift-network-diagnostics/network-check-target-rnwsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 09:34:37.040102 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:37.039559    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9 podName:4a11ac7e-41cc-4546-944a-cf3ad7866a76 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:39.039539944 +0000 UTC m=+6.160256589 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gxqp9" (UniqueName: "kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9") pod "network-check-target-rnwsp" (UID: "4a11ac7e-41cc-4546-944a-cf3ad7866a76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 09:34:37.040102 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:37.039980    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 09:34:37.040102 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:37.040033    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret podName:10ed3813-aabe-4f27-b95e-cdb9121ae64c nodeName:}" failed. No retries permitted until 2026-06-11 09:34:39.040017314 +0000 UTC m=+6.160733950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret") pod "global-pull-secret-syncer-tgj2b" (UID: "10ed3813-aabe-4f27-b95e-cdb9121ae64c") : object "kube-system"/"original-pull-secret" not registered
Jun 11 09:34:37.368135 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:37.368067    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 09:29:35 +0000 UTC" deadline="2028-01-10 00:42:04.031891884 +0000 UTC"
Jun 11 09:34:37.368135 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:37.368132    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13863h7m26.663764277s"
Jun 11 09:34:37.375888 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:37.375862    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:37.376024 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:37.375996    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:34:37.376429 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:37.376408    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:37.376552 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:37.376524    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:34:37.376638 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:37.376620    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:37.376707 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:37.376689    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:34:37.410307 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:37.410255    2561 generic.go:356] "Generic (PLEG): container finished" podID="14939c246b3bf39ed82743c2c00160bc" containerID="37a7254a0989bcc98adff834fbf7488feaa4109c6299b0af1cada4999c84c7be" exitCode=0
Jun 11 09:34:37.411280 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:37.411252    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal" event={"ID":"14939c246b3bf39ed82743c2c00160bc","Type":"ContainerDied","Data":"37a7254a0989bcc98adff834fbf7488feaa4109c6299b0af1cada4999c84c7be"}
Jun 11 09:34:38.432358 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:38.431578    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal" event={"ID":"14939c246b3bf39ed82743c2c00160bc","Type":"ContainerStarted","Data":"b6e273ef81da2fdd87d7968c71b0e7c11cc7f3466a693f191f235aa62dcb0ad0"}
Jun 11 09:34:38.958151 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:38.958107    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs\") pod \"network-metrics-daemon-cfj5p\" (UID: \"44a3719b-9e55-4619-bb8f-104095970f64\") " pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:38.958340 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:38.958273    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 09:34:38.958340 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:38.958336    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs podName:44a3719b-9e55-4619-bb8f-104095970f64 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:42.95831569 +0000 UTC m=+10.079032315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs") pod "network-metrics-daemon-cfj5p" (UID: "44a3719b-9e55-4619-bb8f-104095970f64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 09:34:39.059240 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:39.059199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret\") pod \"global-pull-secret-syncer-tgj2b\" (UID: \"10ed3813-aabe-4f27-b95e-cdb9121ae64c\") " pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:39.059431 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:39.059255    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqp9\" (UniqueName: \"kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9\") pod \"network-check-target-rnwsp\" (UID: \"4a11ac7e-41cc-4546-944a-cf3ad7866a76\") " pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:39.059493 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:39.059445    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 09:34:39.059493 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:39.059466    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 09:34:39.059493 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:39.059480    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gxqp9 for pod openshift-network-diagnostics/network-check-target-rnwsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 09:34:39.059704 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:39.059540    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9 podName:4a11ac7e-41cc-4546-944a-cf3ad7866a76 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:43.059520193 +0000 UTC m=+10.180236815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gxqp9" (UniqueName: "kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9") pod "network-check-target-rnwsp" (UID: "4a11ac7e-41cc-4546-944a-cf3ad7866a76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 09:34:39.060054 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:39.059953    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 09:34:39.060054 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:39.060012    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret podName:10ed3813-aabe-4f27-b95e-cdb9121ae64c nodeName:}" failed. No retries permitted until 2026-06-11 09:34:43.059994933 +0000 UTC m=+10.180711555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret") pod "global-pull-secret-syncer-tgj2b" (UID: "10ed3813-aabe-4f27-b95e-cdb9121ae64c") : object "kube-system"/"original-pull-secret" not registered
Jun 11 09:34:39.374109 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:39.373701    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:39.374109 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:39.373734    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:39.374109 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:39.373701    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:39.374109 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:39.373866    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:34:39.374109 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:39.373985    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:34:39.374109 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:39.374084    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:34:41.373195 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:41.373157    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:41.373690 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:41.373209    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:41.373690 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:41.373175    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:41.373690 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:41.373306    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:34:41.373690 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:41.373409    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:34:41.373690 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:41.373509    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:34:42.995199 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:42.994634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs\") pod \"network-metrics-daemon-cfj5p\" (UID: \"44a3719b-9e55-4619-bb8f-104095970f64\") " pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:42.995199 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:42.994797    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 09:34:42.995199 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:42.994871    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs podName:44a3719b-9e55-4619-bb8f-104095970f64 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:50.994847634 +0000 UTC m=+18.115564259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs") pod "network-metrics-daemon-cfj5p" (UID: "44a3719b-9e55-4619-bb8f-104095970f64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 09:34:43.096009 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:43.095590    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret\") pod \"global-pull-secret-syncer-tgj2b\" (UID: \"10ed3813-aabe-4f27-b95e-cdb9121ae64c\") " pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:43.096009 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:43.095659    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqp9\" (UniqueName: \"kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9\") pod \"network-check-target-rnwsp\" (UID: \"4a11ac7e-41cc-4546-944a-cf3ad7866a76\") " pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:43.096009 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:43.095774    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 09:34:43.096009 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:43.095792    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 09:34:43.096009 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:43.095810    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 09:34:43.096009 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:43.095824    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gxqp9 for pod openshift-network-diagnostics/network-check-target-rnwsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 09:34:43.096009 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:43.095858    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret podName:10ed3813-aabe-4f27-b95e-cdb9121ae64c nodeName:}" failed. No retries permitted until 2026-06-11 09:34:51.095835422 +0000 UTC m=+18.216552047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret") pod "global-pull-secret-syncer-tgj2b" (UID: "10ed3813-aabe-4f27-b95e-cdb9121ae64c") : object "kube-system"/"original-pull-secret" not registered
Jun 11 09:34:43.096009 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:43.095878    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9 podName:4a11ac7e-41cc-4546-944a-cf3ad7866a76 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:51.095868141 +0000 UTC m=+18.216584776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gxqp9" (UniqueName: "kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9") pod "network-check-target-rnwsp" (UID: "4a11ac7e-41cc-4546-944a-cf3ad7866a76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 09:34:43.374751 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:43.374102    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:43.374751 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:43.374227    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:34:43.374751 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:43.374725    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:43.375004 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:43.374814    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:34:43.375541 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:43.375399    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:43.375541 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:43.375502    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:34:45.373729 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:45.373569    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:45.373729 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:45.373569    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:45.373729 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:45.373625    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:45.373729 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:45.373723    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:34:45.374322 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:45.374025    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:34:45.374322 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:45.374124    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:34:47.373854 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:47.373816    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:47.373854 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:47.373839    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:47.374327 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:47.373831    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:47.374327 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:47.373956    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:34:47.374327 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:47.374092    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:34:47.374327 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:47.374171    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:34:49.373359 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:49.373307    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:49.373359 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:49.373351    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:49.373977 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:49.373307    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:49.373977 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:49.373468    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:34:49.373977 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:49.373550    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:34:49.373977 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:49.373644    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:34:51.054790 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:51.054742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs\") pod \"network-metrics-daemon-cfj5p\" (UID: \"44a3719b-9e55-4619-bb8f-104095970f64\") " pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:51.055251 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:51.054875    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 09:34:51.055251 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:51.054958    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs podName:44a3719b-9e55-4619-bb8f-104095970f64 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:07.054934727 +0000 UTC m=+34.175651362 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs") pod "network-metrics-daemon-cfj5p" (UID: "44a3719b-9e55-4619-bb8f-104095970f64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 09:34:51.155397 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:51.155360    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret\") pod \"global-pull-secret-syncer-tgj2b\" (UID: \"10ed3813-aabe-4f27-b95e-cdb9121ae64c\") " pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:51.155397 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:51.155397    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqp9\" (UniqueName: \"kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9\") pod \"network-check-target-rnwsp\" (UID: \"4a11ac7e-41cc-4546-944a-cf3ad7866a76\") " pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:51.155622 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:51.155522    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 09:34:51.155622 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:51.155611    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret podName:10ed3813-aabe-4f27-b95e-cdb9121ae64c nodeName:}" failed. No retries permitted until 2026-06-11 09:35:07.15557752 +0000 UTC m=+34.276294141 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret") pod "global-pull-secret-syncer-tgj2b" (UID: "10ed3813-aabe-4f27-b95e-cdb9121ae64c") : object "kube-system"/"original-pull-secret" not registered
Jun 11 09:34:51.155622 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:51.155528    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 09:34:51.155757 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:51.155640    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 09:34:51.155757 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:51.155653    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gxqp9 for pod openshift-network-diagnostics/network-check-target-rnwsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 09:34:51.155757 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:51.155711    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9 podName:4a11ac7e-41cc-4546-944a-cf3ad7866a76 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:07.155693723 +0000 UTC m=+34.276410347 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gxqp9" (UniqueName: "kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9") pod "network-check-target-rnwsp" (UID: "4a11ac7e-41cc-4546-944a-cf3ad7866a76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 09:34:51.374015 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:51.373877    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:51.374015 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:51.373923    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:51.374015 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:51.374004    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:51.374265 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:51.374022    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:34:51.374265 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:51.374118    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:34:51.374265 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:51.374226    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:34:53.374312 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:53.374276    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:53.374312 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:53.374296    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:53.374816 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:53.374377    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:34:53.374816 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:53.374485    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:34:53.374816 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:53.374524    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:53.374816 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:53.374625    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:34:55.374172 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.373823    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:55.375064 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.373823    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:55.375064 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:55.374284    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:34:55.375064 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:55.374354    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:34:55.375064 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.373846    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:55.375064 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:55.374456    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:34:55.463249 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.463218    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fmjh8" event={"ID":"cadd281c-6a46-4e89-b608-ee346f7729ce","Type":"ContainerStarted","Data":"89210ce2643022f0788bce541b3a2a3fd482ae92efe4c8da86ba26a5fe02f690"}
Jun 11 09:34:55.464743 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.464712    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc" event={"ID":"371e2496-f4cb-46bd-9d8b-24ed36933efc","Type":"ContainerStarted","Data":"9a2646c098d619874bf34fe7dd3d005de12ba7138593c8d8eda5e67514c3ef25"}
Jun 11 09:34:55.466165 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.466139    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lmpvz" event={"ID":"b28fa7f8-061b-482e-bfeb-f0e51364c83e","Type":"ContainerStarted","Data":"f2095c50f1d5558eba81d11b0520090c15a682a2f2c049fec1a20758c527c569"}
Jun 11 09:34:55.467682 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.467634    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qwzvt" event={"ID":"80146ee6-1a7c-414a-bac3-d48cdf1ecc8a","Type":"ContainerStarted","Data":"03f64755a101599a6a82a70253f6babb8d34bd194f724d97763e525f1c57f463"}
Jun 11 09:34:55.470857 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.470838    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 09:34:55.471182 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.471162    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ccffbfc-8341-49eb-9082-723d34c5a8bd" containerID="082ba0b84604aa16e3c19f42e7dfabb9a0101e69e77a69e272e211302ce54d04" exitCode=1
Jun 11 09:34:55.471272 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.471235    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8" event={"ID":"2ccffbfc-8341-49eb-9082-723d34c5a8bd","Type":"ContainerStarted","Data":"4f0831b214f1cb76232d92c106e8891e07ea7f273c66bba9e5b2d170be7c2e8f"}
Jun 11 09:34:55.471334 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.471318    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8" event={"ID":"2ccffbfc-8341-49eb-9082-723d34c5a8bd","Type":"ContainerStarted","Data":"998f284ac41aab22fca90aba7187c26f44931643800bcd8e9852bbbc7a98eb0c"}
Jun 11 09:34:55.471389 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.471372    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8" event={"ID":"2ccffbfc-8341-49eb-9082-723d34c5a8bd","Type":"ContainerStarted","Data":"6972b37f929d49e4c1feb9463f88b24750f094477f848cbf26128ec22109c977"}
Jun 11 09:34:55.471441 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.471410    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8" event={"ID":"2ccffbfc-8341-49eb-9082-723d34c5a8bd","Type":"ContainerStarted","Data":"ad56973de5732f35615f2e28047fa2ba480f8732ca2ddad918fc2d03e028f04e"}
Jun 11 09:34:55.471491 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.471450    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8" event={"ID":"2ccffbfc-8341-49eb-9082-723d34c5a8bd","Type":"ContainerDied","Data":"082ba0b84604aa16e3c19f42e7dfabb9a0101e69e77a69e272e211302ce54d04"}
Jun 11 09:34:55.471544 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.471495    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8" event={"ID":"2ccffbfc-8341-49eb-9082-723d34c5a8bd","Type":"ContainerStarted","Data":"d60dabdda27efecab95f730c18e4db35e64cfc4b76205d738e95a3d0a95a77f1"}
Jun 11 09:34:55.472791 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.472770    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-95th7" event={"ID":"f2862586-aa82-4ee0-9c74-53feb7254237","Type":"ContainerStarted","Data":"530c18cb6aa7bc784c3faf39db3a166fc1404a0a6ad15bd35b1d6da8c9642503"}
Jun 11 09:34:55.474282 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.474258    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-llbqf" event={"ID":"ebe653ef-f4b8-4c0c-8a90-4ce77aecf4f6","Type":"ContainerStarted","Data":"05e1ee18c857db0d1d98add4c6a7df65948efdca0c9e69623129d72eacbd81c6"}
Jun 11 09:34:55.475763 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.475740    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfebb8d0-c009-4be3-9d8a-36100da43c39" containerID="e195983871f901daef2c7dd09b47375103a3f10fe8cf55270394294822b935db" exitCode=0
Jun 11 09:34:55.475843 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.475774    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hrr2" event={"ID":"dfebb8d0-c009-4be3-9d8a-36100da43c39","Type":"ContainerDied","Data":"e195983871f901daef2c7dd09b47375103a3f10fe8cf55270394294822b935db"}
Jun 11 09:34:55.489405 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.489317    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fmjh8" podStartSLOduration=4.099009467 podStartE2EDuration="22.489305782s" totalImagesPullingTime="18.390296315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:55.489066212 +0000 UTC m=+22.609782855" watchObservedRunningTime="2026-06-11 09:34:55.489305782 +0000 UTC m=+22.610022426"
Jun 11 09:34:55.489492 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.489407    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-252.ec2.internal" podStartSLOduration=21.48940275 podStartE2EDuration="21.48940275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:38.455142813 +0000 UTC m=+5.575859454" watchObservedRunningTime="2026-06-11 09:34:55.48940275 +0000 UTC m=+22.610119396"
Jun 11 09:34:55.518364 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.518318    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lmpvz" podStartSLOduration=4.141621523 podStartE2EDuration="22.518301616s" totalImagesPullingTime="18.376680093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:55.517572869 +0000 UTC m=+22.638289512" watchObservedRunningTime="2026-06-11 09:34:55.518301616 +0000 UTC m=+22.639018262"
Jun 11 09:34:55.614785 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.614668    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-llbqf" podStartSLOduration=8.917430191 podStartE2EDuration="22.614653623s" totalImagesPullingTime="13.697223432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:55.550036597 +0000 UTC m=+22.670753232" watchObservedRunningTime="2026-06-11 09:34:55.614653623 +0000 UTC m=+22.735370267"
Jun 11 09:34:55.700714 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.700690    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 11 09:34:55.702799 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:55.702646    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qwzvt" podStartSLOduration=4.30113447 podStartE2EDuration="22.702628819s" totalImagesPullingTime="18.401494349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:55.667047596 +0000 UTC m=+22.787764239" watchObservedRunningTime="2026-06-11 09:34:55.702628819 +0000 UTC m=+22.823345465"
Jun 11 09:34:56.381254 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:56.381150    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T09:34:55.700710557Z","UUID":"fb0267fb-d246-42cb-a20c-b74eeace20a5","Handler":null,"Name":"","Endpoint":""}
Jun 11 09:34:56.383409 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:56.383013    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 11 09:34:56.383409 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:56.383061    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 11 09:34:56.480507 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:56.479802    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ggzwc" event={"ID":"0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53","Type":"ContainerStarted","Data":"94c65bba48dcc30ea9b6b2b08ec199f805ae6b370e3430520d9059fd195ca66c"}
Jun 11 09:34:56.482769 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:56.482732    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc" event={"ID":"371e2496-f4cb-46bd-9d8b-24ed36933efc","Type":"ContainerStarted","Data":"29999e064677368cd19abbfa92e1c78ea51181213c32c8bdda628ab6319e3246"}
Jun 11 09:34:56.497799 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:56.497352    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-95th7" podStartSLOduration=5.071791237 podStartE2EDuration="23.497325625s" totalImagesPullingTime="18.425534388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:55.702875927 +0000 UTC m=+22.823592565" watchObservedRunningTime="2026-06-11 09:34:56.497325625 +0000 UTC m=+23.618042270"
Jun 11 09:34:56.498230 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:56.498074    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ggzwc" podStartSLOduration=5.103319523 podStartE2EDuration="23.498063119s" totalImagesPullingTime="18.394743596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:56.497050234 +0000 UTC m=+23.617766880" watchObservedRunningTime="2026-06-11 09:34:56.498063119 +0000 UTC m=+23.618779765"
Jun 11 09:34:57.373548 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:57.373516    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:57.373736 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:57.373516    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:57.373736 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:57.373672    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:57.373736 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:57.373685    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:34:57.373896 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:57.373783    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:34:57.373896 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:57.373866    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:34:57.487113 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:57.487071    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc" event={"ID":"371e2496-f4cb-46bd-9d8b-24ed36933efc","Type":"ContainerStarted","Data":"e8def2120e7ca8dfc94c1a81e78f3341bb0014ba54c5c926d8693e81614e1e2f"}
Jun 11 09:34:57.490556 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:57.490534    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 09:34:57.491020 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:57.490993    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8" event={"ID":"2ccffbfc-8341-49eb-9082-723d34c5a8bd","Type":"ContainerStarted","Data":"17f6ac20ae37c35040bc717359ffbd07d560612ec178205d87cbd4d6aa09ed0a"}
Jun 11 09:34:57.510168 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:57.510122    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lxsc" podStartSLOduration=4.650249743 podStartE2EDuration="24.510108286s" totalImagesPullingTime="19.859858543s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:57.50917723 +0000 UTC m=+24.629893873" watchObservedRunningTime="2026-06-11 09:34:57.510108286 +0000 UTC m=+24.630824930"
Jun 11 09:34:57.883255 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:57.883218    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-llbqf"
Jun 11 09:34:57.883921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:57.883902    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-llbqf"
Jun 11 09:34:59.373673 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:59.373650    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:34:59.373673 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:59.373669    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:34:59.374156 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:59.373651    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:34:59.374156 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:59.373744    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:34:59.374156 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:59.373833    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:34:59.374156 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:34:59.373899    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:34:59.499517 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:59.499499    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 09:34:59.499910 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:59.499885    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8" event={"ID":"2ccffbfc-8341-49eb-9082-723d34c5a8bd","Type":"ContainerStarted","Data":"f44598f317a3cb388ef12b2c3c9c34a9a90507a8ee48e42d4b5008548ac5c5b8"}
Jun 11 09:34:59.500155 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:59.500132    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:34:59.500317 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:59.500303    2561 scope.go:117] "RemoveContainer" containerID="082ba0b84604aa16e3c19f42e7dfabb9a0101e69e77a69e272e211302ce54d04"
Jun 11 09:34:59.514775 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:34:59.514625    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:35:00.503228 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:00.503195    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfebb8d0-c009-4be3-9d8a-36100da43c39" containerID="1707b103f2f76a278020e86e264f5702b3d8a13923a9ab79f3e0e584a0ee6761" exitCode=0
Jun 11 09:35:00.503671 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:00.503270    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hrr2" event={"ID":"dfebb8d0-c009-4be3-9d8a-36100da43c39","Type":"ContainerDied","Data":"1707b103f2f76a278020e86e264f5702b3d8a13923a9ab79f3e0e584a0ee6761"}
Jun 11 09:35:00.506964 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:00.506945    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 09:35:00.507291 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:00.507267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8" event={"ID":"2ccffbfc-8341-49eb-9082-723d34c5a8bd","Type":"ContainerStarted","Data":"62fdd5f0a68c19bdb01ae05707e2dbb7236a1c72eaa41c1811fe9ece5f1d7a7b"}
Jun 11 09:35:00.507573 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:00.507554    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:35:00.507671 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:00.507642    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:35:00.522567 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:00.522549    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:35:00.560429 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:00.560382    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8" podStartSLOduration=9.110557306 podStartE2EDuration="27.560369323s" totalImagesPullingTime="18.449812017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:35:00.557197994 +0000 UTC m=+27.677914638" watchObservedRunningTime="2026-06-11 09:35:00.560369323 +0000 UTC m=+27.681085967"
Jun 11 09:35:01.373799 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:01.373773    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:35:01.374036 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:01.373777    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:35:01.374036 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:01.373879    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:35:01.374036 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:01.373773    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:35:01.374036 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:01.373962    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:35:01.374209 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:01.374042    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:35:01.611129 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:01.610905    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tgj2b"]
Jun 11 09:35:01.611129 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:01.611056    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:35:01.611632 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:01.611170    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:35:01.611632 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:01.611593    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rnwsp"]
Jun 11 09:35:01.611714 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:01.611702    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:35:01.611802 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:01.611783    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:35:01.612332 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:01.612308    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cfj5p"]
Jun 11 09:35:01.612426 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:01.612414    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:35:01.612547 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:01.612523    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:35:02.513654 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:02.513460    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfebb8d0-c009-4be3-9d8a-36100da43c39" containerID="f88ff0064ca9d14b76c81db5638b3cf08165a06258c2e732bb0230305f25c716" exitCode=0
Jun 11 09:35:02.513654 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:02.513556    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hrr2" event={"ID":"dfebb8d0-c009-4be3-9d8a-36100da43c39","Type":"ContainerDied","Data":"f88ff0064ca9d14b76c81db5638b3cf08165a06258c2e732bb0230305f25c716"}
Jun 11 09:35:03.368834 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:03.368803    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-llbqf"
Jun 11 09:35:03.369274 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:03.368943    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 11 09:35:03.369431 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:03.369411    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-llbqf"
Jun 11 09:35:03.372917 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:03.372896    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:35:03.373042 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:03.372897    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:35:03.373042 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:03.373015    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:35:03.373153 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:03.372898    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:35:03.373153 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:03.373104    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:35:03.373244 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:03.373174    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:35:04.520395 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:04.520360    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfebb8d0-c009-4be3-9d8a-36100da43c39" containerID="0859813fd7059a61cb1c8f098fd5e15d3b3ba99c033bed3f9c5b1c9fe01d0abb" exitCode=0
Jun 11 09:35:04.521055 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:04.520422    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hrr2" event={"ID":"dfebb8d0-c009-4be3-9d8a-36100da43c39","Type":"ContainerDied","Data":"0859813fd7059a61cb1c8f098fd5e15d3b3ba99c033bed3f9c5b1c9fe01d0abb"}
Jun 11 09:35:05.373128 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:05.373092    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:35:05.373320 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:05.373092    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:35:05.373320 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:05.373287    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:35:05.373320 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:05.373096    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:35:05.373505 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:05.373332    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:35:05.373505 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:05.373387    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:35:07.077388 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.077351    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs\") pod \"network-metrics-daemon-cfj5p\" (UID: \"44a3719b-9e55-4619-bb8f-104095970f64\") " pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:35:07.078050 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:07.077501    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 09:35:07.078050 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:07.077563    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs podName:44a3719b-9e55-4619-bb8f-104095970f64 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:39.077545566 +0000 UTC m=+66.198262193 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs") pod "network-metrics-daemon-cfj5p" (UID: "44a3719b-9e55-4619-bb8f-104095970f64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 09:35:07.177935 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.177897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret\") pod \"global-pull-secret-syncer-tgj2b\" (UID: \"10ed3813-aabe-4f27-b95e-cdb9121ae64c\") " pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:35:07.178093 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.177943    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqp9\" (UniqueName: \"kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9\") pod \"network-check-target-rnwsp\" (UID: \"4a11ac7e-41cc-4546-944a-cf3ad7866a76\") " pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:35:07.178093 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:07.178061    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 09:35:07.178093 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:07.178075    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 09:35:07.178093 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:07.178091    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 09:35:07.178252 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:07.178103    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gxqp9 for pod openshift-network-diagnostics/network-check-target-rnwsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 09:35:07.178252 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:07.178133    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret podName:10ed3813-aabe-4f27-b95e-cdb9121ae64c nodeName:}" failed. No retries permitted until 2026-06-11 09:35:39.178117813 +0000 UTC m=+66.298834436 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret") pod "global-pull-secret-syncer-tgj2b" (UID: "10ed3813-aabe-4f27-b95e-cdb9121ae64c") : object "kube-system"/"original-pull-secret" not registered
Jun 11 09:35:07.178252 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:07.178150    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9 podName:4a11ac7e-41cc-4546-944a-cf3ad7866a76 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:39.17814208 +0000 UTC m=+66.298858702 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gxqp9" (UniqueName: "kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9") pod "network-check-target-rnwsp" (UID: "4a11ac7e-41cc-4546-944a-cf3ad7866a76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 09:35:07.373917 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.373890    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:35:07.373917 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.373921    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:35:07.374102 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.373890    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:35:07.374102 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:07.374046    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:35:07.374209 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:07.374142    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnwsp" podUID="4a11ac7e-41cc-4546-944a-cf3ad7866a76"
Jun 11 09:35:07.374261 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:07.374221    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgj2b" podUID="10ed3813-aabe-4f27-b95e-cdb9121ae64c"
Jun 11 09:35:07.674562 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.674487    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-252.ec2.internal" event="NodeReady"
Jun 11 09:35:07.674774 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.674651    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 11 09:35:07.724678 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.724644    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gwvf5"]
Jun 11 09:35:07.758871 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.758830    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kwdx4"]
Jun 11 09:35:07.759042 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.758985    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gwvf5"
Jun 11 09:35:07.761688 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.761663    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 11 09:35:07.761688 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.761673    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8pc9t\""
Jun 11 09:35:07.761897 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.761681    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 11 09:35:07.761897 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.761754    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 11 09:35:07.773559 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.773539    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gwvf5"]
Jun 11 09:35:07.773729 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.773633    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kwdx4"]
Jun 11 09:35:07.773729 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.773675    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:07.776003 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.775983    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 11 09:35:07.776003 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.775996    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 11 09:35:07.776161 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.776065    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pgk2h\""
Jun 11 09:35:07.883568 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.883526    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-config-volume\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:07.883756 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.883576    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w565c\" (UniqueName: \"kubernetes.io/projected/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-kube-api-access-w565c\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:07.883756 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.883662    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl6rw\" (UniqueName: \"kubernetes.io/projected/e59603fc-27ab-414e-8394-7c4114bc6236-kube-api-access-bl6rw\") pod \"ingress-canary-gwvf5\" (UID: \"e59603fc-27ab-414e-8394-7c4114bc6236\") " pod="openshift-ingress-canary/ingress-canary-gwvf5"
Jun 11 09:35:07.883756 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.883724    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e59603fc-27ab-414e-8394-7c4114bc6236-cert\") pod \"ingress-canary-gwvf5\" (UID: \"e59603fc-27ab-414e-8394-7c4114bc6236\") " pod="openshift-ingress-canary/ingress-canary-gwvf5"
Jun 11 09:35:07.883907 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.883808    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:07.883907 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.883840    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-tmp-dir\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:07.984933 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.984895    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-tmp-dir\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:07.985123 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.984957    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-config-volume\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:07.985123 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.984987    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w565c\" (UniqueName: \"kubernetes.io/projected/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-kube-api-access-w565c\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:07.985123 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.985028    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl6rw\" (UniqueName: \"kubernetes.io/projected/e59603fc-27ab-414e-8394-7c4114bc6236-kube-api-access-bl6rw\") pod \"ingress-canary-gwvf5\" (UID: \"e59603fc-27ab-414e-8394-7c4114bc6236\") " pod="openshift-ingress-canary/ingress-canary-gwvf5"
Jun 11 09:35:07.985123 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.985046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e59603fc-27ab-414e-8394-7c4114bc6236-cert\") pod \"ingress-canary-gwvf5\" (UID: \"e59603fc-27ab-414e-8394-7c4114bc6236\") " pod="openshift-ingress-canary/ingress-canary-gwvf5"
Jun 11 09:35:07.985348 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.985195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:07.985348 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:07.985299    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 09:35:07.985348 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.985300    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-tmp-dir\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:07.985527 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:07.985374    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls podName:79ac9c32-23fe-459c-b7b9-af6c4bb5c707 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:08.485354165 +0000 UTC m=+35.606070791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls") pod "dns-default-kwdx4" (UID: "79ac9c32-23fe-459c-b7b9-af6c4bb5c707") : secret "dns-default-metrics-tls" not found
Jun 11 09:35:07.985653 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.985635    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-config-volume\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:07.989661 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.989505    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e59603fc-27ab-414e-8394-7c4114bc6236-cert\") pod \"ingress-canary-gwvf5\" (UID: \"e59603fc-27ab-414e-8394-7c4114bc6236\") " pod="openshift-ingress-canary/ingress-canary-gwvf5"
Jun 11 09:35:07.995868 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.995845    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w565c\" (UniqueName: \"kubernetes.io/projected/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-kube-api-access-w565c\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:07.997434 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:07.997415    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl6rw\" (UniqueName: \"kubernetes.io/projected/e59603fc-27ab-414e-8394-7c4114bc6236-kube-api-access-bl6rw\") pod \"ingress-canary-gwvf5\" (UID: \"e59603fc-27ab-414e-8394-7c4114bc6236\") " pod="openshift-ingress-canary/ingress-canary-gwvf5"
Jun 11 09:35:08.070474 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:08.070438    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gwvf5"
Jun 11 09:35:08.489080 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:08.489051    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:08.489435 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:08.489214    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 09:35:08.489435 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:08.489285    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls podName:79ac9c32-23fe-459c-b7b9-af6c4bb5c707 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:09.489268322 +0000 UTC m=+36.609984945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls") pod "dns-default-kwdx4" (UID: "79ac9c32-23fe-459c-b7b9-af6c4bb5c707") : secret "dns-default-metrics-tls" not found
Jun 11 09:35:08.522071 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:08.522042    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gwvf5"]
Jun 11 09:35:08.525746 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:35:08.525722    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode59603fc_27ab_414e_8394_7c4114bc6236.slice/crio-f2d3c6aa5d87edd6b0829d6a299f5144dd4cbc966fd567076c184117c43ccc75 WatchSource:0}: Error finding container f2d3c6aa5d87edd6b0829d6a299f5144dd4cbc966fd567076c184117c43ccc75: Status 404 returned error can't find the container with id f2d3c6aa5d87edd6b0829d6a299f5144dd4cbc966fd567076c184117c43ccc75
Jun 11 09:35:08.530729 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:08.530695    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gwvf5" event={"ID":"e59603fc-27ab-414e-8394-7c4114bc6236","Type":"ContainerStarted","Data":"f2d3c6aa5d87edd6b0829d6a299f5144dd4cbc966fd567076c184117c43ccc75"}
Jun 11 09:35:09.373279 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:09.373246    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:35:09.373473 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:09.373246    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:35:09.373473 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:09.373248    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:35:09.375780 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:09.375755    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 11 09:35:09.376049 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:09.376033    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 11 09:35:09.376277 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:09.376257    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5m9lf\""
Jun 11 09:35:09.376972 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:09.376951    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 11 09:35:09.377077 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:09.376992    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 11 09:35:09.377077 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:09.377037    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fdlt8\""
Jun 11 09:35:09.496233 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:09.496196    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:09.496694 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:09.496333    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 09:35:09.496694 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:09.496405    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls podName:79ac9c32-23fe-459c-b7b9-af6c4bb5c707 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:11.496382212 +0000 UTC m=+38.617098838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls") pod "dns-default-kwdx4" (UID: "79ac9c32-23fe-459c-b7b9-af6c4bb5c707") : secret "dns-default-metrics-tls" not found
Jun 11 09:35:09.536892 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:09.536857    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfebb8d0-c009-4be3-9d8a-36100da43c39" containerID="b6294656b7bd98beb4cae717218aa89afed0386bf9378ec8e91df348ccb2d563" exitCode=0
Jun 11 09:35:09.537053 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:09.536942    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hrr2" event={"ID":"dfebb8d0-c009-4be3-9d8a-36100da43c39","Type":"ContainerDied","Data":"b6294656b7bd98beb4cae717218aa89afed0386bf9378ec8e91df348ccb2d563"}
Jun 11 09:35:10.542411 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:10.542165    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfebb8d0-c009-4be3-9d8a-36100da43c39" containerID="78ea5fa89376da2ed3dc8ef3aa179b094b81b681fa444805dcf544288e2055d3" exitCode=0
Jun 11 09:35:10.542713 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:10.542240    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hrr2" event={"ID":"dfebb8d0-c009-4be3-9d8a-36100da43c39","Type":"ContainerDied","Data":"78ea5fa89376da2ed3dc8ef3aa179b094b81b681fa444805dcf544288e2055d3"}
Jun 11 09:35:11.508964 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:11.508934    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:11.509115 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:11.509041    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 09:35:11.509115 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:11.509094    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls podName:79ac9c32-23fe-459c-b7b9-af6c4bb5c707 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:15.509080636 +0000 UTC m=+42.629797257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls") pod "dns-default-kwdx4" (UID: "79ac9c32-23fe-459c-b7b9-af6c4bb5c707") : secret "dns-default-metrics-tls" not found
Jun 11 09:35:11.546733 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:11.546696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gwvf5" event={"ID":"e59603fc-27ab-414e-8394-7c4114bc6236","Type":"ContainerStarted","Data":"d924ff2ee6e2e2d7567cfd0e38bc431c3e8df7e0237d3be8b9b31c3568eeaec0"}
Jun 11 09:35:11.549775 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:11.549748    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hrr2" event={"ID":"dfebb8d0-c009-4be3-9d8a-36100da43c39","Type":"ContainerStarted","Data":"1176752db9e2d4384572fa0956a7671c2d64542ffb8c114974130e3e6c11099d"}
Jun 11 09:35:11.567022 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:11.566969    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gwvf5" podStartSLOduration=2.746449554 podStartE2EDuration="4.56695376s" totalImagesPullingTime="1.820504206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:35:11.565097086 +0000 UTC m=+38.685813729" watchObservedRunningTime="2026-06-11 09:35:11.56695376 +0000 UTC m=+38.687670715"
Jun 11 09:35:11.598306 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:11.598244    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2hrr2" podStartSLOduration=9.792565762 podStartE2EDuration="38.598224744s" totalImagesPullingTime="28.805658982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:35:11.59801871 +0000 UTC m=+38.718735386" watchObservedRunningTime="2026-06-11 09:35:11.598224744 +0000 UTC m=+38.718941389"
Jun 11 09:35:15.538373 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:15.538315    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:15.538903 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:15.538460    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 09:35:15.538903 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:15.538518    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls podName:79ac9c32-23fe-459c-b7b9-af6c4bb5c707 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:23.538503431 +0000 UTC m=+50.659220058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls") pod "dns-default-kwdx4" (UID: "79ac9c32-23fe-459c-b7b9-af6c4bb5c707") : secret "dns-default-metrics-tls" not found
Jun 11 09:35:23.592920 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:23.592882    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:23.593575 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:23.593066    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 09:35:23.593575 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:23.593146    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls podName:79ac9c32-23fe-459c-b7b9-af6c4bb5c707 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:39.593124543 +0000 UTC m=+66.713841168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls") pod "dns-default-kwdx4" (UID: "79ac9c32-23fe-459c-b7b9-af6c4bb5c707") : secret "dns-default-metrics-tls" not found
Jun 11 09:35:32.523963 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:32.523933    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7zrp8"
Jun 11 09:35:39.098996 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.098945    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs\") pod \"network-metrics-daemon-cfj5p\" (UID: \"44a3719b-9e55-4619-bb8f-104095970f64\") " pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:35:39.101675 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.101657    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 11 09:35:39.109853 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:39.109836    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 11 09:35:39.109952 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:39.109891    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs podName:44a3719b-9e55-4619-bb8f-104095970f64 nodeName:}" failed. No retries permitted until 2026-06-11 09:36:43.109873753 +0000 UTC m=+130.230590375 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs") pod "network-metrics-daemon-cfj5p" (UID: "44a3719b-9e55-4619-bb8f-104095970f64") : secret "metrics-daemon-secret" not found
Jun 11 09:35:39.199566 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.199532    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret\") pod \"global-pull-secret-syncer-tgj2b\" (UID: \"10ed3813-aabe-4f27-b95e-cdb9121ae64c\") " pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:35:39.199566 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.199568    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqp9\" (UniqueName: \"kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9\") pod \"network-check-target-rnwsp\" (UID: \"4a11ac7e-41cc-4546-944a-cf3ad7866a76\") " pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:35:39.202527 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.202511    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 11 09:35:39.202686 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.202666    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 11 09:35:39.212563 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.212544    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 11 09:35:39.213634 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.213612    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ed3813-aabe-4f27-b95e-cdb9121ae64c-original-pull-secret\") pod \"global-pull-secret-syncer-tgj2b\" (UID: \"10ed3813-aabe-4f27-b95e-cdb9121ae64c\") " pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:35:39.222718 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.222695    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxqp9\" (UniqueName: \"kubernetes.io/projected/4a11ac7e-41cc-4546-944a-cf3ad7866a76-kube-api-access-gxqp9\") pod \"network-check-target-rnwsp\" (UID: \"4a11ac7e-41cc-4546-944a-cf3ad7866a76\") " pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:35:39.388352 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.388273    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5m9lf\""
Jun 11 09:35:39.396126 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.396106    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:35:39.397374 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.397350    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgj2b"
Jun 11 09:35:39.535173 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.535140    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rnwsp"]
Jun 11 09:35:39.538872 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:35:39.538844    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a11ac7e_41cc_4546_944a_cf3ad7866a76.slice/crio-5d0d1046122990a0ea5921bb2f13ef31baeda71b12d0d1207c54e5f4645040e8 WatchSource:0}: Error finding container 5d0d1046122990a0ea5921bb2f13ef31baeda71b12d0d1207c54e5f4645040e8: Status 404 returned error can't find the container with id 5d0d1046122990a0ea5921bb2f13ef31baeda71b12d0d1207c54e5f4645040e8
Jun 11 09:35:39.553389 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.553367    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tgj2b"]
Jun 11 09:35:39.556380 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:35:39.556355    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ed3813_aabe_4f27_b95e_cdb9121ae64c.slice/crio-79811618f4dda284be58beef209cbe296b9af3c25b9b00e02939b2c7e229db25 WatchSource:0}: Error finding container 79811618f4dda284be58beef209cbe296b9af3c25b9b00e02939b2c7e229db25: Status 404 returned error can't find the container with id 79811618f4dda284be58beef209cbe296b9af3c25b9b00e02939b2c7e229db25
Jun 11 09:35:39.602237 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.602213    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:35:39.602360 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:39.602335    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 09:35:39.602400 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:35:39.602390    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls podName:79ac9c32-23fe-459c-b7b9-af6c4bb5c707 nodeName:}" failed. No retries permitted until 2026-06-11 09:36:11.602373094 +0000 UTC m=+98.723089717 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls") pod "dns-default-kwdx4" (UID: "79ac9c32-23fe-459c-b7b9-af6c4bb5c707") : secret "dns-default-metrics-tls" not found
Jun 11 09:35:39.610902 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.610879    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tgj2b" event={"ID":"10ed3813-aabe-4f27-b95e-cdb9121ae64c","Type":"ContainerStarted","Data":"79811618f4dda284be58beef209cbe296b9af3c25b9b00e02939b2c7e229db25"}
Jun 11 09:35:39.611923 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:39.611903    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rnwsp" event={"ID":"4a11ac7e-41cc-4546-944a-cf3ad7866a76","Type":"ContainerStarted","Data":"5d0d1046122990a0ea5921bb2f13ef31baeda71b12d0d1207c54e5f4645040e8"}
Jun 11 09:35:44.626142 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:44.626104    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tgj2b" event={"ID":"10ed3813-aabe-4f27-b95e-cdb9121ae64c","Type":"ContainerStarted","Data":"5e44b2f3ca6a2bd95dcba8a501ed7ffd86cf209a8c470e9a7d099caf5a8d513d"}
Jun 11 09:35:44.627499 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:44.627476    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rnwsp" event={"ID":"4a11ac7e-41cc-4546-944a-cf3ad7866a76","Type":"ContainerStarted","Data":"79df0bc8250dd115728edd6fa56024a88f40ce4604aaf8aa87a73c758b58a520"}
Jun 11 09:35:44.627658 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:44.627529    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:35:44.645059 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:44.645016    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tgj2b" podStartSLOduration=67.459617859 podStartE2EDuration="1m11.644999171s" totalImagesPullingTime="4.185381312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:35:44.644283684 +0000 UTC m=+71.765000328" watchObservedRunningTime="2026-06-11 09:35:44.644999171 +0000 UTC m=+71.765715818"
Jun 11 09:35:44.662958 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:35:44.662919    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rnwsp" podStartSLOduration=67.463565072 podStartE2EDuration="1m11.662906677s" totalImagesPullingTime="4.199341605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:35:44.66250088 +0000 UTC m=+71.783217524" watchObservedRunningTime="2026-06-11 09:35:44.662906677 +0000 UTC m=+71.783623321"
Jun 11 09:36:11.617691 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:36:11.617653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:36:11.618045 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:36:11.617778    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 09:36:11.618045 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:36:11.617838    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls podName:79ac9c32-23fe-459c-b7b9-af6c4bb5c707 nodeName:}" failed. No retries permitted until 2026-06-11 09:37:15.617821158 +0000 UTC m=+162.738537783 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls") pod "dns-default-kwdx4" (UID: "79ac9c32-23fe-459c-b7b9-af6c4bb5c707") : secret "dns-default-metrics-tls" not found
Jun 11 09:36:15.632069 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:36:15.632039    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rnwsp"
Jun 11 09:36:43.137131 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:36:43.137080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs\") pod \"network-metrics-daemon-cfj5p\" (UID: \"44a3719b-9e55-4619-bb8f-104095970f64\") " pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:36:43.137550 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:36:43.137226    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 11 09:36:43.137550 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:36:43.137317    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs podName:44a3719b-9e55-4619-bb8f-104095970f64 nodeName:}" failed. No retries permitted until 2026-06-11 09:38:45.137301263 +0000 UTC m=+252.258017886 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs") pod "network-metrics-daemon-cfj5p" (UID: "44a3719b-9e55-4619-bb8f-104095970f64") : secret "metrics-daemon-secret" not found
Jun 11 09:37:10.782898 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:37:10.782838    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kwdx4" podUID="79ac9c32-23fe-459c-b7b9-af6c4bb5c707"
Jun 11 09:37:10.829284 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:37:10.829258    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:37:12.391928 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:37:12.391886    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cfj5p" podUID="44a3719b-9e55-4619-bb8f-104095970f64"
Jun 11 09:37:15.658833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:37:15.658785    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:37:15.659253 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:37:15.658909    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 09:37:15.659253 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:37:15.658971    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls podName:79ac9c32-23fe-459c-b7b9-af6c4bb5c707 nodeName:}" failed. No retries permitted until 2026-06-11 09:39:17.658955699 +0000 UTC m=+284.779672322 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls") pod "dns-default-kwdx4" (UID: "79ac9c32-23fe-459c-b7b9-af6c4bb5c707") : secret "dns-default-metrics-tls" not found
Jun 11 09:37:25.373753 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:37:25.373720    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:38:14.109317 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.109282    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cnfd7"]
Jun 11 09:38:14.111148 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.111131    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cnfd7"
Jun 11 09:38:14.115258 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.115238    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5mqzx\""
Jun 11 09:38:14.115481 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.115464    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jun 11 09:38:14.116097 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.116082    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jun 11 09:38:14.166352 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.166326    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cnfd7"]
Jun 11 09:38:14.211756 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.211732    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ll2g\" (UniqueName: \"kubernetes.io/projected/91684f14-75fa-423b-924b-240fa0b3970d-kube-api-access-4ll2g\") pod \"volume-data-source-validator-78dd696465-cnfd7\" (UID: \"91684f14-75fa-423b-924b-240fa0b3970d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cnfd7"
Jun 11 09:38:14.212285 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.212268    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p"]
Jun 11 09:38:14.213923 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.213911    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p"
Jun 11 09:38:14.216317 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.216299    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jun 11 09:38:14.216396 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.216363    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-9j6gl\""
Jun 11 09:38:14.216729 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.216710    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 11 09:38:14.216851 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.216743    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 11 09:38:14.216959 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.216947    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 11 09:38:14.229852 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.229834    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p"]
Jun 11 09:38:14.311430 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.311402    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp"]
Jun 11 09:38:14.312162 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.312139    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ll2g\" (UniqueName: \"kubernetes.io/projected/91684f14-75fa-423b-924b-240fa0b3970d-kube-api-access-4ll2g\") pod \"volume-data-source-validator-78dd696465-cnfd7\" (UID: \"91684f14-75fa-423b-924b-240fa0b3970d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cnfd7"
Jun 11 09:38:14.312260 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.312169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb64t\" (UniqueName: \"kubernetes.io/projected/ac9a1627-2c15-4871-860d-9637ecb513e8-kube-api-access-qb64t\") pod \"managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p\" (UID: \"ac9a1627-2c15-4871-860d-9637ecb513e8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p"
Jun 11 09:38:14.312260 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.312196    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac9a1627-2c15-4871-860d-9637ecb513e8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p\" (UID: \"ac9a1627-2c15-4871-860d-9637ecb513e8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p"
Jun 11 09:38:14.313177 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.313161    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln"]
Jun 11 09:38:14.313284 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.313268    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp"
Jun 11 09:38:14.315018 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.315000    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln"
Jun 11 09:38:14.318882 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.318859    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jun 11 09:38:14.318995 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.318978    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-46cr8\""
Jun 11 09:38:14.319062 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.319023    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jun 11 09:38:14.319333 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.319169    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jun 11 09:38:14.319333 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.319197    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jun 11 09:38:14.319333 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.319227    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-z624b\""
Jun 11 09:38:14.319333 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.319232    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jun 11 09:38:14.319734 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.319539    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jun 11 09:38:14.319734 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.319695    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jun 11 09:38:14.324792 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.324772    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp"]
Jun 11 09:38:14.325931 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.325909    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln"]
Jun 11 09:38:14.328978 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.328960    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ll2g\" (UniqueName: \"kubernetes.io/projected/91684f14-75fa-423b-924b-240fa0b3970d-kube-api-access-4ll2g\") pod \"volume-data-source-validator-78dd696465-cnfd7\" (UID: \"91684f14-75fa-423b-924b-240fa0b3970d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cnfd7"
Jun 11 09:38:14.413433 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.413344    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf537e77-aed5-4420-9ca4-a3c5f101596b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-jsqvp\" (UID: \"bf537e77-aed5-4420-9ca4-a3c5f101596b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp"
Jun 11 09:38:14.413433 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.413398    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl7lp\" (UniqueName: \"kubernetes.io/projected/28767d1a-d97d-4f26-bb88-2ef260c558bd-kube-api-access-sl7lp\") pod \"cluster-samples-operator-854f8b96b6-xgvln\" (UID: \"28767d1a-d97d-4f26-bb88-2ef260c558bd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln"
Jun 11 09:38:14.413433 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.413429    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf537e77-aed5-4420-9ca4-a3c5f101596b-config\") pod \"service-ca-operator-6bc5ff68f5-jsqvp\" (UID: \"bf537e77-aed5-4420-9ca4-a3c5f101596b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp"
Jun 11 09:38:14.413686 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.413449    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82qxb\" (UniqueName: \"kubernetes.io/projected/bf537e77-aed5-4420-9ca4-a3c5f101596b-kube-api-access-82qxb\") pod \"service-ca-operator-6bc5ff68f5-jsqvp\" (UID: \"bf537e77-aed5-4420-9ca4-a3c5f101596b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp"
Jun 11 09:38:14.413686 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.413465    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xgvln\" (UID: \"28767d1a-d97d-4f26-bb88-2ef260c558bd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln"
Jun 11 09:38:14.413686 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.413488    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb64t\" (UniqueName: \"kubernetes.io/projected/ac9a1627-2c15-4871-860d-9637ecb513e8-kube-api-access-qb64t\") pod \"managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p\" (UID: \"ac9a1627-2c15-4871-860d-9637ecb513e8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p"
Jun 11 09:38:14.413686 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.413543    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac9a1627-2c15-4871-860d-9637ecb513e8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p\" (UID: \"ac9a1627-2c15-4871-860d-9637ecb513e8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p"
Jun 11 09:38:14.415843 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.415817    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac9a1627-2c15-4871-860d-9637ecb513e8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p\" (UID: \"ac9a1627-2c15-4871-860d-9637ecb513e8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p"
Jun 11 09:38:14.419580 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.419563    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cnfd7"
Jun 11 09:38:14.422963 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.422946    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb64t\" (UniqueName: \"kubernetes.io/projected/ac9a1627-2c15-4871-860d-9637ecb513e8-kube-api-access-qb64t\") pod \"managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p\" (UID: \"ac9a1627-2c15-4871-860d-9637ecb513e8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p"
Jun 11 09:38:14.514339 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.514307    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf537e77-aed5-4420-9ca4-a3c5f101596b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-jsqvp\" (UID: \"bf537e77-aed5-4420-9ca4-a3c5f101596b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp"
Jun 11 09:38:14.514474 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.514354    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl7lp\" (UniqueName: \"kubernetes.io/projected/28767d1a-d97d-4f26-bb88-2ef260c558bd-kube-api-access-sl7lp\") pod \"cluster-samples-operator-854f8b96b6-xgvln\" (UID: \"28767d1a-d97d-4f26-bb88-2ef260c558bd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln"
Jun 11 09:38:14.514474 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.514393    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf537e77-aed5-4420-9ca4-a3c5f101596b-config\") pod \"service-ca-operator-6bc5ff68f5-jsqvp\" (UID: \"bf537e77-aed5-4420-9ca4-a3c5f101596b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp"
Jun 11 09:38:14.514474 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.514423    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82qxb\" (UniqueName: \"kubernetes.io/projected/bf537e77-aed5-4420-9ca4-a3c5f101596b-kube-api-access-82qxb\") pod \"service-ca-operator-6bc5ff68f5-jsqvp\" (UID: \"bf537e77-aed5-4420-9ca4-a3c5f101596b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp"
Jun 11 09:38:14.514474 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.514447    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xgvln\" (UID: \"28767d1a-d97d-4f26-bb88-2ef260c558bd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln"
Jun 11 09:38:14.514791 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:14.514644    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 11 09:38:14.514791 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:14.514719    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls podName:28767d1a-d97d-4f26-bb88-2ef260c558bd nodeName:}" failed. No retries permitted until 2026-06-11 09:38:15.014700362 +0000 UTC m=+222.135416986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xgvln" (UID: "28767d1a-d97d-4f26-bb88-2ef260c558bd") : secret "samples-operator-tls" not found
Jun 11 09:38:14.514932 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.514913    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf537e77-aed5-4420-9ca4-a3c5f101596b-config\") pod \"service-ca-operator-6bc5ff68f5-jsqvp\" (UID: \"bf537e77-aed5-4420-9ca4-a3c5f101596b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp"
Jun 11 09:38:14.516962 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.516939    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf537e77-aed5-4420-9ca4-a3c5f101596b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-jsqvp\" (UID: \"bf537e77-aed5-4420-9ca4-a3c5f101596b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp"
Jun 11 09:38:14.523665 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.523643    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82qxb\" (UniqueName: \"kubernetes.io/projected/bf537e77-aed5-4420-9ca4-a3c5f101596b-kube-api-access-82qxb\") pod \"service-ca-operator-6bc5ff68f5-jsqvp\" (UID: \"bf537e77-aed5-4420-9ca4-a3c5f101596b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp"
Jun 11 09:38:14.523958 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.523941    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl7lp\" (UniqueName: \"kubernetes.io/projected/28767d1a-d97d-4f26-bb88-2ef260c558bd-kube-api-access-sl7lp\") pod \"cluster-samples-operator-854f8b96b6-xgvln\" (UID: \"28767d1a-d97d-4f26-bb88-2ef260c558bd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln"
Jun 11 09:38:14.534949 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.534926    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cnfd7"]
Jun 11 09:38:14.537979 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:38:14.537961    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91684f14_75fa_423b_924b_240fa0b3970d.slice/crio-45a9ea21926b631654bc1ffbe4d8a3e3acfbc1913901a0f8cd0df44997e8e415 WatchSource:0}: Error finding container 45a9ea21926b631654bc1ffbe4d8a3e3acfbc1913901a0f8cd0df44997e8e415: Status 404 returned error can't find the container with id 45a9ea21926b631654bc1ffbe4d8a3e3acfbc1913901a0f8cd0df44997e8e415
Jun 11 09:38:14.543155 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.543137    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p"
Jun 11 09:38:14.622961 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.622931    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp"
Jun 11 09:38:14.662661 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.662631    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p"]
Jun 11 09:38:14.665828 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:38:14.665801    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac9a1627_2c15_4871_860d_9637ecb513e8.slice/crio-56250f55f42007c7e1901236a7f350b8d83df2adbbe5420b107ac6afb28da121 WatchSource:0}: Error finding container 56250f55f42007c7e1901236a7f350b8d83df2adbbe5420b107ac6afb28da121: Status 404 returned error can't find the container with id 56250f55f42007c7e1901236a7f350b8d83df2adbbe5420b107ac6afb28da121
Jun 11 09:38:14.743611 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.743499    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp"]
Jun 11 09:38:14.747457 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:38:14.747427    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf537e77_aed5_4420_9ca4_a3c5f101596b.slice/crio-7ddc2654a15585d9237411e0348030aeade9b5818ac9a4424cdae498d71e3bf5 WatchSource:0}: Error finding container 7ddc2654a15585d9237411e0348030aeade9b5818ac9a4424cdae498d71e3bf5: Status 404 returned error can't find the container with id 7ddc2654a15585d9237411e0348030aeade9b5818ac9a4424cdae498d71e3bf5
Jun 11 09:38:14.975421 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.975338    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp" event={"ID":"bf537e77-aed5-4420-9ca4-a3c5f101596b","Type":"ContainerStarted","Data":"7ddc2654a15585d9237411e0348030aeade9b5818ac9a4424cdae498d71e3bf5"}
Jun 11 09:38:14.976343 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.976317    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p" event={"ID":"ac9a1627-2c15-4871-860d-9637ecb513e8","Type":"ContainerStarted","Data":"56250f55f42007c7e1901236a7f350b8d83df2adbbe5420b107ac6afb28da121"}
Jun 11 09:38:14.977315 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:14.977295    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cnfd7" event={"ID":"91684f14-75fa-423b-924b-240fa0b3970d","Type":"ContainerStarted","Data":"45a9ea21926b631654bc1ffbe4d8a3e3acfbc1913901a0f8cd0df44997e8e415"}
Jun 11 09:38:15.018808 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:15.018786    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xgvln\" (UID: \"28767d1a-d97d-4f26-bb88-2ef260c558bd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln"
Jun 11 09:38:15.018919 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:15.018906    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 11 09:38:15.018969 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:15.018957    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls podName:28767d1a-d97d-4f26-bb88-2ef260c558bd nodeName:}" failed. No retries permitted until 2026-06-11 09:38:16.018943276 +0000 UTC m=+223.139659897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xgvln" (UID: "28767d1a-d97d-4f26-bb88-2ef260c558bd") : secret "samples-operator-tls" not found
Jun 11 09:38:15.981231 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:15.981199    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cnfd7" event={"ID":"91684f14-75fa-423b-924b-240fa0b3970d","Type":"ContainerStarted","Data":"0fc07edebaf5892351bfc6132756cbddb304e8b143de00f0ec42dc2778b650e9"}
Jun 11 09:38:16.001749 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:16.001702    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cnfd7" podStartSLOduration=0.780471311 podStartE2EDuration="2.001683883s" totalImagesPullingTime="1.221212572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:16.001318073 +0000 UTC m=+223.122034717" watchObservedRunningTime="2026-06-11 09:38:16.001683883 +0000 UTC m=+223.122400525"
Jun 11 09:38:16.027833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:16.027762    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xgvln\" (UID: \"28767d1a-d97d-4f26-bb88-2ef260c558bd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln"
Jun 11 09:38:16.028036 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:16.027885    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 11 09:38:16.028036 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:16.027949    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls podName:28767d1a-d97d-4f26-bb88-2ef260c558bd nodeName:}" failed. No retries permitted until 2026-06-11 09:38:18.027930352 +0000 UTC m=+225.148646978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xgvln" (UID: "28767d1a-d97d-4f26-bb88-2ef260c558bd") : secret "samples-operator-tls" not found
Jun 11 09:38:18.046545 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:18.046520    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xgvln\" (UID: \"28767d1a-d97d-4f26-bb88-2ef260c558bd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln"
Jun 11 09:38:18.046836 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:18.046687    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 11 09:38:18.046836 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:18.046744    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls podName:28767d1a-d97d-4f26-bb88-2ef260c558bd nodeName:}" failed. No retries permitted until 2026-06-11 09:38:22.046727425 +0000 UTC m=+229.167444050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xgvln" (UID: "28767d1a-d97d-4f26-bb88-2ef260c558bd") : secret "samples-operator-tls" not found
Jun 11 09:38:18.991382 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:18.991343    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp" event={"ID":"bf537e77-aed5-4420-9ca4-a3c5f101596b","Type":"ContainerStarted","Data":"cb53c7ed82d8810f1d2c4142120dd7757482d29ba7eead25a22f31231eddcf84"}
Jun 11 09:38:18.992800 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:18.992774    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p" event={"ID":"ac9a1627-2c15-4871-860d-9637ecb513e8","Type":"ContainerStarted","Data":"395d1325dac2301b483da8e08eeb35e95288d2e2f0221b1685354c5d15058f21"}
Jun 11 09:38:19.015442 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:19.015396    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp" podStartSLOduration=1.742953776 podStartE2EDuration="5.015380989s" totalImagesPullingTime="3.272427213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:19.014996458 +0000 UTC m=+226.135713102" watchObservedRunningTime="2026-06-11 09:38:19.015380989 +0000 UTC m=+226.136097636"
Jun 11 09:38:19.033684 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:19.033636    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbdbb4b6b-7fd4p" podStartSLOduration=1.622397622 podStartE2EDuration="5.033617993s" totalImagesPullingTime="3.411220371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:19.03320349 +0000 UTC m=+226.153920135" watchObservedRunningTime="2026-06-11 09:38:19.033617993 +0000 UTC m=+226.154334639"
Jun 11 09:38:21.214163 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:21.214125    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-zz9hs"]
Jun 11 09:38:21.217214 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:21.217191    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zz9hs"
Jun 11 09:38:21.222647 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:21.222624    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jun 11 09:38:21.222647 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:21.222641    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jun 11 09:38:21.223271 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:21.223253    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lp22h\""
Jun 11 09:38:21.269716 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:21.269692    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwznp\" (UniqueName: \"kubernetes.io/projected/64caae0f-4a99-43b9-ac49-eba95920dc33-kube-api-access-bwznp\") pod \"migrator-955ffdf5f-zz9hs\" (UID: \"64caae0f-4a99-43b9-ac49-eba95920dc33\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zz9hs"
Jun 11 09:38:21.352205 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:21.352178    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-zz9hs"]
Jun 11 09:38:21.370384 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:21.370354    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwznp\" (UniqueName: \"kubernetes.io/projected/64caae0f-4a99-43b9-ac49-eba95920dc33-kube-api-access-bwznp\") pod \"migrator-955ffdf5f-zz9hs\" (UID: \"64caae0f-4a99-43b9-ac49-eba95920dc33\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zz9hs"
Jun 11 09:38:21.387867 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:21.387838    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwznp\" (UniqueName: \"kubernetes.io/projected/64caae0f-4a99-43b9-ac49-eba95920dc33-kube-api-access-bwznp\") pod \"migrator-955ffdf5f-zz9hs\" (UID: \"64caae0f-4a99-43b9-ac49-eba95920dc33\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zz9hs"
Jun 11 09:38:21.526468 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:21.526437    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zz9hs"
Jun 11 09:38:21.668772 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:21.668743    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-zz9hs"]
Jun 11 09:38:21.671886 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:38:21.671857    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64caae0f_4a99_43b9_ac49_eba95920dc33.slice/crio-04240d3150d228ad0c7fc7daef0270c132462581e48885d7814b2651cf424807 WatchSource:0}: Error finding container 04240d3150d228ad0c7fc7daef0270c132462581e48885d7814b2651cf424807: Status 404 returned error can't find the container with id 04240d3150d228ad0c7fc7daef0270c132462581e48885d7814b2651cf424807
Jun 11 09:38:22.003777 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.003746    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zz9hs" event={"ID":"64caae0f-4a99-43b9-ac49-eba95920dc33","Type":"ContainerStarted","Data":"04240d3150d228ad0c7fc7daef0270c132462581e48885d7814b2651cf424807"}
Jun 11 09:38:22.074445 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.074412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xgvln\" (UID: \"28767d1a-d97d-4f26-bb88-2ef260c558bd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln"
Jun 11 09:38:22.074585 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:22.074516    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 11 09:38:22.074585 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:22.074564    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls podName:28767d1a-d97d-4f26-bb88-2ef260c558bd nodeName:}" failed. No retries permitted until 2026-06-11 09:38:30.074550594 +0000 UTC m=+237.195267217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xgvln" (UID: "28767d1a-d97d-4f26-bb88-2ef260c558bd") : secret "samples-operator-tls" not found
Jun 11 09:38:22.141750 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.141724    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-ghwnk"]
Jun 11 09:38:22.145777 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.145761    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-ghwnk"
Jun 11 09:38:22.153171 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.153154    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-s7czj\""
Jun 11 09:38:22.153446 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.153428    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jun 11 09:38:22.154059 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.154042    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jun 11 09:38:22.156102 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.156085    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jun 11 09:38:22.160101 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.160086    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jun 11 09:38:22.165871 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.165852    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-ghwnk"]
Jun 11 09:38:22.175241 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.175221    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2lg7\" (UniqueName: \"kubernetes.io/projected/bb347888-c705-42da-9ea5-0e3fe2b06218-kube-api-access-g2lg7\") pod \"service-ca-7d74d578b8-ghwnk\" (UID: \"bb347888-c705-42da-9ea5-0e3fe2b06218\") " pod="openshift-service-ca/service-ca-7d74d578b8-ghwnk"
Jun 11 09:38:22.175331 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.175274    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bb347888-c705-42da-9ea5-0e3fe2b06218-signing-key\") pod \"service-ca-7d74d578b8-ghwnk\" (UID: \"bb347888-c705-42da-9ea5-0e3fe2b06218\") " pod="openshift-service-ca/service-ca-7d74d578b8-ghwnk"
Jun 11 09:38:22.175377 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.175326    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bb347888-c705-42da-9ea5-0e3fe2b06218-signing-cabundle\") pod \"service-ca-7d74d578b8-ghwnk\" (UID: \"bb347888-c705-42da-9ea5-0e3fe2b06218\") " pod="openshift-service-ca/service-ca-7d74d578b8-ghwnk"
Jun 11 09:38:22.276331 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.276258    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2lg7\" (UniqueName: \"kubernetes.io/projected/bb347888-c705-42da-9ea5-0e3fe2b06218-kube-api-access-g2lg7\") pod \"service-ca-7d74d578b8-ghwnk\" (UID: \"bb347888-c705-42da-9ea5-0e3fe2b06218\") " pod="openshift-service-ca/service-ca-7d74d578b8-ghwnk"
Jun 11 09:38:22.276331 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.276329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bb347888-c705-42da-9ea5-0e3fe2b06218-signing-key\") pod \"service-ca-7d74d578b8-ghwnk\" (UID: \"bb347888-c705-42da-9ea5-0e3fe2b06218\") " pod="openshift-service-ca/service-ca-7d74d578b8-ghwnk"
Jun 11 09:38:22.276850 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.276356    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bb347888-c705-42da-9ea5-0e3fe2b06218-signing-cabundle\") pod \"service-ca-7d74d578b8-ghwnk\" (UID: \"bb347888-c705-42da-9ea5-0e3fe2b06218\") " pod="openshift-service-ca/service-ca-7d74d578b8-ghwnk"
Jun 11 09:38:22.277215 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.277189    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bb347888-c705-42da-9ea5-0e3fe2b06218-signing-cabundle\") pod \"service-ca-7d74d578b8-ghwnk\" (UID: \"bb347888-c705-42da-9ea5-0e3fe2b06218\") " pod="openshift-service-ca/service-ca-7d74d578b8-ghwnk"
Jun 11 09:38:22.278924 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.278903    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bb347888-c705-42da-9ea5-0e3fe2b06218-signing-key\") pod \"service-ca-7d74d578b8-ghwnk\" (UID: \"bb347888-c705-42da-9ea5-0e3fe2b06218\") " pod="openshift-service-ca/service-ca-7d74d578b8-ghwnk"
Jun 11 09:38:22.287793 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.287768    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2lg7\" (UniqueName: \"kubernetes.io/projected/bb347888-c705-42da-9ea5-0e3fe2b06218-kube-api-access-g2lg7\") pod \"service-ca-7d74d578b8-ghwnk\" (UID: \"bb347888-c705-42da-9ea5-0e3fe2b06218\") " pod="openshift-service-ca/service-ca-7d74d578b8-ghwnk"
Jun 11 09:38:22.454306 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.454271    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-ghwnk"
Jun 11 09:38:22.587108 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:22.587082    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-ghwnk"]
Jun 11 09:38:22.811869 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:38:22.811789    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb347888_c705_42da_9ea5_0e3fe2b06218.slice/crio-bcd45688db7263ba78b0ac2d381e51d3a415044cc762ce752d8901fb2401fee4 WatchSource:0}: Error finding container bcd45688db7263ba78b0ac2d381e51d3a415044cc762ce752d8901fb2401fee4: Status 404 returned error can't find the container with id bcd45688db7263ba78b0ac2d381e51d3a415044cc762ce752d8901fb2401fee4
Jun 11 09:38:23.012110 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:23.012076    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zz9hs" event={"ID":"64caae0f-4a99-43b9-ac49-eba95920dc33","Type":"ContainerStarted","Data":"c178a9a28cf60c90c1bd2002a8dac46441ea259f388b95e02cf91ddc84ae9c19"}
Jun 11 09:38:23.012244 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:23.012164    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zz9hs" event={"ID":"64caae0f-4a99-43b9-ac49-eba95920dc33","Type":"ContainerStarted","Data":"c91081b82716c494d5f0ab915b00957f67aa3a552a2e953456fbda6f2d5e5965"}
Jun 11 09:38:23.013482 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:23.013459    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-ghwnk" event={"ID":"bb347888-c705-42da-9ea5-0e3fe2b06218","Type":"ContainerStarted","Data":"d177e498ea7be0b0c132b07c6847822e7bf0c4b7f6d816c3c0d171f3d8f7ce4e"}
Jun 11 09:38:23.013577 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:23.013499    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-ghwnk" event={"ID":"bb347888-c705-42da-9ea5-0e3fe2b06218","Type":"ContainerStarted","Data":"bcd45688db7263ba78b0ac2d381e51d3a415044cc762ce752d8901fb2401fee4"}
Jun 11 09:38:23.043015 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:23.042899    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zz9hs" podStartSLOduration=0.858818316 podStartE2EDuration="2.042882756s" totalImagesPullingTime="1.18406444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:23.042584712 +0000 UTC m=+230.163301364" watchObservedRunningTime="2026-06-11 09:38:23.042882756 +0000 UTC m=+230.163599402"
Jun 11 09:38:23.065595 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:23.065518    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-ghwnk" podStartSLOduration=1.065504294 podStartE2EDuration="1.065504294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:23.064090455 +0000 UTC m=+230.184807099" watchObservedRunningTime="2026-06-11 09:38:23.065504294 +0000 UTC m=+230.186220938"
Jun 11 09:38:23.108175 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:23.108154    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lmpvz_b28fa7f8-061b-482e-bfeb-f0e51364c83e/dns-node-resolver/0.log"
Jun 11 09:38:24.108394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:24.108363    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fmjh8_cadd281c-6a46-4e89-b608-ee346f7729ce/node-ca/0.log"
Jun 11 09:38:24.904296 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:24.904266    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gwvf5_e59603fc-27ab-414e-8394-7c4114bc6236/serve-healthcheck-canary/0.log"
Jun 11 09:38:30.140765 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:30.140728    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xgvln\" (UID: \"28767d1a-d97d-4f26-bb88-2ef260c558bd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln"
Jun 11 09:38:30.143157 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:30.143125    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28767d1a-d97d-4f26-bb88-2ef260c558bd-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xgvln\" (UID: \"28767d1a-d97d-4f26-bb88-2ef260c558bd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln"
Jun 11 09:38:30.228637 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:30.228592    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln"
Jun 11 09:38:30.360592 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:30.360562    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln"]
Jun 11 09:38:31.040249 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:31.040197    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln" event={"ID":"28767d1a-d97d-4f26-bb88-2ef260c558bd","Type":"ContainerStarted","Data":"5ec3f433cbae0b23160e9d3165c3dedd2f70e22ab2cb593da11aef16003a55a8"}
Jun 11 09:38:33.049754 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:33.049714    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln" event={"ID":"28767d1a-d97d-4f26-bb88-2ef260c558bd","Type":"ContainerStarted","Data":"f4b1782b7cea0f5a6b352beb23710bd22a1b8c93d323145bc254cc1e28db1cda"}
Jun 11 09:38:33.050126 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:33.049775    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln" event={"ID":"28767d1a-d97d-4f26-bb88-2ef260c558bd","Type":"ContainerStarted","Data":"395862eb1de7bddc03df5d089749bf699d8c7b31631e42a72ada1e6e17d66ffb"}
Jun 11 09:38:33.075331 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:33.075278    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xgvln" podStartSLOduration=17.339122216 podStartE2EDuration="19.075263838s" totalImagesPullingTime="1.736141622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:33.073822425 +0000 UTC m=+240.194539071" watchObservedRunningTime="2026-06-11 09:38:33.075263838 +0000 UTC m=+240.195980481"
Jun 11 09:38:43.916040 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:43.916007    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h6rkm"]
Jun 11 09:38:43.921682 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:43.921665    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:43.927143 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:43.927121    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xdzqm\""
Jun 11 09:38:43.927742 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:43.927676    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 11 09:38:43.928062 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:43.928043    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 11 09:38:43.928129 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:43.928116    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 11 09:38:43.928175 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:43.928158    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 11 09:38:43.967026 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:43.966999    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h6rkm"]
Jun 11 09:38:44.009159 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.009139    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65c7fd86d7-wm2g4"]
Jun 11 09:38:44.012757 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.012743    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.016314 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.016294    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 11 09:38:44.016419 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.016377    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 11 09:38:44.016507 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.016492    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 11 09:38:44.017110 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.017094    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sxn4r\""
Jun 11 09:38:44.023852 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.023835    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 11 09:38:44.039204 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.039182    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa887de6-d292-49b2-8476-1730c4c71a7c-data-volume\") pod \"insights-runtime-extractor-h6rkm\" (UID: \"aa887de6-d292-49b2-8476-1730c4c71a7c\") " pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:44.039271 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.039206    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa887de6-d292-49b2-8476-1730c4c71a7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6rkm\" (UID: \"aa887de6-d292-49b2-8476-1730c4c71a7c\") " pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:44.039271 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.039263    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa887de6-d292-49b2-8476-1730c4c71a7c-crio-socket\") pod \"insights-runtime-extractor-h6rkm\" (UID: \"aa887de6-d292-49b2-8476-1730c4c71a7c\") " pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:44.039379 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.039284    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfvjz\" (UniqueName: \"kubernetes.io/projected/aa887de6-d292-49b2-8476-1730c4c71a7c-kube-api-access-hfvjz\") pod \"insights-runtime-extractor-h6rkm\" (UID: \"aa887de6-d292-49b2-8476-1730c4c71a7c\") " pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:44.039379 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.039301    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa887de6-d292-49b2-8476-1730c4c71a7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6rkm\" (UID: \"aa887de6-d292-49b2-8476-1730c4c71a7c\") " pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:44.059339 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.059319    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65c7fd86d7-wm2g4"]
Jun 11 09:38:44.139807 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.139778    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-bound-sa-token\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.139983 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.139811    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-registry-certificates\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.139983 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.139833    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa887de6-d292-49b2-8476-1730c4c71a7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6rkm\" (UID: \"aa887de6-d292-49b2-8476-1730c4c71a7c\") " pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:44.139983 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.139852    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-image-registry-private-configuration\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.139983 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.139881    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjzlg\" (UniqueName: \"kubernetes.io/projected/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-kube-api-access-hjzlg\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.139983 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.139900    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-registry-tls\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.139983 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.139915    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-installation-pull-secrets\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.139983 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.139932    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa887de6-d292-49b2-8476-1730c4c71a7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6rkm\" (UID: \"aa887de6-d292-49b2-8476-1730c4c71a7c\") " pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:44.140299 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.140060    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-trusted-ca\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.140299 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.140095    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa887de6-d292-49b2-8476-1730c4c71a7c-crio-socket\") pod \"insights-runtime-extractor-h6rkm\" (UID: \"aa887de6-d292-49b2-8476-1730c4c71a7c\") " pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:44.140299 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.140123    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa887de6-d292-49b2-8476-1730c4c71a7c-data-volume\") pod \"insights-runtime-extractor-h6rkm\" (UID: \"aa887de6-d292-49b2-8476-1730c4c71a7c\") " pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:44.140299 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.140141    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa887de6-d292-49b2-8476-1730c4c71a7c-crio-socket\") pod \"insights-runtime-extractor-h6rkm\" (UID: \"aa887de6-d292-49b2-8476-1730c4c71a7c\") " pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:44.140299 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.140159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-ca-trust-extracted\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.140299 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.140182    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfvjz\" (UniqueName: \"kubernetes.io/projected/aa887de6-d292-49b2-8476-1730c4c71a7c-kube-api-access-hfvjz\") pod \"insights-runtime-extractor-h6rkm\" (UID: \"aa887de6-d292-49b2-8476-1730c4c71a7c\") " pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:44.140508 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.140395    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa887de6-d292-49b2-8476-1730c4c71a7c-data-volume\") pod \"insights-runtime-extractor-h6rkm\" (UID: \"aa887de6-d292-49b2-8476-1730c4c71a7c\") " pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:44.140508 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.140458    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa887de6-d292-49b2-8476-1730c4c71a7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6rkm\" (UID: \"aa887de6-d292-49b2-8476-1730c4c71a7c\") " pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:44.142188 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.142168    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa887de6-d292-49b2-8476-1730c4c71a7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6rkm\" (UID: \"aa887de6-d292-49b2-8476-1730c4c71a7c\") " pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:44.153395 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.153365    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfvjz\" (UniqueName: \"kubernetes.io/projected/aa887de6-d292-49b2-8476-1730c4c71a7c-kube-api-access-hfvjz\") pod \"insights-runtime-extractor-h6rkm\" (UID: \"aa887de6-d292-49b2-8476-1730c4c71a7c\") " pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:44.230805 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.230787    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h6rkm"
Jun 11 09:38:44.240584 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.240452    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-bound-sa-token\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.240584 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.240480    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-registry-certificates\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.240584 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.240499    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-image-registry-private-configuration\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.240759 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.240649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjzlg\" (UniqueName: \"kubernetes.io/projected/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-kube-api-access-hjzlg\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.240759 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.240705    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-registry-tls\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.240759 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.240736    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-installation-pull-secrets\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.240894 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.240772    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-trusted-ca\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.240894 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.240821    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-ca-trust-extracted\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.241297 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.241201    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-ca-trust-extracted\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.241536 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.241507    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-registry-certificates\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.241957 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.241936    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-trusted-ca\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.243237 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.243205    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-installation-pull-secrets\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.243555 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.243491    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-image-registry-private-configuration\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.243653 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.243620    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-registry-tls\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.252885 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.252863    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjzlg\" (UniqueName: \"kubernetes.io/projected/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-kube-api-access-hjzlg\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.252885 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.252873    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d9dfda7-5d46-4a9e-9edf-c14d35297db9-bound-sa-token\") pod \"image-registry-65c7fd86d7-wm2g4\" (UID: \"0d9dfda7-5d46-4a9e-9edf-c14d35297db9\") " pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.321945 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.321915    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:44.379996 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.379932    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h6rkm"]
Jun 11 09:38:44.384643 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:38:44.384616    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa887de6_d292_49b2_8476_1730c4c71a7c.slice/crio-bcac698a9d0144e5662f587ac895cee9b23fcc1f34867ec33225815506869be8 WatchSource:0}: Error finding container bcac698a9d0144e5662f587ac895cee9b23fcc1f34867ec33225815506869be8: Status 404 returned error can't find the container with id bcac698a9d0144e5662f587ac895cee9b23fcc1f34867ec33225815506869be8
Jun 11 09:38:44.471989 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:44.471961    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65c7fd86d7-wm2g4"]
Jun 11 09:38:44.473556 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:38:44.473525    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d9dfda7_5d46_4a9e_9edf_c14d35297db9.slice/crio-769131489ad362e01f5130a124b3b9f104ae9f8f4bedfddc24bdee94720e4ed6 WatchSource:0}: Error finding container 769131489ad362e01f5130a124b3b9f104ae9f8f4bedfddc24bdee94720e4ed6: Status 404 returned error can't find the container with id 769131489ad362e01f5130a124b3b9f104ae9f8f4bedfddc24bdee94720e4ed6
Jun 11 09:38:45.085032 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:45.085001    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4" event={"ID":"0d9dfda7-5d46-4a9e-9edf-c14d35297db9","Type":"ContainerStarted","Data":"08449d3963d1e8588a595ad3453385879819e77da21876aac4a69ddb52a19e7e"}
Jun 11 09:38:45.085445 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:45.085060    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4" event={"ID":"0d9dfda7-5d46-4a9e-9edf-c14d35297db9","Type":"ContainerStarted","Data":"769131489ad362e01f5130a124b3b9f104ae9f8f4bedfddc24bdee94720e4ed6"}
Jun 11 09:38:45.085445 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:45.085089    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:38:45.086788 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:45.086763    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6rkm" event={"ID":"aa887de6-d292-49b2-8476-1730c4c71a7c","Type":"ContainerStarted","Data":"84a85b853ba477ce3d3c83f0e8784d216c816eb1ca9f96dec086855be8c6c6ff"}
Jun 11 09:38:45.086879 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:45.086804    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6rkm" event={"ID":"aa887de6-d292-49b2-8476-1730c4c71a7c","Type":"ContainerStarted","Data":"c183d4c66eb30f9d09c3625d783fdc649b5dd46cecdde4519a12d08d0f65fa73"}
Jun 11 09:38:45.086879 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:45.086824    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6rkm" event={"ID":"aa887de6-d292-49b2-8476-1730c4c71a7c","Type":"ContainerStarted","Data":"bcac698a9d0144e5662f587ac895cee9b23fcc1f34867ec33225815506869be8"}
Jun 11 09:38:45.147999 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:45.147968    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs\") pod \"network-metrics-daemon-cfj5p\" (UID: \"44a3719b-9e55-4619-bb8f-104095970f64\") " pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:38:45.150262 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:45.150239    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a3719b-9e55-4619-bb8f-104095970f64-metrics-certs\") pod \"network-metrics-daemon-cfj5p\" (UID: \"44a3719b-9e55-4619-bb8f-104095970f64\") " pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:38:45.182076 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:45.180804    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fdlt8\""
Jun 11 09:38:45.184275 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:45.184253    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfj5p"
Jun 11 09:38:45.321973 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:45.321913    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4" podStartSLOduration=2.321891439 podStartE2EDuration="2.321891439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:45.118433299 +0000 UTC m=+252.239149944" watchObservedRunningTime="2026-06-11 09:38:45.321891439 +0000 UTC m=+252.442608064"
Jun 11 09:38:45.322590 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:45.322572    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cfj5p"]
Jun 11 09:38:45.325400 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:38:45.325369    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a3719b_9e55_4619_bb8f_104095970f64.slice/crio-17d72287ca5dc876dbe1f0356cdd152deeba288148dc7667972ae37694a0118e WatchSource:0}: Error finding container 17d72287ca5dc876dbe1f0356cdd152deeba288148dc7667972ae37694a0118e: Status 404 returned error can't find the container with id 17d72287ca5dc876dbe1f0356cdd152deeba288148dc7667972ae37694a0118e
Jun 11 09:38:46.092658 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:46.092619    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cfj5p" event={"ID":"44a3719b-9e55-4619-bb8f-104095970f64","Type":"ContainerStarted","Data":"17d72287ca5dc876dbe1f0356cdd152deeba288148dc7667972ae37694a0118e"}
Jun 11 09:38:48.104631 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:48.104582    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6rkm" event={"ID":"aa887de6-d292-49b2-8476-1730c4c71a7c","Type":"ContainerStarted","Data":"ec136a8bf82a5edc622c836978890fa471c96404d40b89a50ef40dbdc356d1fd"}
Jun 11 09:38:48.106322 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:48.106289    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cfj5p" event={"ID":"44a3719b-9e55-4619-bb8f-104095970f64","Type":"ContainerStarted","Data":"51644907c8a322f97d137e2bb6b54efd625ed0d58b5deaa61908922bf59c7d89"}
Jun 11 09:38:48.106438 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:48.106329    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cfj5p" event={"ID":"44a3719b-9e55-4619-bb8f-104095970f64","Type":"ContainerStarted","Data":"b32e1a0bfee607de4dd57bbc79d155d7a5c858d482400ae54dc2af06088ee327"}
Jun 11 09:38:48.145105 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:48.145054    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h6rkm" podStartSLOduration=2.534390195 podStartE2EDuration="5.145037146s" totalImagesPullingTime="2.610646951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:38:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:48.144828622 +0000 UTC m=+255.265545268" watchObservedRunningTime="2026-06-11 09:38:48.145037146 +0000 UTC m=+255.265753791"
Jun 11 09:38:48.167829 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:48.167794    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cfj5p" podStartSLOduration=253.366793002 podStartE2EDuration="4m15.167782205s" totalImagesPullingTime="1.800989203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:48.167585585 +0000 UTC m=+255.288302230" watchObservedRunningTime="2026-06-11 09:38:48.167782205 +0000 UTC m=+255.288498848"
Jun 11 09:38:57.208236 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.208203    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bm2nt"]
Jun 11 09:38:57.211461 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.211440    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.249725 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:57.249696    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-138-252.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-252.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jun 11 09:38:57.249725 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:57.249694    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"node-exporter-accelerators-collector-config\" is forbidden: User \"system:node:ip-10-0-138-252.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-252.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap"
Jun 11 09:38:57.249889 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.249723    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 11 09:38:57.249889 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:57.249707    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-dockercfg-4qs24\" is forbidden: User \"system:node:ip-10-0-138-252.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-252.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4qs24\"" type="*v1.Secret"
Jun 11 09:38:57.249889 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:57.249703    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-138-252.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-252.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jun 11 09:38:57.249889 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.249767    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 11 09:38:57.249889 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:57.249768    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"metrics-client-ca\" is forbidden: User \"system:node:ip-10-0-138-252.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-252.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap"
Jun 11 09:38:57.249889 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:57.249761    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"node-exporter-bm2nt\" is forbidden: User \"system:node:ip-10-0-138-252.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-252.ec2.internal' and this object" podUID="467788e2-8e4d-4a64-9f60-a23e74c31913" pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.341280 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.341250    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/467788e2-8e4d-4a64-9f60-a23e74c31913-root\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.341280 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.341280    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/467788e2-8e4d-4a64-9f60-a23e74c31913-sys\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.341450 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.341304    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-textfile\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.341450 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.341358    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-accelerators-collector-config\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.341450 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.341405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-tls\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.341450 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.341424    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.341450 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.341442    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj2fm\" (UniqueName: \"kubernetes.io/projected/467788e2-8e4d-4a64-9f60-a23e74c31913-kube-api-access-xj2fm\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.341627 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.341467    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-wtmp\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.341627 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.341487    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/467788e2-8e4d-4a64-9f60-a23e74c31913-metrics-client-ca\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.442475 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.442444    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/467788e2-8e4d-4a64-9f60-a23e74c31913-root\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.442475 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.442477    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/467788e2-8e4d-4a64-9f60-a23e74c31913-sys\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.442724 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.442497    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-textfile\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.442724 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.442521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-accelerators-collector-config\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.442724 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.442542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-tls\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.442724 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.442566    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.442724 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.442575    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/467788e2-8e4d-4a64-9f60-a23e74c31913-root\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.442724 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.442594    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj2fm\" (UniqueName: \"kubernetes.io/projected/467788e2-8e4d-4a64-9f60-a23e74c31913-kube-api-access-xj2fm\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.442724 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.442583    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/467788e2-8e4d-4a64-9f60-a23e74c31913-sys\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.442724 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.442670    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-wtmp\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.442724 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.442703    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/467788e2-8e4d-4a64-9f60-a23e74c31913-metrics-client-ca\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.443065 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.442835    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-wtmp\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.443065 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.442903    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-textfile\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.444797 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.444771    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.444888 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.444855    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-tls\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:57.931250 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.931219    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 11 09:38:57.934280 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.934261    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:57.936661 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.936636    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 11 09:38:57.936765 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.936647    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 11 09:38:57.938787 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.938772    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 11 09:38:57.938858 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.938803    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 11 09:38:57.938987 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.938972    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 11 09:38:57.939038 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.938984    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 11 09:38:57.939337 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.939321    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 11 09:38:57.939405 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.939391    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 11 09:38:57.940095 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.940076    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 11 09:38:57.940205 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.940143    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gzj55\""
Jun 11 09:38:57.958802 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:57.958781    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 11 09:38:58.046869 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.046837    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-config-volume\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.046869 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.046871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.047065 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.046895    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz9g5\" (UniqueName: \"kubernetes.io/projected/edf7db46-edf5-478d-a195-7a58dbd916a8-kube-api-access-mz9g5\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.047065 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.046921    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/edf7db46-edf5-478d-a195-7a58dbd916a8-config-out\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.047065 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.046944    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.047065 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.047016    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-web-config\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.047065 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.047031    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/edf7db46-edf5-478d-a195-7a58dbd916a8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.047065 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.047048    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.047242 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.047072    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.047242 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.047108    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf7db46-edf5-478d-a195-7a58dbd916a8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.047242 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.047142    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.047242 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.047167    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edf7db46-edf5-478d-a195-7a58dbd916a8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.047242 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.047218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/edf7db46-edf5-478d-a195-7a58dbd916a8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.147967 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.147930    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-web-config\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.148139 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.147974    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/edf7db46-edf5-478d-a195-7a58dbd916a8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.148139 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.148007    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.148139 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.148045    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.148139 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.148069    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf7db46-edf5-478d-a195-7a58dbd916a8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.148139 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.148097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.148139 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.148121    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edf7db46-edf5-478d-a195-7a58dbd916a8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.148463 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.148170    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/edf7db46-edf5-478d-a195-7a58dbd916a8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.148463 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.148204    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-config-volume\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.148463 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.148229    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.148463 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.148263    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz9g5\" (UniqueName: \"kubernetes.io/projected/edf7db46-edf5-478d-a195-7a58dbd916a8-kube-api-access-mz9g5\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.148463 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.148289    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/edf7db46-edf5-478d-a195-7a58dbd916a8-config-out\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.148463 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.148312    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.148463 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:58.148426    2561 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jun 11 09:38:58.148794 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.148471    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/edf7db46-edf5-478d-a195-7a58dbd916a8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.148794 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:58.148491    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-main-tls podName:edf7db46-edf5-478d-a195-7a58dbd916a8 nodeName:}" failed. No retries permitted until 2026-06-11 09:38:58.648472308 +0000 UTC m=+265.769188933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "edf7db46-edf5-478d-a195-7a58dbd916a8") : secret "alertmanager-main-tls" not found
Jun 11 09:38:58.149809 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.149781    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf7db46-edf5-478d-a195-7a58dbd916a8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.151116 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.151045    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.151219 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.151202    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/edf7db46-edf5-478d-a195-7a58dbd916a8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.151289 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.151215    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/edf7db46-edf5-478d-a195-7a58dbd916a8-config-out\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.151390 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.151368    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-web-config\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.151617 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.151585    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.152212 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.152193    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-config-volume\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.152274 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.152255    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.152821 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.152799    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.442802 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:58.442773    2561 configmap.go:193] Couldn't get configMap openshift-monitoring/node-exporter-accelerators-collector-config: failed to sync configmap cache: timed out waiting for the condition
Jun 11 09:38:58.443156 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:58.442859    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-accelerators-collector-config podName:467788e2-8e4d-4a64-9f60-a23e74c31913 nodeName:}" failed. No retries permitted until 2026-06-11 09:38:58.942842272 +0000 UTC m=+266.063558894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-accelerators-collector-config" (UniqueName: "kubernetes.io/configmap/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-accelerators-collector-config") pod "node-exporter-bm2nt" (UID: "467788e2-8e4d-4a64-9f60-a23e74c31913") : failed to sync configmap cache: timed out waiting for the condition
Jun 11 09:38:58.443156 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:58.442935    2561 configmap.go:193] Couldn't get configMap openshift-monitoring/metrics-client-ca: failed to sync configmap cache: timed out waiting for the condition
Jun 11 09:38:58.443156 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:58.442995    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/467788e2-8e4d-4a64-9f60-a23e74c31913-metrics-client-ca podName:467788e2-8e4d-4a64-9f60-a23e74c31913 nodeName:}" failed. No retries permitted until 2026-06-11 09:38:58.942982922 +0000 UTC m=+266.063699544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-client-ca" (UniqueName: "kubernetes.io/configmap/467788e2-8e4d-4a64-9f60-a23e74c31913-metrics-client-ca") pod "node-exporter-bm2nt" (UID: "467788e2-8e4d-4a64-9f60-a23e74c31913") : failed to sync configmap cache: timed out waiting for the condition
Jun 11 09:38:58.452192 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:58.452176    2561 projected.go:291] Couldn't get configMap openshift-monitoring/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jun 11 09:38:58.478520 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.478495    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4qs24\""
Jun 11 09:38:58.651575 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.651534    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.653342 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.653325    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 11 09:38:58.654264 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.654241    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.659184 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.659164    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edf7db46-edf5-478d-a195-7a58dbd916a8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.721267 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.721196    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 11 09:38:58.807251 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.807222    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 11 09:38:58.812496 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.812465    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz9g5\" (UniqueName: \"kubernetes.io/projected/edf7db46-edf5-478d-a195-7a58dbd916a8-kube-api-access-mz9g5\") pod \"alertmanager-main-0\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.812635 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:58.812534    2561 projected.go:196] Error preparing data for projected volume kube-api-access-xj2fm for pod openshift-monitoring/node-exporter-bm2nt: failed to sync configmap cache: timed out waiting for the condition
Jun 11 09:38:58.812635 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:38:58.812592    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/467788e2-8e4d-4a64-9f60-a23e74c31913-kube-api-access-xj2fm podName:467788e2-8e4d-4a64-9f60-a23e74c31913 nodeName:}" failed. No retries permitted until 2026-06-11 09:38:59.312575064 +0000 UTC m=+266.433291693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xj2fm" (UniqueName: "kubernetes.io/projected/467788e2-8e4d-4a64-9f60-a23e74c31913-kube-api-access-xj2fm") pod "node-exporter-bm2nt" (UID: "467788e2-8e4d-4a64-9f60-a23e74c31913") : failed to sync configmap cache: timed out waiting for the condition
Jun 11 09:38:58.843498 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.843474    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:38:58.852522 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.852504    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 11 09:38:58.954457 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.954425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-accelerators-collector-config\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:58.954622 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.954485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/467788e2-8e4d-4a64-9f60-a23e74c31913-metrics-client-ca\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:58.954964 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.954943    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/467788e2-8e4d-4a64-9f60-a23e74c31913-node-exporter-accelerators-collector-config\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:58.955006 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:58.954983    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/467788e2-8e4d-4a64-9f60-a23e74c31913-metrics-client-ca\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:59.022002 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:38:59.021967    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf7db46_edf5_478d_a195_7a58dbd916a8.slice/crio-7538668774afa587d06fed9582d1faf3d8b381e6811a4d7a94202ac2f462022a WatchSource:0}: Error finding container 7538668774afa587d06fed9582d1faf3d8b381e6811a4d7a94202ac2f462022a: Status 404 returned error can't find the container with id 7538668774afa587d06fed9582d1faf3d8b381e6811a4d7a94202ac2f462022a
Jun 11 09:38:59.024941 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:59.024921    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 11 09:38:59.082014 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:59.081984    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-dk9xk"]
Jun 11 09:38:59.085261 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:59.085244    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-dk9xk"
Jun 11 09:38:59.091901 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:59.091880    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 11 09:38:59.098130 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:59.098110    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ks8z8\""
Jun 11 09:38:59.105230 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:59.105209    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 11 09:38:59.116072 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:59.116044    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-dk9xk"]
Jun 11 09:38:59.143527 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:59.143502    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edf7db46-edf5-478d-a195-7a58dbd916a8","Type":"ContainerStarted","Data":"7538668774afa587d06fed9582d1faf3d8b381e6811a4d7a94202ac2f462022a"}
Jun 11 09:38:59.256666 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:59.256633    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scncd\" (UniqueName: \"kubernetes.io/projected/368885f5-24a5-4239-b2a1-82a49f932621-kube-api-access-scncd\") pod \"downloads-6657875f97-dk9xk\" (UID: \"368885f5-24a5-4239-b2a1-82a49f932621\") " pod="openshift-console/downloads-6657875f97-dk9xk"
Jun 11 09:38:59.357508 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:59.357428    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj2fm\" (UniqueName: \"kubernetes.io/projected/467788e2-8e4d-4a64-9f60-a23e74c31913-kube-api-access-xj2fm\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:59.357508 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:59.357473    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scncd\" (UniqueName: \"kubernetes.io/projected/368885f5-24a5-4239-b2a1-82a49f932621-kube-api-access-scncd\") pod \"downloads-6657875f97-dk9xk\" (UID: \"368885f5-24a5-4239-b2a1-82a49f932621\") " pod="openshift-console/downloads-6657875f97-dk9xk"
Jun 11 09:38:59.359744 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:59.359728    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj2fm\" (UniqueName: \"kubernetes.io/projected/467788e2-8e4d-4a64-9f60-a23e74c31913-kube-api-access-xj2fm\") pod \"node-exporter-bm2nt\" (UID: \"467788e2-8e4d-4a64-9f60-a23e74c31913\") " pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:59.367508 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:59.367487    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scncd\" (UniqueName: \"kubernetes.io/projected/368885f5-24a5-4239-b2a1-82a49f932621-kube-api-access-scncd\") pod \"downloads-6657875f97-dk9xk\" (UID: \"368885f5-24a5-4239-b2a1-82a49f932621\") " pod="openshift-console/downloads-6657875f97-dk9xk"
Jun 11 09:38:59.393819 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:59.393790    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-dk9xk"
Jun 11 09:38:59.534555 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:59.534531    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-dk9xk"]
Jun 11 09:38:59.536973 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:38:59.536935    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod368885f5_24a5_4239_b2a1_82a49f932621.slice/crio-87964b2c85519f69df0e435fce4dc62bffce63dc778291e61aa681fc7f6bdd64 WatchSource:0}: Error finding container 87964b2c85519f69df0e435fce4dc62bffce63dc778291e61aa681fc7f6bdd64: Status 404 returned error can't find the container with id 87964b2c85519f69df0e435fce4dc62bffce63dc778291e61aa681fc7f6bdd64
Jun 11 09:38:59.620021 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:38:59.619957    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bm2nt"
Jun 11 09:38:59.630768 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:38:59.630742    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod467788e2_8e4d_4a64_9f60_a23e74c31913.slice/crio-7a7c6af668619a0734b947967c1da79d78c16b1cfdb71388b32aa249b335231d WatchSource:0}: Error finding container 7a7c6af668619a0734b947967c1da79d78c16b1cfdb71388b32aa249b335231d: Status 404 returned error can't find the container with id 7a7c6af668619a0734b947967c1da79d78c16b1cfdb71388b32aa249b335231d
Jun 11 09:39:00.150064 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:00.150034    2561 generic.go:356] "Generic (PLEG): container finished" podID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerID="4e650333800fc1e487091fa9a7c1abb8019491eed2835a733b9d189b1413cc42" exitCode=0
Jun 11 09:39:00.150218 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:00.150123    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edf7db46-edf5-478d-a195-7a58dbd916a8","Type":"ContainerDied","Data":"4e650333800fc1e487091fa9a7c1abb8019491eed2835a733b9d189b1413cc42"}
Jun 11 09:39:00.151538 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:00.151515    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bm2nt" event={"ID":"467788e2-8e4d-4a64-9f60-a23e74c31913","Type":"ContainerStarted","Data":"7a7c6af668619a0734b947967c1da79d78c16b1cfdb71388b32aa249b335231d"}
Jun 11 09:39:00.152663 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:00.152644    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-dk9xk" event={"ID":"368885f5-24a5-4239-b2a1-82a49f932621","Type":"ContainerStarted","Data":"87964b2c85519f69df0e435fce4dc62bffce63dc778291e61aa681fc7f6bdd64"}
Jun 11 09:39:01.159342 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:01.159301    2561 generic.go:356] "Generic (PLEG): container finished" podID="467788e2-8e4d-4a64-9f60-a23e74c31913" containerID="d5833ab0332277656801d697c397af9c9f44a0838f56809aa5fe440d99409894" exitCode=0
Jun 11 09:39:01.159833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:01.159369    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bm2nt" event={"ID":"467788e2-8e4d-4a64-9f60-a23e74c31913","Type":"ContainerDied","Data":"d5833ab0332277656801d697c397af9c9f44a0838f56809aa5fe440d99409894"}
Jun 11 09:39:02.167169 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:02.167083    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edf7db46-edf5-478d-a195-7a58dbd916a8","Type":"ContainerStarted","Data":"d02c3f733a141fca7c56f4424faf7f07ff837cdfc96f99753c2187342906320f"}
Jun 11 09:39:02.167585 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:02.167171    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edf7db46-edf5-478d-a195-7a58dbd916a8","Type":"ContainerStarted","Data":"91effe1031f3e34eca89b01529de7e11a15dc50fdffb3d7c2f015fc783338527"}
Jun 11 09:39:02.167585 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:02.167218    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edf7db46-edf5-478d-a195-7a58dbd916a8","Type":"ContainerStarted","Data":"81a0db167356d172ff853a5bdf4a7583859fd21dc8e127f675ed84f355fb4e1e"}
Jun 11 09:39:02.167585 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:02.167254    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edf7db46-edf5-478d-a195-7a58dbd916a8","Type":"ContainerStarted","Data":"6e459e078dc11d02fc00f29d056c8e2c6591826dbf82affeab4197e0261ff855"}
Jun 11 09:39:02.167585 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:02.167293    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edf7db46-edf5-478d-a195-7a58dbd916a8","Type":"ContainerStarted","Data":"206d4c3946064f5647509ad9ffb6cb082939f9b2842b8ed56e207e99079dd2e4"}
Jun 11 09:39:02.169536 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:02.169511    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bm2nt" event={"ID":"467788e2-8e4d-4a64-9f60-a23e74c31913","Type":"ContainerStarted","Data":"597c2808f41065e3b8dc96028a14eaf08c21c422d972a575bbf2906a5a32f9bc"}
Jun 11 09:39:02.169677 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:02.169551    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bm2nt" event={"ID":"467788e2-8e4d-4a64-9f60-a23e74c31913","Type":"ContainerStarted","Data":"aae572db8fb43bc6ca692dbfa3c86711f6f5b53d526f5e989c56cd62d440d270"}
Jun 11 09:39:02.197455 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:02.197384    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bm2nt" podStartSLOduration=4.229660215 podStartE2EDuration="5.197371456s" totalImagesPullingTime="889.799042ms" totalInitContainerRuntime="77.912199ms" isStatefulPod=true podCreationTimestamp="2026-06-11 09:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:39:02.196429185 +0000 UTC m=+269.317145828" watchObservedRunningTime="2026-06-11 09:39:02.197371456 +0000 UTC m=+269.318088099"
Jun 11 09:39:03.177004 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:03.176966    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edf7db46-edf5-478d-a195-7a58dbd916a8","Type":"ContainerStarted","Data":"9511e243acbf13241a9b77f475b39f91c4be651e49ef6ad2bf30460ded68ef6b"}
Jun 11 09:39:03.210853 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:03.210810    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.132455543 podStartE2EDuration="6.210793415s" totalImagesPullingTime="3.061257805s" totalInitContainerRuntime="17.080067ms" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:39:03.209366068 +0000 UTC m=+270.330082713" watchObservedRunningTime="2026-06-11 09:39:03.210793415 +0000 UTC m=+270.331510117"
Jun 11 09:39:04.327197 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:04.327163    2561 patch_prober.go:28] interesting pod/image-registry-65c7fd86d7-wm2g4 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 11 09:39:04.327559 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:04.327248    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4" podUID="0d9dfda7-5d46-4a9e-9edf-c14d35297db9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 11 09:39:06.097906 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.097868    2561 patch_prober.go:28] interesting pod/image-registry-65c7fd86d7-wm2g4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 11 09:39:06.098289 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.097921    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4" podUID="0d9dfda7-5d46-4a9e-9edf-c14d35297db9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 11 09:39:06.365462 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.365368    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54b555c65-njv6d"]
Jun 11 09:39:06.367896 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.367871    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.370699 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.370678    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 11 09:39:06.371595 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.371574    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 11 09:39:06.371695 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.371627    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 11 09:39:06.371754 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.371735    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 11 09:39:06.371877 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.371858    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9wwlz\""
Jun 11 09:39:06.371937 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.371927    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 11 09:39:06.382506 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.382485    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b555c65-njv6d"]
Jun 11 09:39:06.525214 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.525167    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-service-ca\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.525214 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.525211    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-oauth-serving-cert\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.525460 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.525243    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/893398f4-6c71-456e-9656-5b677db5e034-console-oauth-config\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.525460 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.525261    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-console-config\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.525460 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.525338    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-855fs\" (UniqueName: \"kubernetes.io/projected/893398f4-6c71-456e-9656-5b677db5e034-kube-api-access-855fs\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.525460 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.525441    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/893398f4-6c71-456e-9656-5b677db5e034-console-serving-cert\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.626756 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.626661    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-855fs\" (UniqueName: \"kubernetes.io/projected/893398f4-6c71-456e-9656-5b677db5e034-kube-api-access-855fs\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.626756 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.626742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/893398f4-6c71-456e-9656-5b677db5e034-console-serving-cert\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.626971 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.626786    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-service-ca\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.626971 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.626810    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-oauth-serving-cert\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.626971 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.626857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/893398f4-6c71-456e-9656-5b677db5e034-console-oauth-config\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.626971 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.626882    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-console-config\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.627805 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.627771    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-service-ca\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.627805 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.627789    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-console-config\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.627805 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.627795    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-oauth-serving-cert\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.629644 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.629619    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/893398f4-6c71-456e-9656-5b677db5e034-console-serving-cert\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.629775 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.629687    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/893398f4-6c71-456e-9656-5b677db5e034-console-oauth-config\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.638166 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.638142    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-855fs\" (UniqueName: \"kubernetes.io/projected/893398f4-6c71-456e-9656-5b677db5e034-kube-api-access-855fs\") pod \"console-54b555c65-njv6d\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") " pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.679008 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.678937    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:06.810264 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:06.810231    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b555c65-njv6d"]
Jun 11 09:39:06.814097 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:39:06.814004    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod893398f4_6c71_456e_9656_5b677db5e034.slice/crio-9dcbbdea7283feba9f6239dec62f325be436d9948fb10a7510a51d23d76076cf WatchSource:0}: Error finding container 9dcbbdea7283feba9f6239dec62f325be436d9948fb10a7510a51d23d76076cf: Status 404 returned error can't find the container with id 9dcbbdea7283feba9f6239dec62f325be436d9948fb10a7510a51d23d76076cf
Jun 11 09:39:07.195234 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:07.195196    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b555c65-njv6d" event={"ID":"893398f4-6c71-456e-9656-5b677db5e034","Type":"ContainerStarted","Data":"9dcbbdea7283feba9f6239dec62f325be436d9948fb10a7510a51d23d76076cf"}
Jun 11 09:39:10.217500 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:10.217460    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b555c65-njv6d" event={"ID":"893398f4-6c71-456e-9656-5b677db5e034","Type":"ContainerStarted","Data":"6d3fcd2f9044b77a9821550b1f7de347098f6cd17c54f7cef6c19d131f94dfdc"}
Jun 11 09:39:10.260027 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:10.259980    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54b555c65-njv6d" podStartSLOduration=1.011767794 podStartE2EDuration="4.259964236s" totalImagesPullingTime="3.248196442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:39:10.258020027 +0000 UTC m=+277.378736673" watchObservedRunningTime="2026-06-11 09:39:10.259964236 +0000 UTC m=+277.380680880"
Jun 11 09:39:13.830812 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:39:13.830767    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kwdx4" podUID="79ac9c32-23fe-459c-b7b9-af6c4bb5c707"
Jun 11 09:39:14.234000 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:14.233971    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:39:14.327457 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:14.327421    2561 patch_prober.go:28] interesting pod/image-registry-65c7fd86d7-wm2g4 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 11 09:39:14.327650 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:14.327482    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4" podUID="0d9dfda7-5d46-4a9e-9edf-c14d35297db9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 11 09:39:16.097103 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:16.097071    2561 patch_prober.go:28] interesting pod/image-registry-65c7fd86d7-wm2g4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 11 09:39:16.097645 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:16.097121    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4" podUID="0d9dfda7-5d46-4a9e-9edf-c14d35297db9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 11 09:39:16.679548 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:16.679507    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:16.679749 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:16.679585    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:16.681174 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:16.681149    2561 patch_prober.go:28] interesting pod/console-54b555c65-njv6d container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body=
Jun 11 09:39:16.681291 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:16.681192    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54b555c65-njv6d" podUID="893398f4-6c71-456e-9656-5b677db5e034" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused"
Jun 11 09:39:17.715303 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:17.715266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:39:17.718036 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:17.718004    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79ac9c32-23fe-459c-b7b9-af6c4bb5c707-metrics-tls\") pod \"dns-default-kwdx4\" (UID: \"79ac9c32-23fe-459c-b7b9-af6c4bb5c707\") " pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:39:17.837117 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:17.837080    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pgk2h\""
Jun 11 09:39:17.845274 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:17.845245    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:39:20.127071 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:20.127042    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kwdx4"]
Jun 11 09:39:20.134614 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:39:20.134575    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ac9c32_23fe_459c_b7b9_af6c4bb5c707.slice/crio-82a6da24a803c974834ca16d64da16d95c2f5a467fad5059bbe08073b8861a58 WatchSource:0}: Error finding container 82a6da24a803c974834ca16d64da16d95c2f5a467fad5059bbe08073b8861a58: Status 404 returned error can't find the container with id 82a6da24a803c974834ca16d64da16d95c2f5a467fad5059bbe08073b8861a58
Jun 11 09:39:20.260404 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:20.260326    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-dk9xk" event={"ID":"368885f5-24a5-4239-b2a1-82a49f932621","Type":"ContainerStarted","Data":"d60c157434ffc91ea04074aff50329bddaf96456f49b8d056b7b145ad98acf23"}
Jun 11 09:39:20.260560 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:20.260457    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-dk9xk"
Jun 11 09:39:20.261878 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:20.261852    2561 patch_prober.go:28] interesting pod/downloads-6657875f97-dk9xk container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.17:8080/\": dial tcp 10.134.0.17:8080: connect: connection refused" start-of-body=
Jun 11 09:39:20.261973 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:20.261903    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6657875f97-dk9xk" podUID="368885f5-24a5-4239-b2a1-82a49f932621" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.17:8080/\": dial tcp 10.134.0.17:8080: connect: connection refused"
Jun 11 09:39:20.261973 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:20.261944    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kwdx4" event={"ID":"79ac9c32-23fe-459c-b7b9-af6c4bb5c707","Type":"ContainerStarted","Data":"82a6da24a803c974834ca16d64da16d95c2f5a467fad5059bbe08073b8861a58"}
Jun 11 09:39:20.281136 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:20.281093    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-dk9xk" podStartSLOduration=0.724323388 podStartE2EDuration="21.281078356s" totalImagesPullingTime="20.556754968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:39:20.280472737 +0000 UTC m=+287.401189398" watchObservedRunningTime="2026-06-11 09:39:20.281078356 +0000 UTC m=+287.401794999"
Jun 11 09:39:21.278380 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:21.278240    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-dk9xk"
Jun 11 09:39:22.274555 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:22.274519    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kwdx4" event={"ID":"79ac9c32-23fe-459c-b7b9-af6c4bb5c707","Type":"ContainerStarted","Data":"c6e5f13bfcfc816c58536c10f47df3911493fa260a1b34d31e8db810d877c836"}
Jun 11 09:39:23.280405 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:23.280364    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kwdx4" event={"ID":"79ac9c32-23fe-459c-b7b9-af6c4bb5c707","Type":"ContainerStarted","Data":"8152c8f9de9d9e07bfe6377dd74f31296c79831f9ccefc84ca88cf630546ba8a"}
Jun 11 09:39:23.280864 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:23.280476    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:39:23.299188 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:23.299138    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kwdx4" podStartSLOduration=254.340247034 podStartE2EDuration="4m16.299119996s" totalImagesPullingTime="1.958872962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:39:23.298481292 +0000 UTC m=+290.419197936" watchObservedRunningTime="2026-06-11 09:39:23.299119996 +0000 UTC m=+290.419836641"
Jun 11 09:39:24.327170 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:24.327133    2561 patch_prober.go:28] interesting pod/image-registry-65c7fd86d7-wm2g4 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 11 09:39:24.327591 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:24.327190    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4" podUID="0d9dfda7-5d46-4a9e-9edf-c14d35297db9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 11 09:39:24.327591 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:24.327252    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:39:24.327878 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:24.327837    2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"08449d3963d1e8588a595ad3453385879819e77da21876aac4a69ddb52a19e7e"} pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4" containerMessage="Container registry failed liveness probe, will be restarted"
Jun 11 09:39:24.332068 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:24.332040    2561 patch_prober.go:28] interesting pod/image-registry-65c7fd86d7-wm2g4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 11 09:39:24.332185 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:24.332082    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4" podUID="0d9dfda7-5d46-4a9e-9edf-c14d35297db9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 11 09:39:26.680436 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:26.680403    2561 patch_prober.go:28] interesting pod/console-54b555c65-njv6d container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body=
Jun 11 09:39:26.680882 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:26.680464    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54b555c65-njv6d" podUID="893398f4-6c71-456e-9656-5b677db5e034" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused"
Jun 11 09:39:29.168584 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:29.168552    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_edf7db46-edf5-478d-a195-7a58dbd916a8/init-config-reloader/0.log"
Jun 11 09:39:29.369189 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:29.369161    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_edf7db46-edf5-478d-a195-7a58dbd916a8/alertmanager/0.log"
Jun 11 09:39:29.569406 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:29.569361    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_edf7db46-edf5-478d-a195-7a58dbd916a8/config-reloader/0.log"
Jun 11 09:39:29.769694 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:29.769663    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_edf7db46-edf5-478d-a195-7a58dbd916a8/kube-rbac-proxy-web/0.log"
Jun 11 09:39:29.968577 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:29.968499    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_edf7db46-edf5-478d-a195-7a58dbd916a8/kube-rbac-proxy/0.log"
Jun 11 09:39:30.168430 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:30.168397    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_edf7db46-edf5-478d-a195-7a58dbd916a8/kube-rbac-proxy-metric/0.log"
Jun 11 09:39:30.367687 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:30.367658    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_edf7db46-edf5-478d-a195-7a58dbd916a8/prom-label-proxy/0.log"
Jun 11 09:39:31.769267 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:31.769238    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bm2nt_467788e2-8e4d-4a64-9f60-a23e74c31913/init-textfile/0.log"
Jun 11 09:39:31.939385 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:31.939354    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b555c65-njv6d"]
Jun 11 09:39:31.976402 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:31.976369    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bm2nt_467788e2-8e4d-4a64-9f60-a23e74c31913/node-exporter/0.log"
Jun 11 09:39:32.171663 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:32.171563    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bm2nt_467788e2-8e4d-4a64-9f60-a23e74c31913/kube-rbac-proxy/0.log"
Jun 11 09:39:33.286231 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:33.286199    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kwdx4"
Jun 11 09:39:33.332840 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:33.332812    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 09:39:33.333022 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:33.333002    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 09:39:33.336477 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:33.336456    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jun 11 09:39:34.332449 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:34.332417    2561 patch_prober.go:28] interesting pod/image-registry-65c7fd86d7-wm2g4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 11 09:39:34.346888 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:34.332465    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4" podUID="0d9dfda7-5d46-4a9e-9edf-c14d35297db9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 11 09:39:37.969835 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:37.969791    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54b555c65-njv6d_893398f4-6c71-456e-9656-5b677db5e034/console/0.log"
Jun 11 09:39:38.372286 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:38.372258    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-dk9xk_368885f5-24a5-4239-b2a1-82a49f932621/download-server/0.log"
Jun 11 09:39:39.369339 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:39.369295    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kwdx4_79ac9c32-23fe-459c-b7b9-af6c4bb5c707/dns/0.log"
Jun 11 09:39:39.569633 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:39.569577    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kwdx4_79ac9c32-23fe-459c-b7b9-af6c4bb5c707/kube-rbac-proxy/0.log"
Jun 11 09:39:39.971801 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:39.971772    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lmpvz_b28fa7f8-061b-482e-bfeb-f0e51364c83e/dns-node-resolver/0.log"
Jun 11 09:39:40.368709 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:40.368674    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-65c7fd86d7-wm2g4_0d9dfda7-5d46-4a9e-9edf-c14d35297db9/registry/0.log"
Jun 11 09:39:40.971745 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:40.971720    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fmjh8_cadd281c-6a46-4e89-b608-ee346f7729ce/node-ca/0.log"
Jun 11 09:39:41.768369 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:41.768341    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gwvf5_e59603fc-27ab-414e-8394-7c4114bc6236/serve-healthcheck-canary/0.log"
Jun 11 09:39:44.338410 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:44.338118    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:39:49.352125 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:49.352076    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4" podUID="0d9dfda7-5d46-4a9e-9edf-c14d35297db9" containerName="registry" containerID="cri-o://08449d3963d1e8588a595ad3453385879819e77da21876aac4a69ddb52a19e7e" gracePeriod=30
Jun 11 09:39:49.384196 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:49.384160    2561 generic.go:356] "Generic (PLEG): container finished" podID="bf537e77-aed5-4420-9ca4-a3c5f101596b" containerID="cb53c7ed82d8810f1d2c4142120dd7757482d29ba7eead25a22f31231eddcf84" exitCode=0
Jun 11 09:39:49.384310 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:49.384196    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp" event={"ID":"bf537e77-aed5-4420-9ca4-a3c5f101596b","Type":"ContainerDied","Data":"cb53c7ed82d8810f1d2c4142120dd7757482d29ba7eead25a22f31231eddcf84"}
Jun 11 09:39:49.384478 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:49.384466    2561 scope.go:117] "RemoveContainer" containerID="cb53c7ed82d8810f1d2c4142120dd7757482d29ba7eead25a22f31231eddcf84"
Jun 11 09:39:50.390066 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:50.390030    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jsqvp" event={"ID":"bf537e77-aed5-4420-9ca4-a3c5f101596b","Type":"ContainerStarted","Data":"8c2dd29c632eafa4a8d36aa0cc5e32e0842140d425aed5afdf1981cefdaf61cb"}
Jun 11 09:39:51.395203 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:51.395173    2561 generic.go:356] "Generic (PLEG): container finished" podID="0d9dfda7-5d46-4a9e-9edf-c14d35297db9" containerID="08449d3963d1e8588a595ad3453385879819e77da21876aac4a69ddb52a19e7e" exitCode=0
Jun 11 09:39:51.395626 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:51.395267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4" event={"ID":"0d9dfda7-5d46-4a9e-9edf-c14d35297db9","Type":"ContainerDied","Data":"08449d3963d1e8588a595ad3453385879819e77da21876aac4a69ddb52a19e7e"}
Jun 11 09:39:51.395626 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:51.395317    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4" event={"ID":"0d9dfda7-5d46-4a9e-9edf-c14d35297db9","Type":"ContainerStarted","Data":"c24ba48476385f5aa9c21922c4be0e439b9b5f3c43f20b0dbcef54b76769a5a4"}
Jun 11 09:39:51.395626 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:51.395343    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:39:56.958461 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:56.958395    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54b555c65-njv6d" podUID="893398f4-6c71-456e-9656-5b677db5e034" containerName="console" containerID="cri-o://6d3fcd2f9044b77a9821550b1f7de347098f6cd17c54f7cef6c19d131f94dfdc" gracePeriod=15
Jun 11 09:39:57.227231 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.227177    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:57.348737 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.348706    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-service-ca\") pod \"893398f4-6c71-456e-9656-5b677db5e034\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") "
Jun 11 09:39:57.348865 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.348744    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/893398f4-6c71-456e-9656-5b677db5e034-console-oauth-config\") pod \"893398f4-6c71-456e-9656-5b677db5e034\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") "
Jun 11 09:39:57.348865 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.348763    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-console-config\") pod \"893398f4-6c71-456e-9656-5b677db5e034\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") "
Jun 11 09:39:57.348932 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.348911    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/893398f4-6c71-456e-9656-5b677db5e034-console-serving-cert\") pod \"893398f4-6c71-456e-9656-5b677db5e034\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") "
Jun 11 09:39:57.348972 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.348959    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-855fs\" (UniqueName: \"kubernetes.io/projected/893398f4-6c71-456e-9656-5b677db5e034-kube-api-access-855fs\") pod \"893398f4-6c71-456e-9656-5b677db5e034\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") "
Jun 11 09:39:57.349022 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.349009    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-oauth-serving-cert\") pod \"893398f4-6c71-456e-9656-5b677db5e034\" (UID: \"893398f4-6c71-456e-9656-5b677db5e034\") "
Jun 11 09:39:57.349166 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.349135    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-console-config" (OuterVolumeSpecName: "console-config") pod "893398f4-6c71-456e-9656-5b677db5e034" (UID: "893398f4-6c71-456e-9656-5b677db5e034"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 09:39:57.349166 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.349144    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-service-ca" (OuterVolumeSpecName: "service-ca") pod "893398f4-6c71-456e-9656-5b677db5e034" (UID: "893398f4-6c71-456e-9656-5b677db5e034"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 09:39:57.349337 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.349278    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-service-ca\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:39:57.349337 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.349297    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-console-config\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:39:57.349457 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.349421    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "893398f4-6c71-456e-9656-5b677db5e034" (UID: "893398f4-6c71-456e-9656-5b677db5e034"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 09:39:57.351003 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.350981    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/893398f4-6c71-456e-9656-5b677db5e034-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "893398f4-6c71-456e-9656-5b677db5e034" (UID: "893398f4-6c71-456e-9656-5b677db5e034"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:39:57.351106 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.351026    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/893398f4-6c71-456e-9656-5b677db5e034-kube-api-access-855fs" (OuterVolumeSpecName: "kube-api-access-855fs") pod "893398f4-6c71-456e-9656-5b677db5e034" (UID: "893398f4-6c71-456e-9656-5b677db5e034"). InnerVolumeSpecName "kube-api-access-855fs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 09:39:57.351106 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.351037    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/893398f4-6c71-456e-9656-5b677db5e034-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "893398f4-6c71-456e-9656-5b677db5e034" (UID: "893398f4-6c71-456e-9656-5b677db5e034"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:39:57.417389 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.417360    2561 generic.go:356] "Generic (PLEG): container finished" podID="893398f4-6c71-456e-9656-5b677db5e034" containerID="6d3fcd2f9044b77a9821550b1f7de347098f6cd17c54f7cef6c19d131f94dfdc" exitCode=0
Jun 11 09:39:57.417499 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.417409    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b555c65-njv6d"
Jun 11 09:39:57.417499 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.417446    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b555c65-njv6d" event={"ID":"893398f4-6c71-456e-9656-5b677db5e034","Type":"ContainerDied","Data":"6d3fcd2f9044b77a9821550b1f7de347098f6cd17c54f7cef6c19d131f94dfdc"}
Jun 11 09:39:57.417499 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.417493    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b555c65-njv6d" event={"ID":"893398f4-6c71-456e-9656-5b677db5e034","Type":"ContainerDied","Data":"9dcbbdea7283feba9f6239dec62f325be436d9948fb10a7510a51d23d76076cf"}
Jun 11 09:39:57.417681 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.417526    2561 scope.go:117] "RemoveContainer" containerID="6d3fcd2f9044b77a9821550b1f7de347098f6cd17c54f7cef6c19d131f94dfdc"
Jun 11 09:39:57.432711 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.432695    2561 scope.go:117] "RemoveContainer" containerID="6d3fcd2f9044b77a9821550b1f7de347098f6cd17c54f7cef6c19d131f94dfdc"
Jun 11 09:39:57.432980 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:39:57.432960    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d3fcd2f9044b77a9821550b1f7de347098f6cd17c54f7cef6c19d131f94dfdc\": container with ID starting with 6d3fcd2f9044b77a9821550b1f7de347098f6cd17c54f7cef6c19d131f94dfdc not found: ID does not exist" containerID="6d3fcd2f9044b77a9821550b1f7de347098f6cd17c54f7cef6c19d131f94dfdc"
Jun 11 09:39:57.433027 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.432989    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d3fcd2f9044b77a9821550b1f7de347098f6cd17c54f7cef6c19d131f94dfdc"} err="failed to get container status \"6d3fcd2f9044b77a9821550b1f7de347098f6cd17c54f7cef6c19d131f94dfdc\": rpc error: code = NotFound desc = could not find container \"6d3fcd2f9044b77a9821550b1f7de347098f6cd17c54f7cef6c19d131f94dfdc\": container with ID starting with 6d3fcd2f9044b77a9821550b1f7de347098f6cd17c54f7cef6c19d131f94dfdc not found: ID does not exist"
Jun 11 09:39:57.435432 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.435414    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b555c65-njv6d"]
Jun 11 09:39:57.441899 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.441878    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54b555c65-njv6d"]
Jun 11 09:39:57.450078 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.450061    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/893398f4-6c71-456e-9656-5b677db5e034-console-oauth-config\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:39:57.450137 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.450082    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/893398f4-6c71-456e-9656-5b677db5e034-console-serving-cert\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:39:57.450137 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.450092    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-855fs\" (UniqueName: \"kubernetes.io/projected/893398f4-6c71-456e-9656-5b677db5e034-kube-api-access-855fs\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:39:57.450137 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:57.450101    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/893398f4-6c71-456e-9656-5b677db5e034-oauth-serving-cert\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:39:59.377565 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:39:59.377525    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="893398f4-6c71-456e-9656-5b677db5e034" path="/var/lib/kubelet/pods/893398f4-6c71-456e-9656-5b677db5e034/volumes"
Jun 11 09:40:12.402999 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:12.402970    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65c7fd86d7-wm2g4"
Jun 11 09:40:17.347846 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.347767    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 11 09:40:17.348241 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.348070    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="alertmanager" containerID="cri-o://206d4c3946064f5647509ad9ffb6cb082939f9b2842b8ed56e207e99079dd2e4" gracePeriod=120
Jun 11 09:40:17.348241 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.348143    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="kube-rbac-proxy-metric" containerID="cri-o://d02c3f733a141fca7c56f4424faf7f07ff837cdfc96f99753c2187342906320f" gracePeriod=120
Jun 11 09:40:17.348241 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.348164    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="kube-rbac-proxy-web" containerID="cri-o://81a0db167356d172ff853a5bdf4a7583859fd21dc8e127f675ed84f355fb4e1e" gracePeriod=120
Jun 11 09:40:17.348241 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.348212    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="config-reloader" containerID="cri-o://6e459e078dc11d02fc00f29d056c8e2c6591826dbf82affeab4197e0261ff855" gracePeriod=120
Jun 11 09:40:17.348466 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.348227    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="kube-rbac-proxy" containerID="cri-o://91effe1031f3e34eca89b01529de7e11a15dc50fdffb3d7c2f015fc783338527" gracePeriod=120
Jun 11 09:40:17.348466 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.348373    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="prom-label-proxy" containerID="cri-o://9511e243acbf13241a9b77f475b39f91c4be651e49ef6ad2bf30460ded68ef6b" gracePeriod=120
Jun 11 09:40:17.492987 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.492958    2561 generic.go:356] "Generic (PLEG): container finished" podID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerID="9511e243acbf13241a9b77f475b39f91c4be651e49ef6ad2bf30460ded68ef6b" exitCode=0
Jun 11 09:40:17.492987 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.492988    2561 generic.go:356] "Generic (PLEG): container finished" podID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerID="d02c3f733a141fca7c56f4424faf7f07ff837cdfc96f99753c2187342906320f" exitCode=0
Jun 11 09:40:17.493154 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.492995    2561 generic.go:356] "Generic (PLEG): container finished" podID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerID="91effe1031f3e34eca89b01529de7e11a15dc50fdffb3d7c2f015fc783338527" exitCode=0
Jun 11 09:40:17.493154 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.493000    2561 generic.go:356] "Generic (PLEG): container finished" podID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerID="6e459e078dc11d02fc00f29d056c8e2c6591826dbf82affeab4197e0261ff855" exitCode=0
Jun 11 09:40:17.493154 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.493005    2561 generic.go:356] "Generic (PLEG): container finished" podID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerID="206d4c3946064f5647509ad9ffb6cb082939f9b2842b8ed56e207e99079dd2e4" exitCode=0
Jun 11 09:40:17.493154 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.493030    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edf7db46-edf5-478d-a195-7a58dbd916a8","Type":"ContainerDied","Data":"9511e243acbf13241a9b77f475b39f91c4be651e49ef6ad2bf30460ded68ef6b"}
Jun 11 09:40:17.493154 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.493108    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edf7db46-edf5-478d-a195-7a58dbd916a8","Type":"ContainerDied","Data":"d02c3f733a141fca7c56f4424faf7f07ff837cdfc96f99753c2187342906320f"}
Jun 11 09:40:17.493359 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.493154    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edf7db46-edf5-478d-a195-7a58dbd916a8","Type":"ContainerDied","Data":"91effe1031f3e34eca89b01529de7e11a15dc50fdffb3d7c2f015fc783338527"}
Jun 11 09:40:17.493359 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.493196    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edf7db46-edf5-478d-a195-7a58dbd916a8","Type":"ContainerDied","Data":"6e459e078dc11d02fc00f29d056c8e2c6591826dbf82affeab4197e0261ff855"}
Jun 11 09:40:17.493359 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:17.493238    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edf7db46-edf5-478d-a195-7a58dbd916a8","Type":"ContainerDied","Data":"206d4c3946064f5647509ad9ffb6cb082939f9b2842b8ed56e207e99079dd2e4"}
Jun 11 09:40:18.501234 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.501204    2561 generic.go:356] "Generic (PLEG): container finished" podID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerID="81a0db167356d172ff853a5bdf4a7583859fd21dc8e127f675ed84f355fb4e1e" exitCode=0
Jun 11 09:40:18.501653 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.501277    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edf7db46-edf5-478d-a195-7a58dbd916a8","Type":"ContainerDied","Data":"81a0db167356d172ff853a5bdf4a7583859fd21dc8e127f675ed84f355fb4e1e"}
Jun 11 09:40:18.589312 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.589290    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:18.690328 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.690250    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"edf7db46-edf5-478d-a195-7a58dbd916a8\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") "
Jun 11 09:40:18.690328 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.690326    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-web-config\") pod \"edf7db46-edf5-478d-a195-7a58dbd916a8\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") "
Jun 11 09:40:18.690503 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.690350    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy-web\") pod \"edf7db46-edf5-478d-a195-7a58dbd916a8\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") "
Jun 11 09:40:18.690503 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.690386    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/edf7db46-edf5-478d-a195-7a58dbd916a8-tls-assets\") pod \"edf7db46-edf5-478d-a195-7a58dbd916a8\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") "
Jun 11 09:40:18.690503 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.690408    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/edf7db46-edf5-478d-a195-7a58dbd916a8-config-out\") pod \"edf7db46-edf5-478d-a195-7a58dbd916a8\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") "
Jun 11 09:40:18.690503 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.690434    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/edf7db46-edf5-478d-a195-7a58dbd916a8-alertmanager-main-db\") pod \"edf7db46-edf5-478d-a195-7a58dbd916a8\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") "
Jun 11 09:40:18.690503 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.690465    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz9g5\" (UniqueName: \"kubernetes.io/projected/edf7db46-edf5-478d-a195-7a58dbd916a8-kube-api-access-mz9g5\") pod \"edf7db46-edf5-478d-a195-7a58dbd916a8\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") "
Jun 11 09:40:18.690503 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.690494    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-cluster-tls-config\") pod \"edf7db46-edf5-478d-a195-7a58dbd916a8\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") "
Jun 11 09:40:18.690834 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.690531    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy\") pod \"edf7db46-edf5-478d-a195-7a58dbd916a8\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") "
Jun 11 09:40:18.690834 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.690569    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-config-volume\") pod \"edf7db46-edf5-478d-a195-7a58dbd916a8\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") "
Jun 11 09:40:18.690834 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.690642    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edf7db46-edf5-478d-a195-7a58dbd916a8-metrics-client-ca\") pod \"edf7db46-edf5-478d-a195-7a58dbd916a8\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") "
Jun 11 09:40:18.690834 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.690674    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-main-tls\") pod \"edf7db46-edf5-478d-a195-7a58dbd916a8\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") "
Jun 11 09:40:18.691062 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.691033    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edf7db46-edf5-478d-a195-7a58dbd916a8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "edf7db46-edf5-478d-a195-7a58dbd916a8" (UID: "edf7db46-edf5-478d-a195-7a58dbd916a8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 09:40:18.691900 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.691869    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edf7db46-edf5-478d-a195-7a58dbd916a8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "edf7db46-edf5-478d-a195-7a58dbd916a8" (UID: "edf7db46-edf5-478d-a195-7a58dbd916a8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 09:40:18.693618 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.693324    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "edf7db46-edf5-478d-a195-7a58dbd916a8" (UID: "edf7db46-edf5-478d-a195-7a58dbd916a8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:40:18.693714 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.693678    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edf7db46-edf5-478d-a195-7a58dbd916a8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "edf7db46-edf5-478d-a195-7a58dbd916a8" (UID: "edf7db46-edf5-478d-a195-7a58dbd916a8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 09:40:18.693714 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.693703    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edf7db46-edf5-478d-a195-7a58dbd916a8-config-out" (OuterVolumeSpecName: "config-out") pod "edf7db46-edf5-478d-a195-7a58dbd916a8" (UID: "edf7db46-edf5-478d-a195-7a58dbd916a8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 09:40:18.693832 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.693700    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-config-volume" (OuterVolumeSpecName: "config-volume") pod "edf7db46-edf5-478d-a195-7a58dbd916a8" (UID: "edf7db46-edf5-478d-a195-7a58dbd916a8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:40:18.693832 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.693784    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "edf7db46-edf5-478d-a195-7a58dbd916a8" (UID: "edf7db46-edf5-478d-a195-7a58dbd916a8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:40:18.694230 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.694203    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "edf7db46-edf5-478d-a195-7a58dbd916a8" (UID: "edf7db46-edf5-478d-a195-7a58dbd916a8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:40:18.694530 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.694508    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edf7db46-edf5-478d-a195-7a58dbd916a8-kube-api-access-mz9g5" (OuterVolumeSpecName: "kube-api-access-mz9g5") pod "edf7db46-edf5-478d-a195-7a58dbd916a8" (UID: "edf7db46-edf5-478d-a195-7a58dbd916a8"). InnerVolumeSpecName "kube-api-access-mz9g5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 09:40:18.695321 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.695293    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "edf7db46-edf5-478d-a195-7a58dbd916a8" (UID: "edf7db46-edf5-478d-a195-7a58dbd916a8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:40:18.697435 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.697412    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "edf7db46-edf5-478d-a195-7a58dbd916a8" (UID: "edf7db46-edf5-478d-a195-7a58dbd916a8"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:40:18.703012 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.702992    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-web-config" (OuterVolumeSpecName: "web-config") pod "edf7db46-edf5-478d-a195-7a58dbd916a8" (UID: "edf7db46-edf5-478d-a195-7a58dbd916a8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:40:18.791864 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.791832    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf7db46-edf5-478d-a195-7a58dbd916a8-alertmanager-trusted-ca-bundle\") pod \"edf7db46-edf5-478d-a195-7a58dbd916a8\" (UID: \"edf7db46-edf5-478d-a195-7a58dbd916a8\") "
Jun 11 09:40:18.792016 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.791988    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz9g5\" (UniqueName: \"kubernetes.io/projected/edf7db46-edf5-478d-a195-7a58dbd916a8-kube-api-access-mz9g5\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:40:18.792016 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.792000    2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-cluster-tls-config\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:40:18.792016 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.792010    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:40:18.792114 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.792020    2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-config-volume\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:40:18.792114 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.792029    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edf7db46-edf5-478d-a195-7a58dbd916a8-metrics-client-ca\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:40:18.792114 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.792037    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-main-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:40:18.792114 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.792046    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:40:18.792114 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.792055    2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-web-config\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:40:18.792114 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.792063    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edf7db46-edf5-478d-a195-7a58dbd916a8-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:40:18.792114 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.792072    2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/edf7db46-edf5-478d-a195-7a58dbd916a8-tls-assets\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:40:18.792114 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.792080    2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/edf7db46-edf5-478d-a195-7a58dbd916a8-config-out\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:40:18.792114 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.792088    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/edf7db46-edf5-478d-a195-7a58dbd916a8-alertmanager-main-db\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:40:18.792362 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.792172    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edf7db46-edf5-478d-a195-7a58dbd916a8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "edf7db46-edf5-478d-a195-7a58dbd916a8" (UID: "edf7db46-edf5-478d-a195-7a58dbd916a8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 09:40:18.892971 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:18.892936    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf7db46-edf5-478d-a195-7a58dbd916a8-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:40:19.514231 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.514171    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edf7db46-edf5-478d-a195-7a58dbd916a8","Type":"ContainerDied","Data":"7538668774afa587d06fed9582d1faf3d8b381e6811a4d7a94202ac2f462022a"}
Jun 11 09:40:19.514584 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.514202    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.514584 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.514327    2561 scope.go:117] "RemoveContainer" containerID="9511e243acbf13241a9b77f475b39f91c4be651e49ef6ad2bf30460ded68ef6b"
Jun 11 09:40:19.521445 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.521430    2561 scope.go:117] "RemoveContainer" containerID="d02c3f733a141fca7c56f4424faf7f07ff837cdfc96f99753c2187342906320f"
Jun 11 09:40:19.528101 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.528085    2561 scope.go:117] "RemoveContainer" containerID="91effe1031f3e34eca89b01529de7e11a15dc50fdffb3d7c2f015fc783338527"
Jun 11 09:40:19.534224 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.534205    2561 scope.go:117] "RemoveContainer" containerID="81a0db167356d172ff853a5bdf4a7583859fd21dc8e127f675ed84f355fb4e1e"
Jun 11 09:40:19.536584 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.536562    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 11 09:40:19.541184 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.541166    2561 scope.go:117] "RemoveContainer" containerID="6e459e078dc11d02fc00f29d056c8e2c6591826dbf82affeab4197e0261ff855"
Jun 11 09:40:19.542085 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.542066    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 11 09:40:19.547580 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.547563    2561 scope.go:117] "RemoveContainer" containerID="206d4c3946064f5647509ad9ffb6cb082939f9b2842b8ed56e207e99079dd2e4"
Jun 11 09:40:19.553959 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.553930    2561 scope.go:117] "RemoveContainer" containerID="4e650333800fc1e487091fa9a7c1abb8019491eed2835a733b9d189b1413cc42"
Jun 11 09:40:19.573033 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573013    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 11 09:40:19.573247 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573236    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="kube-rbac-proxy-web"
Jun 11 09:40:19.573291 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573249    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="kube-rbac-proxy-web"
Jun 11 09:40:19.573291 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573261    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="prom-label-proxy"
Jun 11 09:40:19.573291 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573267    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="prom-label-proxy"
Jun 11 09:40:19.573291 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573275    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="893398f4-6c71-456e-9656-5b677db5e034" containerName="console"
Jun 11 09:40:19.573291 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573281    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="893398f4-6c71-456e-9656-5b677db5e034" containerName="console"
Jun 11 09:40:19.573291 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573290    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="kube-rbac-proxy"
Jun 11 09:40:19.573464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573295    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="kube-rbac-proxy"
Jun 11 09:40:19.573464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573301    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="init-config-reloader"
Jun 11 09:40:19.573464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573307    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="init-config-reloader"
Jun 11 09:40:19.573464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573313    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="config-reloader"
Jun 11 09:40:19.573464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573319    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="config-reloader"
Jun 11 09:40:19.573464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573327    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="alertmanager"
Jun 11 09:40:19.573464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573332    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="alertmanager"
Jun 11 09:40:19.573464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573337    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="kube-rbac-proxy-metric"
Jun 11 09:40:19.573464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573343    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="kube-rbac-proxy-metric"
Jun 11 09:40:19.573464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573382    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="893398f4-6c71-456e-9656-5b677db5e034" containerName="console"
Jun 11 09:40:19.573464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573389    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="prom-label-proxy"
Jun 11 09:40:19.573464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573397    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="kube-rbac-proxy-metric"
Jun 11 09:40:19.573464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573402    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="config-reloader"
Jun 11 09:40:19.573464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573407    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="kube-rbac-proxy-web"
Jun 11 09:40:19.573464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573412    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="kube-rbac-proxy"
Jun 11 09:40:19.573464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.573417    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" containerName="alertmanager"
Jun 11 09:40:19.576767 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.576752    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.579157 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.579132    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 11 09:40:19.579273 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.579251    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 11 09:40:19.579388 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.579264    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 11 09:40:19.579436 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.579400    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 11 09:40:19.579508 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.579493    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 11 09:40:19.579645 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.579629    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 11 09:40:19.579739 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.579722    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gzj55\""
Jun 11 09:40:19.579780 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.579727    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 11 09:40:19.579939 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.579927    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 11 09:40:19.586239 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.586220    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 11 09:40:19.596978 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.596926    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.596978 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.596967    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-config-out\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.597187 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.597024    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.597187 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.597052    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.597187 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.597076    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfk29\" (UniqueName: \"kubernetes.io/projected/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-kube-api-access-rfk29\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.597187 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.597096    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.597187 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.597114    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-web-config\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.597187 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.597129    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-config-volume\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.597187 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.597169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.597489 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.597205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.597489 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.597238    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.597489 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.597262    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.597489 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.597291    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.598567 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.598549    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 11 09:40:19.697931 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.697845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-config-out\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.697931 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.697886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.697931 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.697912    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.698202 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.697941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfk29\" (UniqueName: \"kubernetes.io/projected/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-kube-api-access-rfk29\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.698202 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.697965    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.698202 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.697986    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-web-config\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.698202 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.698007    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-config-volume\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.698202 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.698051    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.698202 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.698073    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.698202 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.698105    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.698202 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.698129    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.698202 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.698154    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.698663 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.698208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.698663 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.698328    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.698971 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.698940    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.699484 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.699465    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.701141 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.701112    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-config-volume\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.701306 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.701286    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.701366 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.701321    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-config-out\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.701366 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.701343    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-web-config\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.701829 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.701800    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.701918 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.701897    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.701968 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.701919    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.701968 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.701899    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.702533 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.702514    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.707097 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.707079    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfk29\" (UniqueName: \"kubernetes.io/projected/38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5-kube-api-access-rfk29\") pod \"alertmanager-main-0\" (UID: \"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:19.886275 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:19.886241    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 11 09:40:20.019340 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:20.019318    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 11 09:40:20.021275 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:40:20.021247    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a3e771_78e6_4c5b_8f2b_1512e3a3e5b5.slice/crio-dd54b33d9a12d3272e38beab7568cd08abd7a886e199d0cc290fbb50534cb9c4 WatchSource:0}: Error finding container dd54b33d9a12d3272e38beab7568cd08abd7a886e199d0cc290fbb50534cb9c4: Status 404 returned error can't find the container with id dd54b33d9a12d3272e38beab7568cd08abd7a886e199d0cc290fbb50534cb9c4
Jun 11 09:40:20.519482 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:20.519447    2561 generic.go:356] "Generic (PLEG): container finished" podID="38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5" containerID="6e8837f310c17989538e1cc8c5a503a69f192371ba08f71bbc145cc5ef4a3b17" exitCode=0
Jun 11 09:40:20.519942 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:20.519530    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5","Type":"ContainerDied","Data":"6e8837f310c17989538e1cc8c5a503a69f192371ba08f71bbc145cc5ef4a3b17"}
Jun 11 09:40:20.519942 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:20.519595    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5","Type":"ContainerStarted","Data":"dd54b33d9a12d3272e38beab7568cd08abd7a886e199d0cc290fbb50534cb9c4"}
Jun 11 09:40:21.379297 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.379267    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edf7db46-edf5-478d-a195-7a58dbd916a8" path="/var/lib/kubelet/pods/edf7db46-edf5-478d-a195-7a58dbd916a8/volumes"
Jun 11 09:40:21.388671 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.388643    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"]
Jun 11 09:40:21.390815 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.390798    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.393640 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.393621    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jun 11 09:40:21.393979 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.393935    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jun 11 09:40:21.394058 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.393984    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jun 11 09:40:21.394058 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.393989    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-d2z96\""
Jun 11 09:40:21.394271 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.394253    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jun 11 09:40:21.394271 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.394262    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jun 11 09:40:21.408141 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.402697    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jun 11 09:40:21.408141 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.408117    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d8a779d-68f0-4ea3-87fc-87955ac4458c-serving-certs-ca-bundle\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.408328 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.408170    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7d8a779d-68f0-4ea3-87fc-87955ac4458c-federate-client-tls\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.408328 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.408251    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7d8a779d-68f0-4ea3-87fc-87955ac4458c-telemeter-client-tls\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.408328 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.408288    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7d8a779d-68f0-4ea3-87fc-87955ac4458c-secret-telemeter-client\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.408478 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.408362    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d8a779d-68f0-4ea3-87fc-87955ac4458c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.408478 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.408380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d8a779d-68f0-4ea3-87fc-87955ac4458c-metrics-client-ca\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.408478 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.408440    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d8a779d-68f0-4ea3-87fc-87955ac4458c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.408478 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.408462    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4ccc\" (UniqueName: \"kubernetes.io/projected/7d8a779d-68f0-4ea3-87fc-87955ac4458c-kube-api-access-v4ccc\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.410846 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.410820    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"]
Jun 11 09:40:21.508795 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.508763    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7d8a779d-68f0-4ea3-87fc-87955ac4458c-secret-telemeter-client\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.508969 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.508808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d8a779d-68f0-4ea3-87fc-87955ac4458c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.508969 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.508832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d8a779d-68f0-4ea3-87fc-87955ac4458c-metrics-client-ca\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.508969 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.508859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d8a779d-68f0-4ea3-87fc-87955ac4458c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.508969 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.508882    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4ccc\" (UniqueName: \"kubernetes.io/projected/7d8a779d-68f0-4ea3-87fc-87955ac4458c-kube-api-access-v4ccc\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.508969 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.508921    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d8a779d-68f0-4ea3-87fc-87955ac4458c-serving-certs-ca-bundle\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.508969 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.508941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7d8a779d-68f0-4ea3-87fc-87955ac4458c-federate-client-tls\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.509297 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.509153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7d8a779d-68f0-4ea3-87fc-87955ac4458c-telemeter-client-tls\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.509770 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.509724    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d8a779d-68f0-4ea3-87fc-87955ac4458c-metrics-client-ca\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.510047 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.510006    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d8a779d-68f0-4ea3-87fc-87955ac4458c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.510139 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.510057    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d8a779d-68f0-4ea3-87fc-87955ac4458c-serving-certs-ca-bundle\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.511616 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.511581    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7d8a779d-68f0-4ea3-87fc-87955ac4458c-telemeter-client-tls\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.511706 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.511621    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d8a779d-68f0-4ea3-87fc-87955ac4458c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.511806 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.511788    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7d8a779d-68f0-4ea3-87fc-87955ac4458c-secret-telemeter-client\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.511844 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.511811    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7d8a779d-68f0-4ea3-87fc-87955ac4458c-federate-client-tls\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.518458 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.518436    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4ccc\" (UniqueName: \"kubernetes.io/projected/7d8a779d-68f0-4ea3-87fc-87955ac4458c-kube-api-access-v4ccc\") pod \"telemeter-client-7fb6c5b8d9-lzrn8\" (UID: \"7d8a779d-68f0-4ea3-87fc-87955ac4458c\") " pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.528435 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.528410    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5","Type":"ContainerStarted","Data":"e384df5fb6033ecd9b115250e290315fd7eb0e67c325a174fbff07e0cb41a9f2"}
Jun 11 09:40:21.528751 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.528469    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5","Type":"ContainerStarted","Data":"133c5d65e8384ed8f8da781498acda43fad0766567178d53706df74be41bdb85"}
Jun 11 09:40:21.528751 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.528494    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5","Type":"ContainerStarted","Data":"98bc40a232ee635eda09c46735f1ec8a8a33737b7905af1c7672f358e2437f81"}
Jun 11 09:40:21.528751 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.528524    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5","Type":"ContainerStarted","Data":"8138eb9e6ca55886bf832da6fa9eca05d99a0d7176bc33e465e959b5f38242e3"}
Jun 11 09:40:21.528751 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.528548    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5","Type":"ContainerStarted","Data":"7c7c4f691f15b9a12074f60dea7c9d4c7f470d7254c0212674519e8320342118"}
Jun 11 09:40:21.528751 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.528571    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5","Type":"ContainerStarted","Data":"80e3af6b653a3f3789820efce9e1fecea104f62b1a9fd9919cd9b80871c61a50"}
Jun 11 09:40:21.559702 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.559659    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.544491463 podStartE2EDuration="2.559642477s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.151014ms" isStatefulPod=false podCreationTimestamp="2026-06-11 09:40:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:40:21.55774008 +0000 UTC m=+348.678456727" watchObservedRunningTime="2026-06-11 09:40:21.559642477 +0000 UTC m=+348.680359121"
Jun 11 09:40:21.712735 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.712639    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"
Jun 11 09:40:21.846231 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.846210    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8"]
Jun 11 09:40:21.848351 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:40:21.848328    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d8a779d_68f0_4ea3_87fc_87955ac4458c.slice/crio-6ce75c99ef52e5557ca437161c7fee3c55c214469f90ad01a9d18c97ad78bfc0 WatchSource:0}: Error finding container 6ce75c99ef52e5557ca437161c7fee3c55c214469f90ad01a9d18c97ad78bfc0: Status 404 returned error can't find the container with id 6ce75c99ef52e5557ca437161c7fee3c55c214469f90ad01a9d18c97ad78bfc0
Jun 11 09:40:21.850309 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:21.850290    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 11 09:40:22.534612 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:22.534552    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8" event={"ID":"7d8a779d-68f0-4ea3-87fc-87955ac4458c","Type":"ContainerStarted","Data":"6ce75c99ef52e5557ca437161c7fee3c55c214469f90ad01a9d18c97ad78bfc0"}
Jun 11 09:40:24.544192 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:24.544154    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8" event={"ID":"7d8a779d-68f0-4ea3-87fc-87955ac4458c","Type":"ContainerStarted","Data":"2f81ebfeb29190095010e4882500263c23f50022a189f70c046bed548d12fc09"}
Jun 11 09:40:24.544682 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:24.544216    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8" event={"ID":"7d8a779d-68f0-4ea3-87fc-87955ac4458c","Type":"ContainerStarted","Data":"f59ab559be0e04d4c06997ad7c1d91acdd92c138af99174c8bd32e7758e8be18"}
Jun 11 09:40:24.544682 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:24.544248    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8" event={"ID":"7d8a779d-68f0-4ea3-87fc-87955ac4458c","Type":"ContainerStarted","Data":"2162c4f6b5e422dbf50fd4ded445bbd91eb8c84114a1d560dc39bddfe17f81e1"}
Jun 11 09:40:24.572759 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:24.572710    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7fb6c5b8d9-lzrn8" podStartSLOduration=1.464682282 podStartE2EDuration="3.572693823s" totalImagesPullingTime="2.108011541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:40:24.5715081 +0000 UTC m=+351.692224745" watchObservedRunningTime="2026-06-11 09:40:24.572693823 +0000 UTC m=+351.693410469"
Jun 11 09:40:25.887527 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.887497    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-df67d7dfc-rvqkx"]
Jun 11 09:40:25.889815 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.889795    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:25.892708 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.892682    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 11 09:40:25.892833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.892733    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 11 09:40:25.893822 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.893805    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 11 09:40:25.893911 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.893867    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9wwlz\""
Jun 11 09:40:25.893980 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.893868    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 11 09:40:25.893980 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.893867    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 11 09:40:25.902125 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.902106    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 11 09:40:25.906899 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.906881    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-df67d7dfc-rvqkx"]
Jun 11 09:40:25.942114 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.942080    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-oauth-config\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:25.942258 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.942120    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-trusted-ca-bundle\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:25.942258 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.942146    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-config\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:25.942258 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.942164    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-service-ca\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:25.942258 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.942191    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5mtb\" (UniqueName: \"kubernetes.io/projected/03cf5a28-3756-40d5-aecb-e63e19be53d7-kube-api-access-n5mtb\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:25.942258 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.942241    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-oauth-serving-cert\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:25.942430 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:25.942273    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-serving-cert\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:26.043068 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.043035    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-oauth-config\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:26.043192 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.043075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-trusted-ca-bundle\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:26.043192 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.043117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-config\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:26.043192 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.043138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-service-ca\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:26.043192 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.043178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5mtb\" (UniqueName: \"kubernetes.io/projected/03cf5a28-3756-40d5-aecb-e63e19be53d7-kube-api-access-n5mtb\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:26.043411 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.043204    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-oauth-serving-cert\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:26.043411 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.043247    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-serving-cert\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:26.043959 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.043924    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-config\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:26.044083 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.044056    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-service-ca\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:26.044083 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.044074    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-oauth-serving-cert\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:26.044188 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.044118    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-trusted-ca-bundle\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:26.045676 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.045649    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-serving-cert\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:26.045741 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.045716    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-oauth-config\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:26.056154 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.056133    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5mtb\" (UniqueName: \"kubernetes.io/projected/03cf5a28-3756-40d5-aecb-e63e19be53d7-kube-api-access-n5mtb\") pod \"console-df67d7dfc-rvqkx\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") " pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:26.199814 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.199731    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:26.325552 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.325523    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-df67d7dfc-rvqkx"]
Jun 11 09:40:26.328795 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:40:26.328767    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03cf5a28_3756_40d5_aecb_e63e19be53d7.slice/crio-ea136648dc979c1c616e7a93483df5b0751b31634d2c142d7ae5010893815e13 WatchSource:0}: Error finding container ea136648dc979c1c616e7a93483df5b0751b31634d2c142d7ae5010893815e13: Status 404 returned error can't find the container with id ea136648dc979c1c616e7a93483df5b0751b31634d2c142d7ae5010893815e13
Jun 11 09:40:26.554217 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.554183    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-df67d7dfc-rvqkx" event={"ID":"03cf5a28-3756-40d5-aecb-e63e19be53d7","Type":"ContainerStarted","Data":"283f50e4752a2b13a28e3a09fd5f9aebdaeadb4c2a467721571be723691bf883"}
Jun 11 09:40:26.554383 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.554234    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-df67d7dfc-rvqkx" event={"ID":"03cf5a28-3756-40d5-aecb-e63e19be53d7","Type":"ContainerStarted","Data":"ea136648dc979c1c616e7a93483df5b0751b31634d2c142d7ae5010893815e13"}
Jun 11 09:40:26.574759 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:26.574714    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-df67d7dfc-rvqkx" podStartSLOduration=1.574699372 podStartE2EDuration="1.574699372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:40:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:40:26.573699391 +0000 UTC m=+353.694416057" watchObservedRunningTime="2026-06-11 09:40:26.574699372 +0000 UTC m=+353.695416050"
Jun 11 09:40:36.200437 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:36.200406    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:36.200875 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:36.200453    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:36.204876 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:36.204855    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:40:36.597073 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:40:36.597046    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:42:09.931927 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:09.931851    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-df67d7dfc-rvqkx"]
Jun 11 09:42:34.950483 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:34.950419    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-df67d7dfc-rvqkx" podUID="03cf5a28-3756-40d5-aecb-e63e19be53d7" containerName="console" containerID="cri-o://283f50e4752a2b13a28e3a09fd5f9aebdaeadb4c2a467721571be723691bf883" gracePeriod=15
Jun 11 09:42:35.186155 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.186126    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:42:35.251867 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.251841    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-trusted-ca-bundle\") pod \"03cf5a28-3756-40d5-aecb-e63e19be53d7\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") "
Jun 11 09:42:35.252041 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.251872    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-service-ca\") pod \"03cf5a28-3756-40d5-aecb-e63e19be53d7\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") "
Jun 11 09:42:35.252041 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.251890    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5mtb\" (UniqueName: \"kubernetes.io/projected/03cf5a28-3756-40d5-aecb-e63e19be53d7-kube-api-access-n5mtb\") pod \"03cf5a28-3756-40d5-aecb-e63e19be53d7\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") "
Jun 11 09:42:35.252041 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.251913    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-oauth-config\") pod \"03cf5a28-3756-40d5-aecb-e63e19be53d7\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") "
Jun 11 09:42:35.252206 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.252046    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-oauth-serving-cert\") pod \"03cf5a28-3756-40d5-aecb-e63e19be53d7\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") "
Jun 11 09:42:35.252206 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.252084    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-serving-cert\") pod \"03cf5a28-3756-40d5-aecb-e63e19be53d7\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") "
Jun 11 09:42:35.252206 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.252197    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-config\") pod \"03cf5a28-3756-40d5-aecb-e63e19be53d7\" (UID: \"03cf5a28-3756-40d5-aecb-e63e19be53d7\") "
Jun 11 09:42:35.252364 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.252337    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "03cf5a28-3756-40d5-aecb-e63e19be53d7" (UID: "03cf5a28-3756-40d5-aecb-e63e19be53d7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 09:42:35.252417 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.252380    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-service-ca" (OuterVolumeSpecName: "service-ca") pod "03cf5a28-3756-40d5-aecb-e63e19be53d7" (UID: "03cf5a28-3756-40d5-aecb-e63e19be53d7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 09:42:35.252542 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.252520    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-trusted-ca-bundle\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:42:35.252542 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.252542    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-service-ca\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:42:35.252745 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.252586    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "03cf5a28-3756-40d5-aecb-e63e19be53d7" (UID: "03cf5a28-3756-40d5-aecb-e63e19be53d7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 09:42:35.252745 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.252622    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-config" (OuterVolumeSpecName: "console-config") pod "03cf5a28-3756-40d5-aecb-e63e19be53d7" (UID: "03cf5a28-3756-40d5-aecb-e63e19be53d7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 09:42:35.254130 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.254106    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "03cf5a28-3756-40d5-aecb-e63e19be53d7" (UID: "03cf5a28-3756-40d5-aecb-e63e19be53d7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:42:35.254478 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.254459    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "03cf5a28-3756-40d5-aecb-e63e19be53d7" (UID: "03cf5a28-3756-40d5-aecb-e63e19be53d7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:42:35.254540 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.254459    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03cf5a28-3756-40d5-aecb-e63e19be53d7-kube-api-access-n5mtb" (OuterVolumeSpecName: "kube-api-access-n5mtb") pod "03cf5a28-3756-40d5-aecb-e63e19be53d7" (UID: "03cf5a28-3756-40d5-aecb-e63e19be53d7"). InnerVolumeSpecName "kube-api-access-n5mtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 09:42:35.353074 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.353025    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-config\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:42:35.353074 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.353067    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5mtb\" (UniqueName: \"kubernetes.io/projected/03cf5a28-3756-40d5-aecb-e63e19be53d7-kube-api-access-n5mtb\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:42:35.353074 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.353081    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-oauth-config\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:42:35.353297 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.353094    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03cf5a28-3756-40d5-aecb-e63e19be53d7-oauth-serving-cert\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:42:35.353297 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:35.353106    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03cf5a28-3756-40d5-aecb-e63e19be53d7-console-serving-cert\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:42:36.025155 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:36.025118    2561 generic.go:356] "Generic (PLEG): container finished" podID="03cf5a28-3756-40d5-aecb-e63e19be53d7" containerID="283f50e4752a2b13a28e3a09fd5f9aebdaeadb4c2a467721571be723691bf883" exitCode=0
Jun 11 09:42:36.025554 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:36.025181    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-df67d7dfc-rvqkx"
Jun 11 09:42:36.025554 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:36.025211    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-df67d7dfc-rvqkx" event={"ID":"03cf5a28-3756-40d5-aecb-e63e19be53d7","Type":"ContainerDied","Data":"283f50e4752a2b13a28e3a09fd5f9aebdaeadb4c2a467721571be723691bf883"}
Jun 11 09:42:36.025554 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:36.025286    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-df67d7dfc-rvqkx" event={"ID":"03cf5a28-3756-40d5-aecb-e63e19be53d7","Type":"ContainerDied","Data":"ea136648dc979c1c616e7a93483df5b0751b31634d2c142d7ae5010893815e13"}
Jun 11 09:42:36.025554 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:36.025307    2561 scope.go:117] "RemoveContainer" containerID="283f50e4752a2b13a28e3a09fd5f9aebdaeadb4c2a467721571be723691bf883"
Jun 11 09:42:36.033387 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:36.033370    2561 scope.go:117] "RemoveContainer" containerID="283f50e4752a2b13a28e3a09fd5f9aebdaeadb4c2a467721571be723691bf883"
Jun 11 09:42:36.033649 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:42:36.033623    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"283f50e4752a2b13a28e3a09fd5f9aebdaeadb4c2a467721571be723691bf883\": container with ID starting with 283f50e4752a2b13a28e3a09fd5f9aebdaeadb4c2a467721571be723691bf883 not found: ID does not exist" containerID="283f50e4752a2b13a28e3a09fd5f9aebdaeadb4c2a467721571be723691bf883"
Jun 11 09:42:36.033708 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:36.033659    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"283f50e4752a2b13a28e3a09fd5f9aebdaeadb4c2a467721571be723691bf883"} err="failed to get container status \"283f50e4752a2b13a28e3a09fd5f9aebdaeadb4c2a467721571be723691bf883\": rpc error: code = NotFound desc = could not find container \"283f50e4752a2b13a28e3a09fd5f9aebdaeadb4c2a467721571be723691bf883\": container with ID starting with 283f50e4752a2b13a28e3a09fd5f9aebdaeadb4c2a467721571be723691bf883 not found: ID does not exist"
Jun 11 09:42:36.043582 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:36.043555    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-df67d7dfc-rvqkx"]
Jun 11 09:42:36.048184 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:36.048164    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-df67d7dfc-rvqkx"]
Jun 11 09:42:37.378248 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:42:37.378216    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03cf5a28-3756-40d5-aecb-e63e19be53d7" path="/var/lib/kubelet/pods/03cf5a28-3756-40d5-aecb-e63e19be53d7/volumes"
Jun 11 09:44:23.766468 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.766432    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"]
Jun 11 09:44:23.766960 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.766847    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03cf5a28-3756-40d5-aecb-e63e19be53d7" containerName="console"
Jun 11 09:44:23.766960 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.766861    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="03cf5a28-3756-40d5-aecb-e63e19be53d7" containerName="console"
Jun 11 09:44:23.766960 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.766956    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="03cf5a28-3756-40d5-aecb-e63e19be53d7" containerName="console"
Jun 11 09:44:23.770823 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.770806    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.774000 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.773976    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-cjh6g\""
Jun 11 09:44:23.774154 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.773982    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 11 09:44:23.774154 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.774071    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 11 09:44:23.774442 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.774427    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 11 09:44:23.774675 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.774645    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jun 11 09:44:23.774950 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.774935    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 11 09:44:23.775045 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.775023    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 11 09:44:23.775302 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.775282    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 11 09:44:23.788847 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.788828    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"]
Jun 11 09:44:23.858643 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.858580    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cb8988d5-f500-41c5-aa98-1b16764d9e55-feast-data\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.858824 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.858649    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-registry-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.858824 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.858689    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-offline-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.858824 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.858710    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-online-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.858824 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.858779    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-ui-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.858824 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.858809    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94lpb\" (UniqueName: \"kubernetes.io/projected/cb8988d5-f500-41c5-aa98-1b16764d9e55-kube-api-access-94lpb\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.960002 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.959972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-ui-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.960002 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.960008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94lpb\" (UniqueName: \"kubernetes.io/projected/cb8988d5-f500-41c5-aa98-1b16764d9e55-kube-api-access-94lpb\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.960211 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.960065    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cb8988d5-f500-41c5-aa98-1b16764d9e55-feast-data\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.960211 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.960089    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-registry-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.960211 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.960122    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-offline-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.960211 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.960145    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-online-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.960531 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.960508    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cb8988d5-f500-41c5-aa98-1b16764d9e55-feast-data\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.962754 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.962726    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-registry-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.962854 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.962824    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-offline-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.962903 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.962834    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-online-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.962942 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.962896    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-ui-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:23.969074 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:23.969053    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94lpb\" (UniqueName: \"kubernetes.io/projected/cb8988d5-f500-41c5-aa98-1b16764d9e55-kube-api-access-94lpb\") pod \"feast-simple-feast-setup-7bc7678c9d-fqnp9\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:24.081078 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:24.080994    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:44:24.213997 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:24.213964    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"]
Jun 11 09:44:24.216052 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:44:24.216023    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb8988d5_f500_41c5_aa98_1b16764d9e55.slice/crio-1329e442b588165fc01058ef9fc01b31f8fa6cb0af1c4697505449c79095fe7d WatchSource:0}: Error finding container 1329e442b588165fc01058ef9fc01b31f8fa6cb0af1c4697505449c79095fe7d: Status 404 returned error can't find the container with id 1329e442b588165fc01058ef9fc01b31f8fa6cb0af1c4697505449c79095fe7d
Jun 11 09:44:24.419008 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:24.418927    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" event={"ID":"cb8988d5-f500-41c5-aa98-1b16764d9e55","Type":"ContainerStarted","Data":"1329e442b588165fc01058ef9fc01b31f8fa6cb0af1c4697505449c79095fe7d"}
Jun 11 09:44:33.359711 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:33.359686    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 09:44:33.361224 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:33.361198    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 09:44:55.549589 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:55.549547    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" event={"ID":"cb8988d5-f500-41c5-aa98-1b16764d9e55","Type":"ContainerStarted","Data":"edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215"}
Jun 11 09:44:59.566216 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:59.566179    2561 generic.go:356] "Generic (PLEG): container finished" podID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerID="edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215" exitCode=0
Jun 11 09:44:59.566617 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:44:59.566251    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" event={"ID":"cb8988d5-f500-41c5-aa98-1b16764d9e55","Type":"ContainerDied","Data":"edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215"}
Jun 11 09:45:00.574669 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:00.574638    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" event={"ID":"cb8988d5-f500-41c5-aa98-1b16764d9e55","Type":"ContainerStarted","Data":"7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40"}
Jun 11 09:45:05.593920 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:05.593886    2561 generic.go:356] "Generic (PLEG): container finished" podID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerID="7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40" exitCode=0
Jun 11 09:45:05.594340 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:05.593956    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" event={"ID":"cb8988d5-f500-41c5-aa98-1b16764d9e55","Type":"ContainerDied","Data":"7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40"}
Jun 11 09:45:05.597327 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:05.597309    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jun 11 09:45:06.604898 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:06.604859    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" event={"ID":"cb8988d5-f500-41c5-aa98-1b16764d9e55","Type":"ContainerStarted","Data":"6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2"}
Jun 11 09:45:06.605373 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:06.604922    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" event={"ID":"cb8988d5-f500-41c5-aa98-1b16764d9e55","Type":"ContainerStarted","Data":"3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72"}
Jun 11 09:45:06.605373 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:06.604945    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" event={"ID":"cb8988d5-f500-41c5-aa98-1b16764d9e55","Type":"ContainerStarted","Data":"63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4"}
Jun 11 09:45:06.605373 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:06.604964    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" event={"ID":"cb8988d5-f500-41c5-aa98-1b16764d9e55","Type":"ContainerStarted","Data":"3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a"}
Jun 11 09:45:06.635984 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:06.635917    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" podStartSLOduration=13.091813694 podStartE2EDuration="43.63589493s" totalImagesPullingTime="30.544081236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:45:06.633347213 +0000 UTC m=+633.754063881" watchObservedRunningTime="2026-06-11 09:45:06.63589493 +0000 UTC m=+633.756611575"
Jun 11 09:45:09.081434 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:09.081287    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:45:09.081434 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:09.081351    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:45:09.081434 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:09.081371    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:45:09.081434 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:09.081389    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:45:09.083367 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:09.083324    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Jun 11 09:45:09.083367 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:09.083350    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.22:6571: connect: connection refused"
Jun 11 09:45:09.083568 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:09.083357    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.22:8816: connect: connection refused"
Jun 11 09:45:09.083568 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:09.083410    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Jun 11 09:45:12.082662 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:12.082632    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:45:12.083129 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:12.082767    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:45:12.083202 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:12.083138    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:45:12.083202 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:12.083176    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:45:12.083202 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:12.083193    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:45:12.083396 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:12.083208    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:45:12.083445 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:12.083407    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:45:12.083532 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:12.083515    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:45:12.087072 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:12.087051    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:45:12.635273 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:12.635243    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:45:12.635579 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:12.635558    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:45:12.638178 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:45:12.638149    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:46:15.099659 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.099628    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"]
Jun 11 09:46:15.100150 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.099870    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="registry" containerID="cri-o://3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a" gracePeriod=30
Jun 11 09:46:15.100150 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.099944    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="ui" containerID="cri-o://6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2" gracePeriod=30
Jun 11 09:46:15.100150 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.099944    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="online" containerID="cri-o://63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4" gracePeriod=30
Jun 11 09:46:15.100150 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.099946    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="offline" containerID="cri-o://3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72" gracePeriod=30
Jun 11 09:46:15.444317 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.444240    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"]
Jun 11 09:46:15.448776 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.448750    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.451448 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.451422    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-hnn56\""
Jun 11 09:46:15.466737 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.466705    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"]
Jun 11 09:46:15.536739 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.536697    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-ui-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.536943 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.536773    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-feast-data\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.536943 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.536834    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-registry-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.536943 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.536878    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-offline-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.536943 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.536909    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-online-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.537106 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.536943    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m6wr\" (UniqueName: \"kubernetes.io/projected/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-kube-api-access-6m6wr\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.638351 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.638312    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m6wr\" (UniqueName: \"kubernetes.io/projected/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-kube-api-access-6m6wr\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.638516 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.638404    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-ui-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.638516 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.638448    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-feast-data\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.638516 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.638472    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-registry-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.638516 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.638499    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-offline-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.638792 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.638526    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-online-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.638792 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:46:15.638563    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jun 11 09:46:15.638792 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:46:15.638646    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-ui-tls podName:b9bcda1e-5772-474e-afa4-1d17e6b7e0fd nodeName:}" failed. No retries permitted until 2026-06-11 09:46:16.138626024 +0000 UTC m=+703.259342668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-ui-tls") pod "feast-simple-feast-setup-7bc7678c9d-fg8mg" (UID: "b9bcda1e-5772-474e-afa4-1d17e6b7e0fd") : secret "feast-simple-feast-setup-ui-tls" not found
Jun 11 09:46:15.638792 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:46:15.638648    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 11 09:46:15.638792 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:46:15.638688    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-online-tls podName:b9bcda1e-5772-474e-afa4-1d17e6b7e0fd nodeName:}" failed. No retries permitted until 2026-06-11 09:46:16.138678809 +0000 UTC m=+703.259395469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-online-tls") pod "feast-simple-feast-setup-7bc7678c9d-fg8mg" (UID: "b9bcda1e-5772-474e-afa4-1d17e6b7e0fd") : secret "feast-simple-feast-setup-online-tls" not found
Jun 11 09:46:15.639064 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.638868    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-feast-data\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.641079 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.641051    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-registry-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.641378 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.641347    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-offline-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.648666 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.648636    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m6wr\" (UniqueName: \"kubernetes.io/projected/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-kube-api-access-6m6wr\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:15.874505 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.874470    2561 generic.go:356] "Generic (PLEG): container finished" podID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerID="6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2" exitCode=0
Jun 11 09:46:15.874505 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.874495    2561 generic.go:356] "Generic (PLEG): container finished" podID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerID="63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4" exitCode=0
Jun 11 09:46:15.874741 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.874547    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" event={"ID":"cb8988d5-f500-41c5-aa98-1b16764d9e55","Type":"ContainerDied","Data":"6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2"}
Jun 11 09:46:15.874741 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:15.874612    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" event={"ID":"cb8988d5-f500-41c5-aa98-1b16764d9e55","Type":"ContainerDied","Data":"63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4"}
Jun 11 09:46:16.144332 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:16.144222    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-ui-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:16.144332 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:16.144305    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-online-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:16.146581 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:16.146557    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-online-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:16.146693 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:16.146677    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-ui-tls\") pod \"feast-simple-feast-setup-7bc7678c9d-fg8mg\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") " pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:16.359554 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:16.359498    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:16.509835 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:16.509808    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"]
Jun 11 09:46:16.511099 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:46:16.511065    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9bcda1e_5772_474e_afa4_1d17e6b7e0fd.slice/crio-295c6c859ce8038f9abb87f42231db6ed8e1fd2699aa5061429ad3e33943f1fd WatchSource:0}: Error finding container 295c6c859ce8038f9abb87f42231db6ed8e1fd2699aa5061429ad3e33943f1fd: Status 404 returned error can't find the container with id 295c6c859ce8038f9abb87f42231db6ed8e1fd2699aa5061429ad3e33943f1fd
Jun 11 09:46:16.880197 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:16.880159    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" event={"ID":"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd","Type":"ContainerStarted","Data":"3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e"}
Jun 11 09:46:16.880374 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:16.880206    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" event={"ID":"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd","Type":"ContainerStarted","Data":"295c6c859ce8038f9abb87f42231db6ed8e1fd2699aa5061429ad3e33943f1fd"}
Jun 11 09:46:21.903144 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:21.903111    2561 generic.go:356] "Generic (PLEG): container finished" podID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerID="3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e" exitCode=0
Jun 11 09:46:21.903549 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:21.903184    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" event={"ID":"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd","Type":"ContainerDied","Data":"3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e"}
Jun 11 09:46:22.084122 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:22.084078    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Jun 11 09:46:22.635531 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:22.635487    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Jun 11 09:46:22.908903 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:22.908825    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" event={"ID":"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd","Type":"ContainerStarted","Data":"f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e"}
Jun 11 09:46:27.931741 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:27.931704    2561 generic.go:356] "Generic (PLEG): container finished" podID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerID="f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e" exitCode=0
Jun 11 09:46:27.932102 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:27.931779    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" event={"ID":"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd","Type":"ContainerDied","Data":"f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e"}
Jun 11 09:46:28.942514 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:28.942468    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" event={"ID":"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd","Type":"ContainerStarted","Data":"6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e"}
Jun 11 09:46:28.942998 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:28.942533    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" event={"ID":"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd","Type":"ContainerStarted","Data":"fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7"}
Jun 11 09:46:28.942998 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:28.942554    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" event={"ID":"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd","Type":"ContainerStarted","Data":"b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9"}
Jun 11 09:46:28.942998 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:28.942571    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" event={"ID":"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd","Type":"ContainerStarted","Data":"820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8"}
Jun 11 09:46:28.974573 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:28.974489    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" podStartSLOduration=13.9744656 podStartE2EDuration="13.9744656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:46:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:46:28.972345378 +0000 UTC m=+716.093062067" watchObservedRunningTime="2026-06-11 09:46:28.9744656 +0000 UTC m=+716.095182245"
Jun 11 09:46:31.359943 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:31.359908    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:31.360624 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:31.360450    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:31.361656 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:31.361266    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:31.361656 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:31.361310    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:31.361829 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:31.361662    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.23:8816: connect: connection refused"
Jun 11 09:46:31.361829 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:31.361768    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Jun 11 09:46:31.361829 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:31.361813    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.23:6571: connect: connection refused"
Jun 11 09:46:31.361983 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:31.361765    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Jun 11 09:46:32.084133 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:32.084086    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Jun 11 09:46:32.636026 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:32.635948    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Jun 11 09:46:34.360767 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:34.360736    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:34.361191 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:34.360831    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:34.361191 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:34.361114    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:34.361653 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:34.361573    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:34.361653 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:34.361629    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:34.361653 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:34.361648    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:34.361902 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:34.361833    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:34.361902 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:34.361894    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:34.362020 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:34.362006    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:34.365483 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:34.365466    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:34.973824 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:34.973792    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:34.976797 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:34.976773    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:46:42.083562 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:42.083519    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Jun 11 09:46:42.084053 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:42.083674    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:46:42.635670 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:42.635631    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Jun 11 09:46:42.635884 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:42.635778    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:46:45.160923 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:46:45.160884    2561 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb8988d5_f500_41c5_aa98_1b16764d9e55.slice/crio-conmon-3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb8988d5_f500_41c5_aa98_1b16764d9e55.slice/crio-conmon-3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72.scope\": RecentStats: unable to find data in memory cache]"
Jun 11 09:46:45.751281 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.751253    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:46:45.797779 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.797748    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-online-tls\") pod \"cb8988d5-f500-41c5-aa98-1b16764d9e55\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") "
Jun 11 09:46:45.797779 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.797781    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-offline-tls\") pod \"cb8988d5-f500-41c5-aa98-1b16764d9e55\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") "
Jun 11 09:46:45.797992 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.797805    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-ui-tls\") pod \"cb8988d5-f500-41c5-aa98-1b16764d9e55\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") "
Jun 11 09:46:45.797992 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.797824    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94lpb\" (UniqueName: \"kubernetes.io/projected/cb8988d5-f500-41c5-aa98-1b16764d9e55-kube-api-access-94lpb\") pod \"cb8988d5-f500-41c5-aa98-1b16764d9e55\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") "
Jun 11 09:46:45.797992 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.797850    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-registry-tls\") pod \"cb8988d5-f500-41c5-aa98-1b16764d9e55\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") "
Jun 11 09:46:45.797992 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.797876    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cb8988d5-f500-41c5-aa98-1b16764d9e55-feast-data\") pod \"cb8988d5-f500-41c5-aa98-1b16764d9e55\" (UID: \"cb8988d5-f500-41c5-aa98-1b16764d9e55\") "
Jun 11 09:46:45.798525 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.798489    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb8988d5-f500-41c5-aa98-1b16764d9e55-feast-data" (OuterVolumeSpecName: "feast-data") pod "cb8988d5-f500-41c5-aa98-1b16764d9e55" (UID: "cb8988d5-f500-41c5-aa98-1b16764d9e55"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 09:46:45.800272 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.800243    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "cb8988d5-f500-41c5-aa98-1b16764d9e55" (UID: "cb8988d5-f500-41c5-aa98-1b16764d9e55"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:46:45.800272 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.800259    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb8988d5-f500-41c5-aa98-1b16764d9e55-kube-api-access-94lpb" (OuterVolumeSpecName: "kube-api-access-94lpb") pod "cb8988d5-f500-41c5-aa98-1b16764d9e55" (UID: "cb8988d5-f500-41c5-aa98-1b16764d9e55"). InnerVolumeSpecName "kube-api-access-94lpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 09:46:45.800398 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.800273    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cb8988d5-f500-41c5-aa98-1b16764d9e55" (UID: "cb8988d5-f500-41c5-aa98-1b16764d9e55"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:46:45.800435 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.800409    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "cb8988d5-f500-41c5-aa98-1b16764d9e55" (UID: "cb8988d5-f500-41c5-aa98-1b16764d9e55"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:46:45.800505 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.800488    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-online-tls" (OuterVolumeSpecName: "online-tls") pod "cb8988d5-f500-41c5-aa98-1b16764d9e55" (UID: "cb8988d5-f500-41c5-aa98-1b16764d9e55"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:46:45.899069 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.898983    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-online-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:46:45.899069 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.899010    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-offline-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:46:45.899069 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.899017    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-ui-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:46:45.899069 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.899026    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94lpb\" (UniqueName: \"kubernetes.io/projected/cb8988d5-f500-41c5-aa98-1b16764d9e55-kube-api-access-94lpb\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:46:45.899069 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.899035    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cb8988d5-f500-41c5-aa98-1b16764d9e55-registry-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:46:45.899069 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:45.899042    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cb8988d5-f500-41c5-aa98-1b16764d9e55-feast-data\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:46:46.017661 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.017631    2561 generic.go:356] "Generic (PLEG): container finished" podID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerID="3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72" exitCode=137
Jun 11 09:46:46.017661 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.017653    2561 generic.go:356] "Generic (PLEG): container finished" podID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerID="3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a" exitCode=137
Jun 11 09:46:46.017860 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.017695    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"
Jun 11 09:46:46.017860 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.017688    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" event={"ID":"cb8988d5-f500-41c5-aa98-1b16764d9e55","Type":"ContainerDied","Data":"3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72"}
Jun 11 09:46:46.017860 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.017740    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" event={"ID":"cb8988d5-f500-41c5-aa98-1b16764d9e55","Type":"ContainerDied","Data":"3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a"}
Jun 11 09:46:46.017860 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.017754    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9" event={"ID":"cb8988d5-f500-41c5-aa98-1b16764d9e55","Type":"ContainerDied","Data":"1329e442b588165fc01058ef9fc01b31f8fa6cb0af1c4697505449c79095fe7d"}
Jun 11 09:46:46.017860 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.017771    2561 scope.go:117] "RemoveContainer" containerID="6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2"
Jun 11 09:46:46.026169 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.026153    2561 scope.go:117] "RemoveContainer" containerID="3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72"
Jun 11 09:46:46.033466 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.033445    2561 scope.go:117] "RemoveContainer" containerID="63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4"
Jun 11 09:46:46.040993 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.040972    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"]
Jun 11 09:46:46.041198 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.041183    2561 scope.go:117] "RemoveContainer" containerID="3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a"
Jun 11 09:46:46.044997 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.044968    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fqnp9"]
Jun 11 09:46:46.048365 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.048349    2561 scope.go:117] "RemoveContainer" containerID="7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40"
Jun 11 09:46:46.055121 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.055104    2561 scope.go:117] "RemoveContainer" containerID="edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215"
Jun 11 09:46:46.062070 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.062050    2561 scope.go:117] "RemoveContainer" containerID="6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2"
Jun 11 09:46:46.062307 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:46:46.062290    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2\": container with ID starting with 6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2 not found: ID does not exist" containerID="6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2"
Jun 11 09:46:46.062356 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.062316    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2"} err="failed to get container status \"6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2\": rpc error: code = NotFound desc = could not find container \"6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2\": container with ID starting with 6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2 not found: ID does not exist"
Jun 11 09:46:46.062356 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.062334    2561 scope.go:117] "RemoveContainer" containerID="3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72"
Jun 11 09:46:46.062534 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:46:46.062520    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72\": container with ID starting with 3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72 not found: ID does not exist" containerID="3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72"
Jun 11 09:46:46.062577 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.062540    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72"} err="failed to get container status \"3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72\": rpc error: code = NotFound desc = could not find container \"3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72\": container with ID starting with 3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72 not found: ID does not exist"
Jun 11 09:46:46.062577 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.062552    2561 scope.go:117] "RemoveContainer" containerID="63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4"
Jun 11 09:46:46.062793 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:46:46.062776    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4\": container with ID starting with 63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4 not found: ID does not exist" containerID="63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4"
Jun 11 09:46:46.062832 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.062799    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4"} err="failed to get container status \"63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4\": rpc error: code = NotFound desc = could not find container \"63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4\": container with ID starting with 63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4 not found: ID does not exist"
Jun 11 09:46:46.062832 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.062817    2561 scope.go:117] "RemoveContainer" containerID="3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a"
Jun 11 09:46:46.063023 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:46:46.063006    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a\": container with ID starting with 3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a not found: ID does not exist" containerID="3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a"
Jun 11 09:46:46.063077 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.063027    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a"} err="failed to get container status \"3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a\": rpc error: code = NotFound desc = could not find container \"3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a\": container with ID starting with 3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a not found: ID does not exist"
Jun 11 09:46:46.063077 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.063040    2561 scope.go:117] "RemoveContainer" containerID="7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40"
Jun 11 09:46:46.063221 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:46:46.063203    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40\": container with ID starting with 7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40 not found: ID does not exist" containerID="7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40"
Jun 11 09:46:46.063259 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.063224    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40"} err="failed to get container status \"7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40\": rpc error: code = NotFound desc = could not find container \"7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40\": container with ID starting with 7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40 not found: ID does not exist"
Jun 11 09:46:46.063259 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.063235    2561 scope.go:117] "RemoveContainer" containerID="edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215"
Jun 11 09:46:46.063432 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:46:46.063416    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215\": container with ID starting with edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215 not found: ID does not exist" containerID="edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215"
Jun 11 09:46:46.063481 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.063436    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215"} err="failed to get container status \"edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215\": rpc error: code = NotFound desc = could not find container \"edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215\": container with ID starting with edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215 not found: ID does not exist"
Jun 11 09:46:46.063481 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.063449    2561 scope.go:117] "RemoveContainer" containerID="6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2"
Jun 11 09:46:46.063640 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.063623    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2"} err="failed to get container status \"6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2\": rpc error: code = NotFound desc = could not find container \"6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2\": container with ID starting with 6cc91a2446886c2d58138632bf06f0a8f1d6d21b1b88ef30fac75a8e0c4914f2 not found: ID does not exist"
Jun 11 09:46:46.063692 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.063641    2561 scope.go:117] "RemoveContainer" containerID="3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72"
Jun 11 09:46:46.063816 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.063800    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72"} err="failed to get container status \"3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72\": rpc error: code = NotFound desc = could not find container \"3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72\": container with ID starting with 3b651ebd3b368cae3d36448d2c65741e35461ea4b514154908ba25e5eeeade72 not found: ID does not exist"
Jun 11 09:46:46.063858 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.063815    2561 scope.go:117] "RemoveContainer" containerID="63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4"
Jun 11 09:46:46.063982 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.063967    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4"} err="failed to get container status \"63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4\": rpc error: code = NotFound desc = could not find container \"63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4\": container with ID starting with 63c984fb5e49d04daf52f201ef2d90527cd4078e603397efdccf5c3be881e2c4 not found: ID does not exist"
Jun 11 09:46:46.063982 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.063981    2561 scope.go:117] "RemoveContainer" containerID="3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a"
Jun 11 09:46:46.064140 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.064126    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a"} err="failed to get container status \"3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a\": rpc error: code = NotFound desc = could not find container \"3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a\": container with ID starting with 3fd6c2de07c8d0cd7cb5b393083f73568e1ed6a71274d1671c23aaca10f2c89a not found: ID does not exist"
Jun 11 09:46:46.064140 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.064139    2561 scope.go:117] "RemoveContainer" containerID="7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40"
Jun 11 09:46:46.064312 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.064291    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40"} err="failed to get container status \"7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40\": rpc error: code = NotFound desc = could not find container \"7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40\": container with ID starting with 7202527242c3f418fd9fc99df1652102ec1c1b75ca0bc8496f56106059560c40 not found: ID does not exist"
Jun 11 09:46:46.064382 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.064314    2561 scope.go:117] "RemoveContainer" containerID="edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215"
Jun 11 09:46:46.064519 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:46.064501    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215"} err="failed to get container status \"edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215\": rpc error: code = NotFound desc = could not find container \"edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215\": container with ID starting with edbbf49dd22e4d0449d05148178254393ce9f81c958edc437c56e758bb2f4215 not found: ID does not exist"
Jun 11 09:46:47.378334 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:46:47.378298    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" path="/var/lib/kubelet/pods/cb8988d5-f500-41c5-aa98-1b16764d9e55/volumes"
Jun 11 09:47:37.086405 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086367    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"]
Jun 11 09:47:37.086921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086669    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="online"
Jun 11 09:47:37.086921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086681    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="online"
Jun 11 09:47:37.086921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086694    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="registry"
Jun 11 09:47:37.086921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086699    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="registry"
Jun 11 09:47:37.086921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086710    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="offline"
Jun 11 09:47:37.086921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086715    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="offline"
Jun 11 09:47:37.086921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086723    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="feast-apply"
Jun 11 09:47:37.086921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086728    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="feast-apply"
Jun 11 09:47:37.086921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086736    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="feast-init"
Jun 11 09:47:37.086921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086741    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="feast-init"
Jun 11 09:47:37.086921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086747    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="ui"
Jun 11 09:47:37.086921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086752    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="ui"
Jun 11 09:47:37.086921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086797    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="online"
Jun 11 09:47:37.086921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086807    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="ui"
Jun 11 09:47:37.086921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086813    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="registry"
Jun 11 09:47:37.086921 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.086820    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb8988d5-f500-41c5-aa98-1b16764d9e55" containerName="offline"
Jun 11 09:47:37.091370 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.091352    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.093911 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.093884    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 11 09:47:37.094101 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.094079    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jun 11 09:47:37.094177 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.094137    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 11 09:47:37.094323 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.094307    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 11 09:47:37.094464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.094353    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-jrt29\""
Jun 11 09:47:37.094538 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.094416    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 11 09:47:37.094538 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.094423    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 11 09:47:37.094867 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.094848    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 11 09:47:37.104854 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.104835    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"]
Jun 11 09:47:37.194899 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.194877    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/122ea5f2-8a04-4f24-80f5-ac3b2c861190-registry-tls\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.195011 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.194908    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-ui-tls\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.195011 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.194944    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/122ea5f2-8a04-4f24-80f5-ac3b2c861190-feast-data\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.195102 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.195018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77nhc\" (UniqueName: \"kubernetes.io/projected/122ea5f2-8a04-4f24-80f5-ac3b2c861190-kube-api-access-77nhc\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.195102 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.195061    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-offline-tls\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.195179 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.195125    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-online-tls\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.296376 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.296347    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/122ea5f2-8a04-4f24-80f5-ac3b2c861190-registry-tls\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.296376 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.296372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-ui-tls\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.296577 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.296395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/122ea5f2-8a04-4f24-80f5-ac3b2c861190-feast-data\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.296577 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.296415    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77nhc\" (UniqueName: \"kubernetes.io/projected/122ea5f2-8a04-4f24-80f5-ac3b2c861190-kube-api-access-77nhc\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.296577 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.296443    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-offline-tls\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.296577 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.296483    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-online-tls\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.296577 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:47:37.296570    2561 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
Jun 11 09:47:37.296853 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:47:37.296657    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-online-tls podName:122ea5f2-8a04-4f24-80f5-ac3b2c861190 nodeName:}" failed. No retries permitted until 2026-06-11 09:47:37.796635609 +0000 UTC m=+784.917352231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-online-tls") pod "feast-simple-feast-remote-setup-78d4795c48-m22ck" (UID: "122ea5f2-8a04-4f24-80f5-ac3b2c861190") : secret "feast-simple-feast-remote-setup-online-tls" not found
Jun 11 09:47:37.296853 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:47:37.296829    2561 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Jun 11 09:47:37.296967 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:47:37.296896    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-offline-tls podName:122ea5f2-8a04-4f24-80f5-ac3b2c861190 nodeName:}" failed. No retries permitted until 2026-06-11 09:47:37.796878516 +0000 UTC m=+784.917595144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-offline-tls") pod "feast-simple-feast-remote-setup-78d4795c48-m22ck" (UID: "122ea5f2-8a04-4f24-80f5-ac3b2c861190") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Jun 11 09:47:37.297090 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.297068    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/122ea5f2-8a04-4f24-80f5-ac3b2c861190-feast-data\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.297154 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.297139    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/122ea5f2-8a04-4f24-80f5-ac3b2c861190-registry-tls\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.298935 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.298917    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-ui-tls\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.310278 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.310255    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77nhc\" (UniqueName: \"kubernetes.io/projected/122ea5f2-8a04-4f24-80f5-ac3b2c861190-kube-api-access-77nhc\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.799963 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.799928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-offline-tls\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.800140 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.799975    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-online-tls\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.802362 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.802337    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-offline-tls\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:37.802486 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:37.802366    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-online-tls\") pod \"feast-simple-feast-remote-setup-78d4795c48-m22ck\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:38.002237 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:38.002206    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:38.169584 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:38.169556    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"]
Jun 11 09:47:38.170009 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:47:38.169986    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod122ea5f2_8a04_4f24_80f5_ac3b2c861190.slice/crio-b7ffa8921bcff4b0cbb14a4bc16ad38b92e64a95d2c1a8419f4ae912f34d473f WatchSource:0}: Error finding container b7ffa8921bcff4b0cbb14a4bc16ad38b92e64a95d2c1a8419f4ae912f34d473f: Status 404 returned error can't find the container with id b7ffa8921bcff4b0cbb14a4bc16ad38b92e64a95d2c1a8419f4ae912f34d473f
Jun 11 09:47:38.210855 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:38.210831    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" event={"ID":"122ea5f2-8a04-4f24-80f5-ac3b2c861190","Type":"ContainerStarted","Data":"b7ffa8921bcff4b0cbb14a4bc16ad38b92e64a95d2c1a8419f4ae912f34d473f"}
Jun 11 09:47:39.217591 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:39.217555    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" event={"ID":"122ea5f2-8a04-4f24-80f5-ac3b2c861190","Type":"ContainerStarted","Data":"f3346f9697ad2da3a9a051c55f6a3370c6a3e473ca968a8b5ff6d7c69548032d"}
Jun 11 09:47:43.234581 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:43.234541    2561 generic.go:356] "Generic (PLEG): container finished" podID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerID="f3346f9697ad2da3a9a051c55f6a3370c6a3e473ca968a8b5ff6d7c69548032d" exitCode=0
Jun 11 09:47:43.234958 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:43.234624    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" event={"ID":"122ea5f2-8a04-4f24-80f5-ac3b2c861190","Type":"ContainerDied","Data":"f3346f9697ad2da3a9a051c55f6a3370c6a3e473ca968a8b5ff6d7c69548032d"}
Jun 11 09:47:44.242445 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:44.242409    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" event={"ID":"122ea5f2-8a04-4f24-80f5-ac3b2c861190","Type":"ContainerStarted","Data":"14c6640e419f229454b32ec62dc852146a92518974f9d06dd4c24affa7027df1"}
Jun 11 09:47:49.265023 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:49.264990    2561 generic.go:356] "Generic (PLEG): container finished" podID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerID="14c6640e419f229454b32ec62dc852146a92518974f9d06dd4c24affa7027df1" exitCode=0
Jun 11 09:47:49.265405 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:49.265029    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" event={"ID":"122ea5f2-8a04-4f24-80f5-ac3b2c861190","Type":"ContainerDied","Data":"14c6640e419f229454b32ec62dc852146a92518974f9d06dd4c24affa7027df1"}
Jun 11 09:47:50.273849 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:50.273805    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" event={"ID":"122ea5f2-8a04-4f24-80f5-ac3b2c861190","Type":"ContainerStarted","Data":"f713579c714d6ef8e6b3a9aae532b76760a28a01353c441624ba15f3fe42bfb7"}
Jun 11 09:47:50.274295 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:50.273870    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" event={"ID":"122ea5f2-8a04-4f24-80f5-ac3b2c861190","Type":"ContainerStarted","Data":"128159ddef98b656ed75bcbbcc51f4c36e81abd33a9bbdccef230a72445b0d4a"}
Jun 11 09:47:50.274295 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:50.273890    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" event={"ID":"122ea5f2-8a04-4f24-80f5-ac3b2c861190","Type":"ContainerStarted","Data":"6e607f49f28df156d7ff3cede2fd672225626325f4a71ac62c6bf5362f1ebab5"}
Jun 11 09:47:50.314213 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:50.314157    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" podStartSLOduration=13.31414082 podStartE2EDuration="13.31414082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:47:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:47:50.312747941 +0000 UTC m=+797.433464597" watchObservedRunningTime="2026-06-11 09:47:50.31414082 +0000 UTC m=+797.434857463"
Jun 11 09:47:53.003464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:53.003419    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:53.003955 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:53.003491    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:53.003955 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:53.003509    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:53.005293 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:53.005255    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Jun 11 09:47:53.005293 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:53.005274    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused"
Jun 11 09:47:53.005524 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:53.005298    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Jun 11 09:47:56.003832 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:56.003803    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:56.004278 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:56.003985    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:56.004396 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:56.004375    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:56.004476 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:56.004415    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:56.004665 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:56.004642    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:56.004786 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:56.004757    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:56.007865 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:56.007848    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:56.301438 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:56.301366    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:47:56.304195 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:47:56.304174    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:48:58.575573 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:58.575538    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"]
Jun 11 09:48:58.576119 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:58.575789    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="online" containerID="cri-o://6e607f49f28df156d7ff3cede2fd672225626325f4a71ac62c6bf5362f1ebab5" gracePeriod=30
Jun 11 09:48:58.576119 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:58.575810    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="offline" containerID="cri-o://128159ddef98b656ed75bcbbcc51f4c36e81abd33a9bbdccef230a72445b0d4a" gracePeriod=30
Jun 11 09:48:58.576119 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:58.575808    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="ui" containerID="cri-o://f713579c714d6ef8e6b3a9aae532b76760a28a01353c441624ba15f3fe42bfb7" gracePeriod=30
Jun 11 09:48:58.801818 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:58.801785    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"]
Jun 11 09:48:58.802106 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:58.802061    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="registry" containerID="cri-o://820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8" gracePeriod=30
Jun 11 09:48:58.802255 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:58.802091    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="ui" containerID="cri-o://6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e" gracePeriod=30
Jun 11 09:48:58.802255 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:58.802109    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="online" containerID="cri-o://b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9" gracePeriod=30
Jun 11 09:48:58.802255 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:58.802107    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="offline" containerID="cri-o://fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7" gracePeriod=30
Jun 11 09:48:59.551653 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:59.551624    2561 generic.go:356] "Generic (PLEG): container finished" podID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerID="6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e" exitCode=0
Jun 11 09:48:59.551653 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:59.551646    2561 generic.go:356] "Generic (PLEG): container finished" podID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerID="b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9" exitCode=0
Jun 11 09:48:59.551829 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:59.551685    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" event={"ID":"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd","Type":"ContainerDied","Data":"6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e"}
Jun 11 09:48:59.551829 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:59.551727    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" event={"ID":"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd","Type":"ContainerDied","Data":"b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9"}
Jun 11 09:48:59.554142 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:59.554122    2561 generic.go:356] "Generic (PLEG): container finished" podID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerID="f713579c714d6ef8e6b3a9aae532b76760a28a01353c441624ba15f3fe42bfb7" exitCode=0
Jun 11 09:48:59.554142 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:59.554140    2561 generic.go:356] "Generic (PLEG): container finished" podID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerID="6e607f49f28df156d7ff3cede2fd672225626325f4a71ac62c6bf5362f1ebab5" exitCode=0
Jun 11 09:48:59.554273 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:59.554192    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" event={"ID":"122ea5f2-8a04-4f24-80f5-ac3b2c861190","Type":"ContainerDied","Data":"f713579c714d6ef8e6b3a9aae532b76760a28a01353c441624ba15f3fe42bfb7"}
Jun 11 09:48:59.554273 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:48:59.554226    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" event={"ID":"122ea5f2-8a04-4f24-80f5-ac3b2c861190","Type":"ContainerDied","Data":"6e607f49f28df156d7ff3cede2fd672225626325f4a71ac62c6bf5362f1ebab5"}
Jun 11 09:49:04.361874 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:04.361824    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Jun 11 09:49:04.973941 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:04.973896    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Jun 11 09:49:06.004699 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:06.004647    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Jun 11 09:49:06.302096 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:06.302012    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Jun 11 09:49:14.362412 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:14.362372    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Jun 11 09:49:14.973968 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:14.973921    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Jun 11 09:49:16.004523 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:16.004473    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Jun 11 09:49:16.301985 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:16.301898    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Jun 11 09:49:24.361950 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:24.361905    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Jun 11 09:49:24.362326 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:24.362073    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:49:24.974944 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:24.974901    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Jun 11 09:49:24.975124 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:24.975046    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:49:26.004699 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:26.004651    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Jun 11 09:49:26.005137 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:26.004788    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:49:26.301583 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:26.301488    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Jun 11 09:49:26.301776 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:26.301639    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:49:28.664797 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:28.664771    2561 generic.go:356] "Generic (PLEG): container finished" podID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerID="128159ddef98b656ed75bcbbcc51f4c36e81abd33a9bbdccef230a72445b0d4a" exitCode=137
Jun 11 09:49:28.665107 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:28.664844    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" event={"ID":"122ea5f2-8a04-4f24-80f5-ac3b2c861190","Type":"ContainerDied","Data":"128159ddef98b656ed75bcbbcc51f4c36e81abd33a9bbdccef230a72445b0d4a"}
Jun 11 09:49:29.225641 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.225619    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:49:29.384750 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.384713    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-online-tls\") pod \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") "
Jun 11 09:49:29.384883 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.384789    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/122ea5f2-8a04-4f24-80f5-ac3b2c861190-feast-data\") pod \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") "
Jun 11 09:49:29.384883 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.384829    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-offline-tls\") pod \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") "
Jun 11 09:49:29.385009 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.384891    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77nhc\" (UniqueName: \"kubernetes.io/projected/122ea5f2-8a04-4f24-80f5-ac3b2c861190-kube-api-access-77nhc\") pod \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") "
Jun 11 09:49:29.385009 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.384922    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-ui-tls\") pod \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") "
Jun 11 09:49:29.385009 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.384953    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/122ea5f2-8a04-4f24-80f5-ac3b2c861190-registry-tls\") pod \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\" (UID: \"122ea5f2-8a04-4f24-80f5-ac3b2c861190\") "
Jun 11 09:49:29.386172 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.386139    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/122ea5f2-8a04-4f24-80f5-ac3b2c861190-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "122ea5f2-8a04-4f24-80f5-ac3b2c861190" (UID: "122ea5f2-8a04-4f24-80f5-ac3b2c861190"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 09:49:29.386291 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.386261    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/122ea5f2-8a04-4f24-80f5-ac3b2c861190-feast-data" (OuterVolumeSpecName: "feast-data") pod "122ea5f2-8a04-4f24-80f5-ac3b2c861190" (UID: "122ea5f2-8a04-4f24-80f5-ac3b2c861190"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 09:49:29.387990 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.387951    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "122ea5f2-8a04-4f24-80f5-ac3b2c861190" (UID: "122ea5f2-8a04-4f24-80f5-ac3b2c861190"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:49:29.388161 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.388141    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-online-tls" (OuterVolumeSpecName: "online-tls") pod "122ea5f2-8a04-4f24-80f5-ac3b2c861190" (UID: "122ea5f2-8a04-4f24-80f5-ac3b2c861190"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:49:29.388429 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.388412    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "122ea5f2-8a04-4f24-80f5-ac3b2c861190" (UID: "122ea5f2-8a04-4f24-80f5-ac3b2c861190"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:49:29.389006 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.388990    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/122ea5f2-8a04-4f24-80f5-ac3b2c861190-kube-api-access-77nhc" (OuterVolumeSpecName: "kube-api-access-77nhc") pod "122ea5f2-8a04-4f24-80f5-ac3b2c861190" (UID: "122ea5f2-8a04-4f24-80f5-ac3b2c861190"). InnerVolumeSpecName "kube-api-access-77nhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 09:49:29.439417 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.439396    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:49:29.486457 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.486424    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77nhc\" (UniqueName: \"kubernetes.io/projected/122ea5f2-8a04-4f24-80f5-ac3b2c861190-kube-api-access-77nhc\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:49:29.486457 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.486457    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-ui-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:49:29.486587 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.486468    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/122ea5f2-8a04-4f24-80f5-ac3b2c861190-registry-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:49:29.486587 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.486476    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-online-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:49:29.486587 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.486484    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/122ea5f2-8a04-4f24-80f5-ac3b2c861190-feast-data\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:49:29.486587 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.486491    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/122ea5f2-8a04-4f24-80f5-ac3b2c861190-offline-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:49:29.587578 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.587558    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-ui-tls\") pod \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") "
Jun 11 09:49:29.587703 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.587619    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m6wr\" (UniqueName: \"kubernetes.io/projected/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-kube-api-access-6m6wr\") pod \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") "
Jun 11 09:49:29.587703 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.587678    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-registry-tls\") pod \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") "
Jun 11 09:49:29.587818 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.587708    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-offline-tls\") pod \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") "
Jun 11 09:49:29.587818 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.587745    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-online-tls\") pod \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") "
Jun 11 09:49:29.587818 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.587780    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-feast-data\") pod \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\" (UID: \"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd\") "
Jun 11 09:49:29.588437 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.588406    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-feast-data" (OuterVolumeSpecName: "feast-data") pod "b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" (UID: "b9bcda1e-5772-474e-afa4-1d17e6b7e0fd"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 09:49:29.590043 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.590001    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" (UID: "b9bcda1e-5772-474e-afa4-1d17e6b7e0fd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:49:29.590151 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.590095    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" (UID: "b9bcda1e-5772-474e-afa4-1d17e6b7e0fd"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:49:29.590216 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.590158    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" (UID: "b9bcda1e-5772-474e-afa4-1d17e6b7e0fd"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:49:29.590216 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.590166    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-kube-api-access-6m6wr" (OuterVolumeSpecName: "kube-api-access-6m6wr") pod "b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" (UID: "b9bcda1e-5772-474e-afa4-1d17e6b7e0fd"). InnerVolumeSpecName "kube-api-access-6m6wr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 09:49:29.590463 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.590444    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-online-tls" (OuterVolumeSpecName: "online-tls") pod "b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" (UID: "b9bcda1e-5772-474e-afa4-1d17e6b7e0fd"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:49:29.672307 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.672231    2561 generic.go:356] "Generic (PLEG): container finished" podID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerID="fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7" exitCode=137
Jun 11 09:49:29.672307 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.672255    2561 generic.go:356] "Generic (PLEG): container finished" podID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerID="820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8" exitCode=137
Jun 11 09:49:29.672307 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.672298    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"
Jun 11 09:49:29.672824 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.672311    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" event={"ID":"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd","Type":"ContainerDied","Data":"fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7"}
Jun 11 09:49:29.672824 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.672359    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" event={"ID":"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd","Type":"ContainerDied","Data":"820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8"}
Jun 11 09:49:29.672824 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.672379    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg" event={"ID":"b9bcda1e-5772-474e-afa4-1d17e6b7e0fd","Type":"ContainerDied","Data":"295c6c859ce8038f9abb87f42231db6ed8e1fd2699aa5061429ad3e33943f1fd"}
Jun 11 09:49:29.672824 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.672394    2561 scope.go:117] "RemoveContainer" containerID="6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e"
Jun 11 09:49:29.676165 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.676104    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck" event={"ID":"122ea5f2-8a04-4f24-80f5-ac3b2c861190","Type":"ContainerDied","Data":"b7ffa8921bcff4b0cbb14a4bc16ad38b92e64a95d2c1a8419f4ae912f34d473f"}
Jun 11 09:49:29.679475 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.676502    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"
Jun 11 09:49:29.688384 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.688362    2561 scope.go:117] "RemoveContainer" containerID="fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7"
Jun 11 09:49:29.688618 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.688575    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-registry-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:49:29.688618 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.688614    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-offline-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:49:29.688778 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.688644    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-online-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:49:29.688778 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.688655    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-feast-data\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:49:29.688778 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.688667    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-ui-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:49:29.688778 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.688681    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m6wr\" (UniqueName: \"kubernetes.io/projected/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd-kube-api-access-6m6wr\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:49:29.696229 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.696205    2561 scope.go:117] "RemoveContainer" containerID="b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9"
Jun 11 09:49:29.703394 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.703375    2561 scope.go:117] "RemoveContainer" containerID="820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8"
Jun 11 09:49:29.710737 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.710720    2561 scope.go:117] "RemoveContainer" containerID="f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e"
Jun 11 09:49:29.718094 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.718068    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"]
Jun 11 09:49:29.719588 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.719499    2561 scope.go:117] "RemoveContainer" containerID="3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e"
Jun 11 09:49:29.722225 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.722203    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc7678c9d-fg8mg"]
Jun 11 09:49:29.726634 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.726617    2561 scope.go:117] "RemoveContainer" containerID="6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e"
Jun 11 09:49:29.726889 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:49:29.726870    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e\": container with ID starting with 6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e not found: ID does not exist" containerID="6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e"
Jun 11 09:49:29.726971 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.726897    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e"} err="failed to get container status \"6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e\": rpc error: code = NotFound desc = could not find container \"6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e\": container with ID starting with 6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e not found: ID does not exist"
Jun 11 09:49:29.726971 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.726920    2561 scope.go:117] "RemoveContainer" containerID="fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7"
Jun 11 09:49:29.727151 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:49:29.727133    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7\": container with ID starting with fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7 not found: ID does not exist" containerID="fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7"
Jun 11 09:49:29.727199 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.727158    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7"} err="failed to get container status \"fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7\": rpc error: code = NotFound desc = could not find container \"fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7\": container with ID starting with fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7 not found: ID does not exist"
Jun 11 09:49:29.727199 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.727174    2561 scope.go:117] "RemoveContainer" containerID="b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9"
Jun 11 09:49:29.727368 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:49:29.727353    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9\": container with ID starting with b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9 not found: ID does not exist" containerID="b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9"
Jun 11 09:49:29.727406 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.727371    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9"} err="failed to get container status \"b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9\": rpc error: code = NotFound desc = could not find container \"b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9\": container with ID starting with b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9 not found: ID does not exist"
Jun 11 09:49:29.727406 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.727383    2561 scope.go:117] "RemoveContainer" containerID="820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8"
Jun 11 09:49:29.727631 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:49:29.727593    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8\": container with ID starting with 820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8 not found: ID does not exist" containerID="820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8"
Jun 11 09:49:29.727695 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.727637    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8"} err="failed to get container status \"820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8\": rpc error: code = NotFound desc = could not find container \"820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8\": container with ID starting with 820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8 not found: ID does not exist"
Jun 11 09:49:29.727695 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.727653    2561 scope.go:117] "RemoveContainer" containerID="f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e"
Jun 11 09:49:29.727908 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:49:29.727891    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e\": container with ID starting with f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e not found: ID does not exist" containerID="f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e"
Jun 11 09:49:29.727960 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.727912    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e"} err="failed to get container status \"f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e\": rpc error: code = NotFound desc = could not find container \"f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e\": container with ID starting with f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e not found: ID does not exist"
Jun 11 09:49:29.727960 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.727924    2561 scope.go:117] "RemoveContainer" containerID="3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e"
Jun 11 09:49:29.728115 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:49:29.728097    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e\": container with ID starting with 3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e not found: ID does not exist" containerID="3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e"
Jun 11 09:49:29.728158 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.728119    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e"} err="failed to get container status \"3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e\": rpc error: code = NotFound desc = could not find container \"3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e\": container with ID starting with 3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e not found: ID does not exist"
Jun 11 09:49:29.728158 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.728132    2561 scope.go:117] "RemoveContainer" containerID="6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e"
Jun 11 09:49:29.728356 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.728338    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e"} err="failed to get container status \"6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e\": rpc error: code = NotFound desc = could not find container \"6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e\": container with ID starting with 6e3ad837dcdc63cdeca30c127fd4d84b3999d70331588b92fe1a598991cf9d6e not found: ID does not exist"
Jun 11 09:49:29.728405 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.728356    2561 scope.go:117] "RemoveContainer" containerID="fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7"
Jun 11 09:49:29.728541 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.728523    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7"} err="failed to get container status \"fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7\": rpc error: code = NotFound desc = could not find container \"fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7\": container with ID starting with fa41e83dfc36757a2137cc77888fefc8d2c740bb84477abccb42c96296a456b7 not found: ID does not exist"
Jun 11 09:49:29.728637 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.728541    2561 scope.go:117] "RemoveContainer" containerID="b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9"
Jun 11 09:49:29.728755 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.728737    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9"} err="failed to get container status \"b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9\": rpc error: code = NotFound desc = could not find container \"b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9\": container with ID starting with b151fd2dfc7c22f2c5cf7c1a2567dfde24cce30f8568f2106d8d8c0cfe0739d9 not found: ID does not exist"
Jun 11 09:49:29.728796 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.728755    2561 scope.go:117] "RemoveContainer" containerID="820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8"
Jun 11 09:49:29.728969 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.728949    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8"} err="failed to get container status \"820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8\": rpc error: code = NotFound desc = could not find container \"820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8\": container with ID starting with 820ef9fed0449466dec13e542b820cde27b2d1514aef2ec85c921e0e386a65b8 not found: ID does not exist"
Jun 11 09:49:29.729021 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.728969    2561 scope.go:117] "RemoveContainer" containerID="f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e"
Jun 11 09:49:29.729187 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.729170    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e"} err="failed to get container status \"f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e\": rpc error: code = NotFound desc = could not find container \"f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e\": container with ID starting with f1d67cf7fa84fdf922dc218e74e521de834734cd9a9b6dd2b769c4fe2948906e not found: ID does not exist"
Jun 11 09:49:29.729187 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.729186    2561 scope.go:117] "RemoveContainer" containerID="3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e"
Jun 11 09:49:29.729389 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.729373    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e"} err="failed to get container status \"3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e\": rpc error: code = NotFound desc = could not find container \"3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e\": container with ID starting with 3a34ca787d252eb1eca5b21c9cfb3c6c7f1e4727c5ff30c44b78e4d44a1b939e not found: ID does not exist"
Jun 11 09:49:29.729490 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.729389    2561 scope.go:117] "RemoveContainer" containerID="f713579c714d6ef8e6b3a9aae532b76760a28a01353c441624ba15f3fe42bfb7"
Jun 11 09:49:29.736664 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.736638    2561 scope.go:117] "RemoveContainer" containerID="128159ddef98b656ed75bcbbcc51f4c36e81abd33a9bbdccef230a72445b0d4a"
Jun 11 09:49:29.743408 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.743378    2561 scope.go:117] "RemoveContainer" containerID="6e607f49f28df156d7ff3cede2fd672225626325f4a71ac62c6bf5362f1ebab5"
Jun 11 09:49:29.750169 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.750091    2561 scope.go:117] "RemoveContainer" containerID="14c6640e419f229454b32ec62dc852146a92518974f9d06dd4c24affa7027df1"
Jun 11 09:49:29.751480 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.751462    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"]
Jun 11 09:49:29.757232 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.757203    2561 scope.go:117] "RemoveContainer" containerID="f3346f9697ad2da3a9a051c55f6a3370c6a3e473ca968a8b5ff6d7c69548032d"
Jun 11 09:49:29.767068 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:29.767049    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-78d4795c48-m22ck"]
Jun 11 09:49:31.377578 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:31.377549    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" path="/var/lib/kubelet/pods/122ea5f2-8a04-4f24-80f5-ac3b2c861190/volumes"
Jun 11 09:49:31.378111 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:31.378097    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" path="/var/lib/kubelet/pods/b9bcda1e-5772-474e-afa4-1d17e6b7e0fd/volumes"
Jun 11 09:49:33.389879 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:33.389854    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 09:49:33.391440 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:33.391418    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 09:49:43.471979 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.471946    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-z5c4f"]
Jun 11 09:49:43.472335 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472242    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="feast-apply"
Jun 11 09:49:43.472335 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472253    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="feast-apply"
Jun 11 09:49:43.472335 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472262    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="offline"
Jun 11 09:49:43.472335 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472267    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="offline"
Jun 11 09:49:43.472335 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472276    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="offline"
Jun 11 09:49:43.472335 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472283    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="offline"
Jun 11 09:49:43.472335 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472289    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="feast-apply"
Jun 11 09:49:43.472335 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472294    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="feast-apply"
Jun 11 09:49:43.472335 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472303    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="online"
Jun 11 09:49:43.472335 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472308    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="online"
Jun 11 09:49:43.472335 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472316    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="feast-init"
Jun 11 09:49:43.472335 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472321    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="feast-init"
Jun 11 09:49:43.472335 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472326    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="online"
Jun 11 09:49:43.472335 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472331    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="online"
Jun 11 09:49:43.472335 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472338    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="ui"
Jun 11 09:49:43.472335 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472344    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="ui"
Jun 11 09:49:43.472833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472352    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="registry"
Jun 11 09:49:43.472833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472357    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="registry"
Jun 11 09:49:43.472833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472367    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="ui"
Jun 11 09:49:43.472833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472372    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="ui"
Jun 11 09:49:43.472833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472380    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="feast-init"
Jun 11 09:49:43.472833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472385    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="feast-init"
Jun 11 09:49:43.472833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472426    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="ui"
Jun 11 09:49:43.472833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472436    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="registry"
Jun 11 09:49:43.472833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472443    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="offline"
Jun 11 09:49:43.472833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472448    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="122ea5f2-8a04-4f24-80f5-ac3b2c861190" containerName="online"
Jun 11 09:49:43.472833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472453    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="online"
Jun 11 09:49:43.472833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472459    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="offline"
Jun 11 09:49:43.472833 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.472465    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9bcda1e-5772-474e-afa4-1d17e6b7e0fd" containerName="ui"
Jun 11 09:49:43.477398 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.477380    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-z5c4f"
Jun 11 09:49:43.486904 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.486884    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-bxfpf\""
Jun 11 09:49:43.487030 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.487013    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 11 09:49:43.487268 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.487254    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Jun 11 09:49:43.487864 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.487850    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 11 09:49:43.514444 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.514420    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-z5c4f"]
Jun 11 09:49:43.584228 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.582048    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-2b6vz"]
Jun 11 09:49:43.585464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.585431    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-2b6vz"
Jun 11 09:49:43.587386 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.587367    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/baf7ca53-81bf-4c52-8b79-a2431946d393-postgresdata\") pod \"postgres-864846d4f5-z5c4f\" (UID: \"baf7ca53-81bf-4c52-8b79-a2431946d393\") " pod="test-ns-feast/postgres-864846d4f5-z5c4f"
Jun 11 09:49:43.587511 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.587397    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxp6x\" (UniqueName: \"kubernetes.io/projected/baf7ca53-81bf-4c52-8b79-a2431946d393-kube-api-access-xxp6x\") pod \"postgres-864846d4f5-z5c4f\" (UID: \"baf7ca53-81bf-4c52-8b79-a2431946d393\") " pod="test-ns-feast/postgres-864846d4f5-z5c4f"
Jun 11 09:49:43.611957 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.611935    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-2b6vz"]
Jun 11 09:49:43.688065 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.688037    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26vwb\" (UniqueName: \"kubernetes.io/projected/4652b44c-08f8-4458-aa40-979caae9dbd0-kube-api-access-26vwb\") pod \"redis-69bbd798b6-2b6vz\" (UID: \"4652b44c-08f8-4458-aa40-979caae9dbd0\") " pod="test-ns-feast/redis-69bbd798b6-2b6vz"
Jun 11 09:49:43.688222 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.688093    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/baf7ca53-81bf-4c52-8b79-a2431946d393-postgresdata\") pod \"postgres-864846d4f5-z5c4f\" (UID: \"baf7ca53-81bf-4c52-8b79-a2431946d393\") " pod="test-ns-feast/postgres-864846d4f5-z5c4f"
Jun 11 09:49:43.688222 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.688147    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxp6x\" (UniqueName: \"kubernetes.io/projected/baf7ca53-81bf-4c52-8b79-a2431946d393-kube-api-access-xxp6x\") pod \"postgres-864846d4f5-z5c4f\" (UID: \"baf7ca53-81bf-4c52-8b79-a2431946d393\") " pod="test-ns-feast/postgres-864846d4f5-z5c4f"
Jun 11 09:49:43.688388 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.688374    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/baf7ca53-81bf-4c52-8b79-a2431946d393-postgresdata\") pod \"postgres-864846d4f5-z5c4f\" (UID: \"baf7ca53-81bf-4c52-8b79-a2431946d393\") " pod="test-ns-feast/postgres-864846d4f5-z5c4f"
Jun 11 09:49:43.698743 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.698716    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxp6x\" (UniqueName: \"kubernetes.io/projected/baf7ca53-81bf-4c52-8b79-a2431946d393-kube-api-access-xxp6x\") pod \"postgres-864846d4f5-z5c4f\" (UID: \"baf7ca53-81bf-4c52-8b79-a2431946d393\") " pod="test-ns-feast/postgres-864846d4f5-z5c4f"
Jun 11 09:49:43.785758 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.785731    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-z5c4f"
Jun 11 09:49:43.788859 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.788545    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26vwb\" (UniqueName: \"kubernetes.io/projected/4652b44c-08f8-4458-aa40-979caae9dbd0-kube-api-access-26vwb\") pod \"redis-69bbd798b6-2b6vz\" (UID: \"4652b44c-08f8-4458-aa40-979caae9dbd0\") " pod="test-ns-feast/redis-69bbd798b6-2b6vz"
Jun 11 09:49:43.799805 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.799786    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26vwb\" (UniqueName: \"kubernetes.io/projected/4652b44c-08f8-4458-aa40-979caae9dbd0-kube-api-access-26vwb\") pod \"redis-69bbd798b6-2b6vz\" (UID: \"4652b44c-08f8-4458-aa40-979caae9dbd0\") " pod="test-ns-feast/redis-69bbd798b6-2b6vz"
Jun 11 09:49:43.894743 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.894717    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-2b6vz"
Jun 11 09:49:43.914633 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.914611    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-z5c4f"]
Jun 11 09:49:43.916625 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:49:43.916575    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbaf7ca53_81bf_4c52_8b79_a2431946d393.slice/crio-e6a6803e4e1d69e955adb5c6cac4dc7ab637be6eb9f90ddf534091223b3fbc43 WatchSource:0}: Error finding container e6a6803e4e1d69e955adb5c6cac4dc7ab637be6eb9f90ddf534091223b3fbc43: Status 404 returned error can't find the container with id e6a6803e4e1d69e955adb5c6cac4dc7ab637be6eb9f90ddf534091223b3fbc43
Jun 11 09:49:43.918463 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:43.918445    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 11 09:49:44.031966 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:44.031937    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-2b6vz"]
Jun 11 09:49:44.035061 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:49:44.035034    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4652b44c_08f8_4458_aa40_979caae9dbd0.slice/crio-f078b2f3af454ff6529769f982e32b642fbb08bbb6e63349a21a12506156b90e WatchSource:0}: Error finding container f078b2f3af454ff6529769f982e32b642fbb08bbb6e63349a21a12506156b90e: Status 404 returned error can't find the container with id f078b2f3af454ff6529769f982e32b642fbb08bbb6e63349a21a12506156b90e
Jun 11 09:49:44.732440 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:44.732404    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-2b6vz" event={"ID":"4652b44c-08f8-4458-aa40-979caae9dbd0","Type":"ContainerStarted","Data":"f078b2f3af454ff6529769f982e32b642fbb08bbb6e63349a21a12506156b90e"}
Jun 11 09:49:44.734153 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:44.734120    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-z5c4f" event={"ID":"baf7ca53-81bf-4c52-8b79-a2431946d393","Type":"ContainerStarted","Data":"e6a6803e4e1d69e955adb5c6cac4dc7ab637be6eb9f90ddf534091223b3fbc43"}
Jun 11 09:49:45.740766 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:45.740728    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-2b6vz" event={"ID":"4652b44c-08f8-4458-aa40-979caae9dbd0","Type":"ContainerStarted","Data":"2a8a067d876750608afc55763b76a4c447812d31e5f49da42033cee87b66debf"}
Jun 11 09:49:45.772632 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:45.772512    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-2b6vz" podStartSLOduration=1.296972966 podStartE2EDuration="2.772496116s" totalImagesPullingTime="1.47552315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:49:45.771875296 +0000 UTC m=+912.892591939" watchObservedRunningTime="2026-06-11 09:49:45.772496116 +0000 UTC m=+912.893212760"
Jun 11 09:49:50.760571 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:50.760536    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-z5c4f" event={"ID":"baf7ca53-81bf-4c52-8b79-a2431946d393","Type":"ContainerStarted","Data":"0f9b54b71c1deefe89881b2bbabd32dc93a470801c12b2270c65387f3836a321"}
Jun 11 09:49:50.791366 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:50.791309    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-z5c4f" podStartSLOduration=1.8586596260000001 podStartE2EDuration="7.791293081s" totalImagesPullingTime="5.932633455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:49:50.789800353 +0000 UTC m=+917.910516997" watchObservedRunningTime="2026-06-11 09:49:50.791293081 +0000 UTC m=+917.912009726"
Jun 11 09:49:54.527660 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.527625    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"]
Jun 11 09:49:54.530942 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.530924    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:54.542254 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.542236    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Jun 11 09:49:54.542558 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.542540    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-22xrd\""
Jun 11 09:49:54.542880 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.542866    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Jun 11 09:49:54.543039 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.543026    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jun 11 09:49:54.548630 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.548615    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Jun 11 09:49:54.574735 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.574711    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"]
Jun 11 09:49:54.577374 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.577353    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6bfd\" (UniqueName: \"kubernetes.io/projected/a705e047-6e2e-46f6-937c-1058ce89e059-kube-api-access-j6bfd\") pod \"feast-credit-scoring-d45fcdc5c-54nnz\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") " pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:54.577490 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.577397    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a705e047-6e2e-46f6-937c-1058ce89e059-feast-data\") pod \"feast-credit-scoring-d45fcdc5c-54nnz\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") " pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:54.577490 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.577429    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-offline-tls\") pod \"feast-credit-scoring-d45fcdc5c-54nnz\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") " pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:54.577490 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.577464    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-registry-tls\") pod \"feast-credit-scoring-d45fcdc5c-54nnz\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") " pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:54.577626 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.577578    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-online-tls\") pod \"feast-credit-scoring-d45fcdc5c-54nnz\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") " pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:54.677926 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.677897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-online-tls\") pod \"feast-credit-scoring-d45fcdc5c-54nnz\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") " pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:54.678108 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.677936    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6bfd\" (UniqueName: \"kubernetes.io/projected/a705e047-6e2e-46f6-937c-1058ce89e059-kube-api-access-j6bfd\") pod \"feast-credit-scoring-d45fcdc5c-54nnz\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") " pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:54.678108 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.677980    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a705e047-6e2e-46f6-937c-1058ce89e059-feast-data\") pod \"feast-credit-scoring-d45fcdc5c-54nnz\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") " pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:54.678108 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.678007    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-offline-tls\") pod \"feast-credit-scoring-d45fcdc5c-54nnz\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") " pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:54.678108 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.678044    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-registry-tls\") pod \"feast-credit-scoring-d45fcdc5c-54nnz\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") " pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:54.678317 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:49:54.678151    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found
Jun 11 09:49:54.678317 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:49:54.678230    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-registry-tls podName:a705e047-6e2e-46f6-937c-1058ce89e059 nodeName:}" failed. No retries permitted until 2026-06-11 09:49:55.178207312 +0000 UTC m=+922.298923937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-registry-tls") pod "feast-credit-scoring-d45fcdc5c-54nnz" (UID: "a705e047-6e2e-46f6-937c-1058ce89e059") : secret "feast-credit-scoring-registry-tls" not found
Jun 11 09:49:54.678540 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.678506    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a705e047-6e2e-46f6-937c-1058ce89e059-feast-data\") pod \"feast-credit-scoring-d45fcdc5c-54nnz\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") " pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:54.680372 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.680351    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-online-tls\") pod \"feast-credit-scoring-d45fcdc5c-54nnz\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") " pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:54.680473 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.680416    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-offline-tls\") pod \"feast-credit-scoring-d45fcdc5c-54nnz\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") " pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:54.705582 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:54.705561    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6bfd\" (UniqueName: \"kubernetes.io/projected/a705e047-6e2e-46f6-937c-1058ce89e059-kube-api-access-j6bfd\") pod \"feast-credit-scoring-d45fcdc5c-54nnz\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") " pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:55.180617 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:55.180572    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-registry-tls\") pod \"feast-credit-scoring-d45fcdc5c-54nnz\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") " pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:55.182848 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:55.182826    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-registry-tls\") pod \"feast-credit-scoring-d45fcdc5c-54nnz\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") " pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:55.440520 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:55.440444    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:49:55.638117 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:49:55.638091    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda705e047_6e2e_46f6_937c_1058ce89e059.slice/crio-76b3e6ad9f90bdafdea6a0767416db3ec80bae7ca04d21878002077848855023 WatchSource:0}: Error finding container 76b3e6ad9f90bdafdea6a0767416db3ec80bae7ca04d21878002077848855023: Status 404 returned error can't find the container with id 76b3e6ad9f90bdafdea6a0767416db3ec80bae7ca04d21878002077848855023
Jun 11 09:49:55.643114 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:55.643090    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"]
Jun 11 09:49:55.780439 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:55.780407    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" event={"ID":"a705e047-6e2e-46f6-937c-1058ce89e059","Type":"ContainerStarted","Data":"cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218"}
Jun 11 09:49:55.780573 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:55.780463    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" event={"ID":"a705e047-6e2e-46f6-937c-1058ce89e059","Type":"ContainerStarted","Data":"76b3e6ad9f90bdafdea6a0767416db3ec80bae7ca04d21878002077848855023"}
Jun 11 09:49:56.785936 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:56.785899    2561 generic.go:356] "Generic (PLEG): container finished" podID="a705e047-6e2e-46f6-937c-1058ce89e059" containerID="cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218" exitCode=0
Jun 11 09:49:56.786264 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:56.785961    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" event={"ID":"a705e047-6e2e-46f6-937c-1058ce89e059","Type":"ContainerDied","Data":"cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218"}
Jun 11 09:49:57.792164 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:49:57.792125    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" event={"ID":"a705e047-6e2e-46f6-937c-1058ce89e059","Type":"ContainerStarted","Data":"663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49"}
Jun 11 09:50:03.818367 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:03.818331    2561 generic.go:356] "Generic (PLEG): container finished" podID="a705e047-6e2e-46f6-937c-1058ce89e059" containerID="663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49" exitCode=0
Jun 11 09:50:03.818786 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:03.818402    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" event={"ID":"a705e047-6e2e-46f6-937c-1058ce89e059","Type":"ContainerDied","Data":"663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49"}
Jun 11 09:50:04.826848 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:04.826801    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" event={"ID":"a705e047-6e2e-46f6-937c-1058ce89e059","Type":"ContainerStarted","Data":"05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e"}
Jun 11 09:50:04.827345 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:04.826872    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" event={"ID":"a705e047-6e2e-46f6-937c-1058ce89e059","Type":"ContainerStarted","Data":"6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2"}
Jun 11 09:50:04.827345 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:04.826892    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" event={"ID":"a705e047-6e2e-46f6-937c-1058ce89e059","Type":"ContainerStarted","Data":"791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932"}
Jun 11 09:50:05.440710 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:05.440669    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:50:05.440875 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:05.440742    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:50:05.440875 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:05.440769    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:50:07.440797 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:07.440765    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:50:07.441269 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:07.440835    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:50:07.441269 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:07.440854    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:50:07.442802 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:07.442772    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.27:8816: connect: connection refused"
Jun 11 09:50:07.442914 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:07.442829    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
Jun 11 09:50:07.442914 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:07.442773    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.27:6571: connect: connection refused"
Jun 11 09:50:10.441643 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:10.441583    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.27:6571: connect: connection refused"
Jun 11 09:50:10.442536 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:10.442516    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:50:10.443408 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:10.443382    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:50:10.447261 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:10.447234    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:50:10.470289 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:10.470242    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" podStartSLOduration=16.470229035 podStartE2EDuration="16.470229035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:49:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:50:04.887873823 +0000 UTC m=+932.008590626" watchObservedRunningTime="2026-06-11 09:50:10.470229035 +0000 UTC m=+937.590945677"
Jun 11 09:50:10.862787 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:10.862757    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:50:13.441664 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:13.441620    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.27:6571: connect: connection refused"
Jun 11 09:50:16.442120 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:16.442082    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:50:16.442848 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:50:16.442826    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:51:17.517477 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.517438    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"]
Jun 11 09:51:17.518540 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.518484    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="registry" containerID="cri-o://791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932" gracePeriod=30
Jun 11 09:51:17.519061 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.519003    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="offline" containerID="cri-o://05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e" gracePeriod=30
Jun 11 09:51:17.519172 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.519047    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="online" containerID="cri-o://6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2" gracePeriod=30
Jun 11 09:51:17.545293 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.545259    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-z5c4f"]
Jun 11 09:51:17.545468 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.545432    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-z5c4f" podUID="baf7ca53-81bf-4c52-8b79-a2431946d393" containerName="postgres" containerID="cri-o://0f9b54b71c1deefe89881b2bbabd32dc93a470801c12b2270c65387f3836a321" gracePeriod=30
Jun 11 09:51:17.553943 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.553897    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-2b6vz"]
Jun 11 09:51:17.554156 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.554130    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-2b6vz" podUID="4652b44c-08f8-4458-aa40-979caae9dbd0" containerName="redis" containerID="cri-o://2a8a067d876750608afc55763b76a4c447812d31e5f49da42033cee87b66debf" gracePeriod=30
Jun 11 09:51:17.788870 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.788846    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-z5c4f"
Jun 11 09:51:17.819032 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.819006    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-2b6vz"
Jun 11 09:51:17.890484 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.890449    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxp6x\" (UniqueName: \"kubernetes.io/projected/baf7ca53-81bf-4c52-8b79-a2431946d393-kube-api-access-xxp6x\") pod \"baf7ca53-81bf-4c52-8b79-a2431946d393\" (UID: \"baf7ca53-81bf-4c52-8b79-a2431946d393\") "
Jun 11 09:51:17.890698 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.890512    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/baf7ca53-81bf-4c52-8b79-a2431946d393-postgresdata\") pod \"baf7ca53-81bf-4c52-8b79-a2431946d393\" (UID: \"baf7ca53-81bf-4c52-8b79-a2431946d393\") "
Jun 11 09:51:17.892584 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.892554    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baf7ca53-81bf-4c52-8b79-a2431946d393-kube-api-access-xxp6x" (OuterVolumeSpecName: "kube-api-access-xxp6x") pod "baf7ca53-81bf-4c52-8b79-a2431946d393" (UID: "baf7ca53-81bf-4c52-8b79-a2431946d393"). InnerVolumeSpecName "kube-api-access-xxp6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 09:51:17.919924 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.919879    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf7ca53-81bf-4c52-8b79-a2431946d393-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "baf7ca53-81bf-4c52-8b79-a2431946d393" (UID: "baf7ca53-81bf-4c52-8b79-a2431946d393"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 09:51:17.991906 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.991857    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26vwb\" (UniqueName: \"kubernetes.io/projected/4652b44c-08f8-4458-aa40-979caae9dbd0-kube-api-access-26vwb\") pod \"4652b44c-08f8-4458-aa40-979caae9dbd0\" (UID: \"4652b44c-08f8-4458-aa40-979caae9dbd0\") "
Jun 11 09:51:17.992104 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.992035    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxp6x\" (UniqueName: \"kubernetes.io/projected/baf7ca53-81bf-4c52-8b79-a2431946d393-kube-api-access-xxp6x\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:51:17.992104 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.992046    2561 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/baf7ca53-81bf-4c52-8b79-a2431946d393-postgresdata\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:51:17.993913 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:17.993880    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4652b44c-08f8-4458-aa40-979caae9dbd0-kube-api-access-26vwb" (OuterVolumeSpecName: "kube-api-access-26vwb") pod "4652b44c-08f8-4458-aa40-979caae9dbd0" (UID: "4652b44c-08f8-4458-aa40-979caae9dbd0"). InnerVolumeSpecName "kube-api-access-26vwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 09:51:18.093087 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.092980    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26vwb\" (UniqueName: \"kubernetes.io/projected/4652b44c-08f8-4458-aa40-979caae9dbd0-kube-api-access-26vwb\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:51:18.133099 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.133062    2561 generic.go:356] "Generic (PLEG): container finished" podID="4652b44c-08f8-4458-aa40-979caae9dbd0" containerID="2a8a067d876750608afc55763b76a4c447812d31e5f49da42033cee87b66debf" exitCode=0
Jun 11 09:51:18.133274 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.133116    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-2b6vz"
Jun 11 09:51:18.133274 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.133140    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-2b6vz" event={"ID":"4652b44c-08f8-4458-aa40-979caae9dbd0","Type":"ContainerDied","Data":"2a8a067d876750608afc55763b76a4c447812d31e5f49da42033cee87b66debf"}
Jun 11 09:51:18.133274 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.133187    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-2b6vz" event={"ID":"4652b44c-08f8-4458-aa40-979caae9dbd0","Type":"ContainerDied","Data":"f078b2f3af454ff6529769f982e32b642fbb08bbb6e63349a21a12506156b90e"}
Jun 11 09:51:18.133274 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.133214    2561 scope.go:117] "RemoveContainer" containerID="2a8a067d876750608afc55763b76a4c447812d31e5f49da42033cee87b66debf"
Jun 11 09:51:18.134404 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.134383    2561 generic.go:356] "Generic (PLEG): container finished" podID="baf7ca53-81bf-4c52-8b79-a2431946d393" containerID="0f9b54b71c1deefe89881b2bbabd32dc93a470801c12b2270c65387f3836a321" exitCode=0
Jun 11 09:51:18.134457 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.134419    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-z5c4f" event={"ID":"baf7ca53-81bf-4c52-8b79-a2431946d393","Type":"ContainerDied","Data":"0f9b54b71c1deefe89881b2bbabd32dc93a470801c12b2270c65387f3836a321"}
Jun 11 09:51:18.134457 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.134447    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-z5c4f" event={"ID":"baf7ca53-81bf-4c52-8b79-a2431946d393","Type":"ContainerDied","Data":"e6a6803e4e1d69e955adb5c6cac4dc7ab637be6eb9f90ddf534091223b3fbc43"}
Jun 11 09:51:18.134574 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.134423    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-z5c4f"
Jun 11 09:51:18.142801 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.142778    2561 scope.go:117] "RemoveContainer" containerID="2a8a067d876750608afc55763b76a4c447812d31e5f49da42033cee87b66debf"
Jun 11 09:51:18.143086 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:51:18.143065    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a8a067d876750608afc55763b76a4c447812d31e5f49da42033cee87b66debf\": container with ID starting with 2a8a067d876750608afc55763b76a4c447812d31e5f49da42033cee87b66debf not found: ID does not exist" containerID="2a8a067d876750608afc55763b76a4c447812d31e5f49da42033cee87b66debf"
Jun 11 09:51:18.143166 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.143092    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a8a067d876750608afc55763b76a4c447812d31e5f49da42033cee87b66debf"} err="failed to get container status \"2a8a067d876750608afc55763b76a4c447812d31e5f49da42033cee87b66debf\": rpc error: code = NotFound desc = could not find container \"2a8a067d876750608afc55763b76a4c447812d31e5f49da42033cee87b66debf\": container with ID starting with 2a8a067d876750608afc55763b76a4c447812d31e5f49da42033cee87b66debf not found: ID does not exist"
Jun 11 09:51:18.143166 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.143110    2561 scope.go:117] "RemoveContainer" containerID="0f9b54b71c1deefe89881b2bbabd32dc93a470801c12b2270c65387f3836a321"
Jun 11 09:51:18.151064 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.151046    2561 scope.go:117] "RemoveContainer" containerID="0f9b54b71c1deefe89881b2bbabd32dc93a470801c12b2270c65387f3836a321"
Jun 11 09:51:18.151393 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:51:18.151370    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f9b54b71c1deefe89881b2bbabd32dc93a470801c12b2270c65387f3836a321\": container with ID starting with 0f9b54b71c1deefe89881b2bbabd32dc93a470801c12b2270c65387f3836a321 not found: ID does not exist" containerID="0f9b54b71c1deefe89881b2bbabd32dc93a470801c12b2270c65387f3836a321"
Jun 11 09:51:18.151463 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.151403    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f9b54b71c1deefe89881b2bbabd32dc93a470801c12b2270c65387f3836a321"} err="failed to get container status \"0f9b54b71c1deefe89881b2bbabd32dc93a470801c12b2270c65387f3836a321\": rpc error: code = NotFound desc = could not find container \"0f9b54b71c1deefe89881b2bbabd32dc93a470801c12b2270c65387f3836a321\": container with ID starting with 0f9b54b71c1deefe89881b2bbabd32dc93a470801c12b2270c65387f3836a321 not found: ID does not exist"
Jun 11 09:51:18.162380 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.162356    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-z5c4f"]
Jun 11 09:51:18.167135 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.167113    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-z5c4f"]
Jun 11 09:51:18.181025 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.180993    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-2b6vz"]
Jun 11 09:51:18.187767 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:18.187740    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-2b6vz"]
Jun 11 09:51:19.142697 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:19.142661    2561 generic.go:356] "Generic (PLEG): container finished" podID="a705e047-6e2e-46f6-937c-1058ce89e059" containerID="6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2" exitCode=0
Jun 11 09:51:19.143053 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:19.142714    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" event={"ID":"a705e047-6e2e-46f6-937c-1058ce89e059","Type":"ContainerDied","Data":"6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2"}
Jun 11 09:51:19.377846 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:19.377813    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4652b44c-08f8-4458-aa40-979caae9dbd0" path="/var/lib/kubelet/pods/4652b44c-08f8-4458-aa40-979caae9dbd0/volumes"
Jun 11 09:51:19.378170 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:19.378158    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baf7ca53-81bf-4c52-8b79-a2431946d393" path="/var/lib/kubelet/pods/baf7ca53-81bf-4c52-8b79-a2431946d393/volumes"
Jun 11 09:51:20.859926 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:20.859883    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
Jun 11 09:51:30.860116 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:30.860068    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
Jun 11 09:51:40.860028 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:40.859985    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
Jun 11 09:51:40.860426 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:40.860105    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:51:48.164655 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.164628    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:51:48.234966 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.234929    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-offline-tls\") pod \"a705e047-6e2e-46f6-937c-1058ce89e059\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") "
Jun 11 09:51:48.235160 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.235002    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a705e047-6e2e-46f6-937c-1058ce89e059-feast-data\") pod \"a705e047-6e2e-46f6-937c-1058ce89e059\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") "
Jun 11 09:51:48.235160 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.235039    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-online-tls\") pod \"a705e047-6e2e-46f6-937c-1058ce89e059\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") "
Jun 11 09:51:48.235160 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.235063    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-registry-tls\") pod \"a705e047-6e2e-46f6-937c-1058ce89e059\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") "
Jun 11 09:51:48.235160 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.235123    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6bfd\" (UniqueName: \"kubernetes.io/projected/a705e047-6e2e-46f6-937c-1058ce89e059-kube-api-access-j6bfd\") pod \"a705e047-6e2e-46f6-937c-1058ce89e059\" (UID: \"a705e047-6e2e-46f6-937c-1058ce89e059\") "
Jun 11 09:51:48.237114 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.237073    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-online-tls" (OuterVolumeSpecName: "online-tls") pod "a705e047-6e2e-46f6-937c-1058ce89e059" (UID: "a705e047-6e2e-46f6-937c-1058ce89e059"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:51:48.237114 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.237106    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a705e047-6e2e-46f6-937c-1058ce89e059" (UID: "a705e047-6e2e-46f6-937c-1058ce89e059"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:51:48.237281 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.237197    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a705e047-6e2e-46f6-937c-1058ce89e059" (UID: "a705e047-6e2e-46f6-937c-1058ce89e059"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:51:48.237474 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.237453    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a705e047-6e2e-46f6-937c-1058ce89e059-kube-api-access-j6bfd" (OuterVolumeSpecName: "kube-api-access-j6bfd") pod "a705e047-6e2e-46f6-937c-1058ce89e059" (UID: "a705e047-6e2e-46f6-937c-1058ce89e059"). InnerVolumeSpecName "kube-api-access-j6bfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 09:51:48.243209 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.243182    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a705e047-6e2e-46f6-937c-1058ce89e059-feast-data" (OuterVolumeSpecName: "feast-data") pod "a705e047-6e2e-46f6-937c-1058ce89e059" (UID: "a705e047-6e2e-46f6-937c-1058ce89e059"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 09:51:48.259728 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.259699    2561 generic.go:356] "Generic (PLEG): container finished" podID="a705e047-6e2e-46f6-937c-1058ce89e059" containerID="05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e" exitCode=137
Jun 11 09:51:48.259728 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.259725    2561 generic.go:356] "Generic (PLEG): container finished" podID="a705e047-6e2e-46f6-937c-1058ce89e059" containerID="791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932" exitCode=137
Jun 11 09:51:48.259879 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.259759    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"
Jun 11 09:51:48.259879 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.259780    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" event={"ID":"a705e047-6e2e-46f6-937c-1058ce89e059","Type":"ContainerDied","Data":"05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e"}
Jun 11 09:51:48.259879 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.259842    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" event={"ID":"a705e047-6e2e-46f6-937c-1058ce89e059","Type":"ContainerDied","Data":"791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932"}
Jun 11 09:51:48.259879 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.259861    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz" event={"ID":"a705e047-6e2e-46f6-937c-1058ce89e059","Type":"ContainerDied","Data":"76b3e6ad9f90bdafdea6a0767416db3ec80bae7ca04d21878002077848855023"}
Jun 11 09:51:48.260022 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.259881    2561 scope.go:117] "RemoveContainer" containerID="05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e"
Jun 11 09:51:48.268065 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.268047    2561 scope.go:117] "RemoveContainer" containerID="6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2"
Jun 11 09:51:48.275421 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.275406    2561 scope.go:117] "RemoveContainer" containerID="791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932"
Jun 11 09:51:48.282443 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.282416    2561 scope.go:117] "RemoveContainer" containerID="663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49"
Jun 11 09:51:48.284893 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.284870    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"]
Jun 11 09:51:48.290172 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.290155    2561 scope.go:117] "RemoveContainer" containerID="cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218"
Jun 11 09:51:48.291014 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.290992    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-d45fcdc5c-54nnz"]
Jun 11 09:51:48.296982 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.296967    2561 scope.go:117] "RemoveContainer" containerID="05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e"
Jun 11 09:51:48.297241 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:51:48.297224    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e\": container with ID starting with 05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e not found: ID does not exist" containerID="05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e"
Jun 11 09:51:48.297295 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.297248    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e"} err="failed to get container status \"05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e\": rpc error: code = NotFound desc = could not find container \"05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e\": container with ID starting with 05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e not found: ID does not exist"
Jun 11 09:51:48.297295 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.297265    2561 scope.go:117] "RemoveContainer" containerID="6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2"
Jun 11 09:51:48.297484 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:51:48.297467    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2\": container with ID starting with 6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2 not found: ID does not exist" containerID="6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2"
Jun 11 09:51:48.297525 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.297488    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2"} err="failed to get container status \"6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2\": rpc error: code = NotFound desc = could not find container \"6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2\": container with ID starting with 6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2 not found: ID does not exist"
Jun 11 09:51:48.297525 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.297501    2561 scope.go:117] "RemoveContainer" containerID="791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932"
Jun 11 09:51:48.297759 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:51:48.297741    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932\": container with ID starting with 791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932 not found: ID does not exist" containerID="791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932"
Jun 11 09:51:48.297818 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.297771    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932"} err="failed to get container status \"791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932\": rpc error: code = NotFound desc = could not find container \"791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932\": container with ID starting with 791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932 not found: ID does not exist"
Jun 11 09:51:48.297818 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.297784    2561 scope.go:117] "RemoveContainer" containerID="663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49"
Jun 11 09:51:48.298050 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:51:48.298032    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49\": container with ID starting with 663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49 not found: ID does not exist" containerID="663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49"
Jun 11 09:51:48.298096 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.298057    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49"} err="failed to get container status \"663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49\": rpc error: code = NotFound desc = could not find container \"663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49\": container with ID starting with 663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49 not found: ID does not exist"
Jun 11 09:51:48.298096 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.298076    2561 scope.go:117] "RemoveContainer" containerID="cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218"
Jun 11 09:51:48.298313 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:51:48.298297    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218\": container with ID starting with cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218 not found: ID does not exist" containerID="cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218"
Jun 11 09:51:48.298357 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.298316    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218"} err="failed to get container status \"cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218\": rpc error: code = NotFound desc = could not find container \"cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218\": container with ID starting with cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218 not found: ID does not exist"
Jun 11 09:51:48.298357 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.298331    2561 scope.go:117] "RemoveContainer" containerID="05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e"
Jun 11 09:51:48.298524 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.298509    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e"} err="failed to get container status \"05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e\": rpc error: code = NotFound desc = could not find container \"05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e\": container with ID starting with 05170ad8c322d0bbd6bcc1119c76538381c325ad5601e64b1d74b4d04d8d8f2e not found: ID does not exist"
Jun 11 09:51:48.298564 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.298524    2561 scope.go:117] "RemoveContainer" containerID="6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2"
Jun 11 09:51:48.298726 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.298712    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2"} err="failed to get container status \"6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2\": rpc error: code = NotFound desc = could not find container \"6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2\": container with ID starting with 6aabf2af0c4953da3d74d22d563bc114f764d2e9c261b65d8e36a243c34918e2 not found: ID does not exist"
Jun 11 09:51:48.298792 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.298726    2561 scope.go:117] "RemoveContainer" containerID="791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932"
Jun 11 09:51:48.298914 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.298886    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932"} err="failed to get container status \"791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932\": rpc error: code = NotFound desc = could not find container \"791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932\": container with ID starting with 791ca06671193b90f079a5ad1af2ef79879005e990a2b450a220a8beec5e8932 not found: ID does not exist"
Jun 11 09:51:48.298914 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.298913    2561 scope.go:117] "RemoveContainer" containerID="663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49"
Jun 11 09:51:48.299120 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.299104    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49"} err="failed to get container status \"663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49\": rpc error: code = NotFound desc = could not find container \"663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49\": container with ID starting with 663054e9bfb775a0f34b6b453be1f21ca4d4a2903999c514bdc615133c44bf49 not found: ID does not exist"
Jun 11 09:51:48.299170 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.299120    2561 scope.go:117] "RemoveContainer" containerID="cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218"
Jun 11 09:51:48.299357 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.299338    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218"} err="failed to get container status \"cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218\": rpc error: code = NotFound desc = could not find container \"cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218\": container with ID starting with cf4082fee85a4215f33d201479034798f4e25196aefb73ba14b850579db6a218 not found: ID does not exist"
Jun 11 09:51:48.335897 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.335870    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-registry-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:51:48.335897 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.335895    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6bfd\" (UniqueName: \"kubernetes.io/projected/a705e047-6e2e-46f6-937c-1058ce89e059-kube-api-access-j6bfd\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:51:48.336044 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.335905    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-offline-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:51:48.336044 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.335913    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a705e047-6e2e-46f6-937c-1058ce89e059-feast-data\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:51:48.336044 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:48.335921    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a705e047-6e2e-46f6-937c-1058ce89e059-online-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:51:49.378507 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:51:49.378475    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" path="/var/lib/kubelet/pods/a705e047-6e2e-46f6-937c-1058ce89e059/volumes"
Jun 11 09:53:41.775849 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.775815    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-rglbg"]
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776087    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4652b44c-08f8-4458-aa40-979caae9dbd0" containerName="redis"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776098    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4652b44c-08f8-4458-aa40-979caae9dbd0" containerName="redis"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776106    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baf7ca53-81bf-4c52-8b79-a2431946d393" containerName="postgres"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776111    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="baf7ca53-81bf-4c52-8b79-a2431946d393" containerName="postgres"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776118    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="offline"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776124    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="offline"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776134    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="registry"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776139    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="registry"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776148    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="feast-apply"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776154    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="feast-apply"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776163    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="online"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776168    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="online"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776177    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="feast-init"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776183    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="feast-init"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776227    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="online"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776235    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="baf7ca53-81bf-4c52-8b79-a2431946d393" containerName="postgres"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776245    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4652b44c-08f8-4458-aa40-979caae9dbd0" containerName="redis"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776250    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="offline"
Jun 11 09:53:41.776298 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.776256    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a705e047-6e2e-46f6-937c-1058ce89e059" containerName="registry"
Jun 11 09:53:41.778974 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.778957    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-rglbg"
Jun 11 09:53:41.781830 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:53:41.781793    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-138-252.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"test-ns-feast-rest\": no relationship found between node 'ip-10-0-138-252.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jun 11 09:53:41.782289 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:53:41.782264    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"redis-69bbd798b6-rglbg\" is forbidden: User \"system:node:ip-10-0-138-252.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"test-ns-feast-rest\": no relationship found between node 'ip-10-0-138-252.ec2.internal' and this object" podUID="46a70f9f-41dc-441f-ac36-cf043271ab13" pod="test-ns-feast-rest/redis-69bbd798b6-rglbg"
Jun 11 09:53:41.782336 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:53:41.782290    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-138-252.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"test-ns-feast-rest\": no relationship found between node 'ip-10-0-138-252.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jun 11 09:53:41.782336 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:53:41.782286    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-t5frq\" is forbidden: User \"system:node:ip-10-0-138-252.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"test-ns-feast-rest\": no relationship found between node 'ip-10-0-138-252.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-t5frq\"" type="*v1.Secret"
Jun 11 09:53:41.816040 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.816009    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-rglbg"]
Jun 11 09:53:41.885636 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.885584    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc4tc\" (UniqueName: \"kubernetes.io/projected/46a70f9f-41dc-441f-ac36-cf043271ab13-kube-api-access-zc4tc\") pod \"redis-69bbd798b6-rglbg\" (UID: \"46a70f9f-41dc-441f-ac36-cf043271ab13\") " pod="test-ns-feast-rest/redis-69bbd798b6-rglbg"
Jun 11 09:53:41.986653 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:41.986617    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc4tc\" (UniqueName: \"kubernetes.io/projected/46a70f9f-41dc-441f-ac36-cf043271ab13-kube-api-access-zc4tc\") pod \"redis-69bbd798b6-rglbg\" (UID: \"46a70f9f-41dc-441f-ac36-cf043271ab13\") " pod="test-ns-feast-rest/redis-69bbd798b6-rglbg"
Jun 11 09:53:42.803656 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:42.803622    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Jun 11 09:53:42.856438 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:42.856410    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Jun 11 09:53:42.867135 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:42.867113    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc4tc\" (UniqueName: \"kubernetes.io/projected/46a70f9f-41dc-441f-ac36-cf043271ab13-kube-api-access-zc4tc\") pod \"redis-69bbd798b6-rglbg\" (UID: \"46a70f9f-41dc-441f-ac36-cf043271ab13\") " pod="test-ns-feast-rest/redis-69bbd798b6-rglbg"
Jun 11 09:53:43.193343 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:43.193265    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-t5frq\""
Jun 11 09:53:43.198428 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:43.198413    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-rglbg"
Jun 11 09:53:43.327965 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:43.327926    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-rglbg"]
Jun 11 09:53:43.330778 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:53:43.330753    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46a70f9f_41dc_441f_ac36_cf043271ab13.slice/crio-6f9d176f9488601f9f9ed995f0d064886f19c6734295f02efc3af3c3eddb28b8 WatchSource:0}: Error finding container 6f9d176f9488601f9f9ed995f0d064886f19c6734295f02efc3af3c3eddb28b8: Status 404 returned error can't find the container with id 6f9d176f9488601f9f9ed995f0d064886f19c6734295f02efc3af3c3eddb28b8
Jun 11 09:53:43.676379 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:43.676335    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-rglbg" event={"ID":"46a70f9f-41dc-441f-ac36-cf043271ab13","Type":"ContainerStarted","Data":"cc454ab1febb9ea2880a6875bcc9373339efbc634101c2f82bda19ef0f90e800"}
Jun 11 09:53:43.676379 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:43.676381    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-rglbg" event={"ID":"46a70f9f-41dc-441f-ac36-cf043271ab13","Type":"ContainerStarted","Data":"6f9d176f9488601f9f9ed995f0d064886f19c6734295f02efc3af3c3eddb28b8"}
Jun 11 09:53:43.699203 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:43.699157    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-rglbg" podStartSLOduration=2.699145019 podStartE2EDuration="2.699145019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:53:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:53:43.698287805 +0000 UTC m=+1150.819004449" watchObservedRunningTime="2026-06-11 09:53:43.699145019 +0000 UTC m=+1150.819861663"
Jun 11 09:53:47.273848 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:47.273772    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-mtwkd"]
Jun 11 09:53:47.276881 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:47.276857    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-mtwkd"
Jun 11 09:53:47.279360 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:47.279340    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Jun 11 09:53:47.288592 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:47.288565    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-mtwkd"]
Jun 11 09:53:47.429749 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:47.429722    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22ptf\" (UniqueName: \"kubernetes.io/projected/4909d917-16b1-4c9c-894b-50589df40f07-kube-api-access-22ptf\") pod \"postgres-864846d4f5-mtwkd\" (UID: \"4909d917-16b1-4c9c-894b-50589df40f07\") " pod="test-ns-feast-rest/postgres-864846d4f5-mtwkd"
Jun 11 09:53:47.429882 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:47.429758    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/4909d917-16b1-4c9c-894b-50589df40f07-postgresdata\") pod \"postgres-864846d4f5-mtwkd\" (UID: \"4909d917-16b1-4c9c-894b-50589df40f07\") " pod="test-ns-feast-rest/postgres-864846d4f5-mtwkd"
Jun 11 09:53:47.530911 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:47.530843    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22ptf\" (UniqueName: \"kubernetes.io/projected/4909d917-16b1-4c9c-894b-50589df40f07-kube-api-access-22ptf\") pod \"postgres-864846d4f5-mtwkd\" (UID: \"4909d917-16b1-4c9c-894b-50589df40f07\") " pod="test-ns-feast-rest/postgres-864846d4f5-mtwkd"
Jun 11 09:53:47.530911 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:47.530883    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/4909d917-16b1-4c9c-894b-50589df40f07-postgresdata\") pod \"postgres-864846d4f5-mtwkd\" (UID: \"4909d917-16b1-4c9c-894b-50589df40f07\") " pod="test-ns-feast-rest/postgres-864846d4f5-mtwkd"
Jun 11 09:53:47.531260 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:47.531244    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/4909d917-16b1-4c9c-894b-50589df40f07-postgresdata\") pod \"postgres-864846d4f5-mtwkd\" (UID: \"4909d917-16b1-4c9c-894b-50589df40f07\") " pod="test-ns-feast-rest/postgres-864846d4f5-mtwkd"
Jun 11 09:53:47.541171 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:47.541145    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22ptf\" (UniqueName: \"kubernetes.io/projected/4909d917-16b1-4c9c-894b-50589df40f07-kube-api-access-22ptf\") pod \"postgres-864846d4f5-mtwkd\" (UID: \"4909d917-16b1-4c9c-894b-50589df40f07\") " pod="test-ns-feast-rest/postgres-864846d4f5-mtwkd"
Jun 11 09:53:47.589113 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:47.589088    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-mtwkd"
Jun 11 09:53:47.715243 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:47.715213    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-mtwkd"]
Jun 11 09:53:47.718168 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:53:47.718138    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4909d917_16b1_4c9c_894b_50589df40f07.slice/crio-33355d0effda2148d4b5271ed58898e7b3907a16f929849f81dfef8bbe4c3f82 WatchSource:0}: Error finding container 33355d0effda2148d4b5271ed58898e7b3907a16f929849f81dfef8bbe4c3f82: Status 404 returned error can't find the container with id 33355d0effda2148d4b5271ed58898e7b3907a16f929849f81dfef8bbe4c3f82
Jun 11 09:53:48.696835 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:48.696798    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-mtwkd" event={"ID":"4909d917-16b1-4c9c-894b-50589df40f07","Type":"ContainerStarted","Data":"0bf991f88a6e7cb8cae9d92c56c4f7c347cc1e0604eb90880407824c2806e7c2"}
Jun 11 09:53:48.696835 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:48.696837    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-mtwkd" event={"ID":"4909d917-16b1-4c9c-894b-50589df40f07","Type":"ContainerStarted","Data":"33355d0effda2148d4b5271ed58898e7b3907a16f929849f81dfef8bbe4c3f82"}
Jun 11 09:53:48.713175 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:48.713129    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-mtwkd" podStartSLOduration=1.71311434 podStartE2EDuration="1.71311434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:53:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:53:48.711917169 +0000 UTC m=+1155.832633812" watchObservedRunningTime="2026-06-11 09:53:48.71311434 +0000 UTC m=+1155.833830984"
Jun 11 09:53:52.966124 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:52.966089    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"]
Jun 11 09:53:52.970084 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:52.970066    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:53:52.972465 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:52.972444    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Jun 11 09:53:52.972574 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:52.972450    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Jun 11 09:53:52.972574 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:52.972557    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-f2p5c\""
Jun 11 09:53:52.972851 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:52.972836    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Jun 11 09:53:52.980771 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:52.980750    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"]
Jun 11 09:53:53.076132 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:53.076096    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-feast-data\") pod \"feast-credit-scoring-fd88bf769-69nm6\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") " pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:53:53.076132 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:53.076130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ds8j\" (UniqueName: \"kubernetes.io/projected/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-kube-api-access-5ds8j\") pod \"feast-credit-scoring-fd88bf769-69nm6\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") " pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:53:53.076368 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:53.076165    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-registry-tls\") pod \"feast-credit-scoring-fd88bf769-69nm6\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") " pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:53:53.076368 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:53.076232    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-online-tls\") pod \"feast-credit-scoring-fd88bf769-69nm6\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") " pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:53:53.177398 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:53.177363    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-online-tls\") pod \"feast-credit-scoring-fd88bf769-69nm6\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") " pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:53:53.177564 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:53.177419    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-feast-data\") pod \"feast-credit-scoring-fd88bf769-69nm6\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") " pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:53:53.177564 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:53.177440    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ds8j\" (UniqueName: \"kubernetes.io/projected/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-kube-api-access-5ds8j\") pod \"feast-credit-scoring-fd88bf769-69nm6\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") " pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:53:53.177564 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:53.177476    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-registry-tls\") pod \"feast-credit-scoring-fd88bf769-69nm6\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") " pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:53:53.177564 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:53:53.177526    2561 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Jun 11 09:53:53.177840 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:53:53.177591    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-online-tls podName:70a9dd1a-ee4c-495d-96d1-01bcf018c88a nodeName:}" failed. No retries permitted until 2026-06-11 09:53:53.677573605 +0000 UTC m=+1160.798290226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-online-tls") pod "feast-credit-scoring-fd88bf769-69nm6" (UID: "70a9dd1a-ee4c-495d-96d1-01bcf018c88a") : secret "feast-credit-scoring-online-tls" not found
Jun 11 09:53:53.177903 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:53.177860    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-feast-data\") pod \"feast-credit-scoring-fd88bf769-69nm6\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") " pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:53:53.179920 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:53.179903    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-registry-tls\") pod \"feast-credit-scoring-fd88bf769-69nm6\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") " pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:53:53.188278 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:53.188259    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ds8j\" (UniqueName: \"kubernetes.io/projected/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-kube-api-access-5ds8j\") pod \"feast-credit-scoring-fd88bf769-69nm6\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") " pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:53:53.682896 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:53.682859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-online-tls\") pod \"feast-credit-scoring-fd88bf769-69nm6\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") " pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:53:53.685118 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:53.685095    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-online-tls\") pod \"feast-credit-scoring-fd88bf769-69nm6\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") " pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:53:53.881755 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:53.881717    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:53:54.022581 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:54.022555    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"]
Jun 11 09:53:54.024329 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:53:54.024303    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a9dd1a_ee4c_495d_96d1_01bcf018c88a.slice/crio-7fca3ca4161625775383a65f64f6b1d80765b5063805c257cfca444b16c51f98 WatchSource:0}: Error finding container 7fca3ca4161625775383a65f64f6b1d80765b5063805c257cfca444b16c51f98: Status 404 returned error can't find the container with id 7fca3ca4161625775383a65f64f6b1d80765b5063805c257cfca444b16c51f98
Jun 11 09:53:54.719392 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:54.719347    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" event={"ID":"70a9dd1a-ee4c-495d-96d1-01bcf018c88a","Type":"ContainerStarted","Data":"3f29558f089c244a475a24a7d01e24f8512849f0bc786d359f3f4c9200518eed"}
Jun 11 09:53:54.719613 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:54.719404    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" event={"ID":"70a9dd1a-ee4c-495d-96d1-01bcf018c88a","Type":"ContainerStarted","Data":"7fca3ca4161625775383a65f64f6b1d80765b5063805c257cfca444b16c51f98"}
Jun 11 09:53:55.724579 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:55.724544    2561 generic.go:356] "Generic (PLEG): container finished" podID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerID="3f29558f089c244a475a24a7d01e24f8512849f0bc786d359f3f4c9200518eed" exitCode=0
Jun 11 09:53:55.724956 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:55.724618    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" event={"ID":"70a9dd1a-ee4c-495d-96d1-01bcf018c88a","Type":"ContainerDied","Data":"3f29558f089c244a475a24a7d01e24f8512849f0bc786d359f3f4c9200518eed"}
Jun 11 09:53:56.730734 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:53:56.730696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" event={"ID":"70a9dd1a-ee4c-495d-96d1-01bcf018c88a","Type":"ContainerStarted","Data":"efe7e454af927b81775eac63a4fa56a954f8200bea1b358a9ea23e2ce59cbe76"}
Jun 11 09:54:02.759143 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:02.759110    2561 generic.go:356] "Generic (PLEG): container finished" podID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerID="efe7e454af927b81775eac63a4fa56a954f8200bea1b358a9ea23e2ce59cbe76" exitCode=0
Jun 11 09:54:02.759483 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:02.759170    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" event={"ID":"70a9dd1a-ee4c-495d-96d1-01bcf018c88a","Type":"ContainerDied","Data":"efe7e454af927b81775eac63a4fa56a954f8200bea1b358a9ea23e2ce59cbe76"}
Jun 11 09:54:03.766736 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:03.766698    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" event={"ID":"70a9dd1a-ee4c-495d-96d1-01bcf018c88a","Type":"ContainerStarted","Data":"00538dfcebeb431aafecf408e6ba0e8f51a464b907fd524176a1c8b2fb0f4458"}
Jun 11 09:54:03.767080 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:03.766770    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" event={"ID":"70a9dd1a-ee4c-495d-96d1-01bcf018c88a","Type":"ContainerStarted","Data":"59be7e874c286ef348d378d635496703e12421b2ddde8c48f22f179e9cd4cea5"}
Jun 11 09:54:03.795944 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:03.795882    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" podStartSLOduration=11.795862297 podStartE2EDuration="11.795862297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:53:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:54:03.793802372 +0000 UTC m=+1170.914519040" watchObservedRunningTime="2026-06-11 09:54:03.795862297 +0000 UTC m=+1170.916578940"
Jun 11 09:54:03.882226 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:03.882196    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:54:03.882369 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:03.882251    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:54:05.882021 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:05.881987    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:54:05.882488 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:05.882054    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:54:05.883637 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:05.883591    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused"
Jun 11 09:54:05.883762 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:05.883658    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
Jun 11 09:54:08.882577 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:08.882527    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused"
Jun 11 09:54:08.887965 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:08.887931    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:54:08.890880 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:08.890855    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:54:11.882110 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:11.882053    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused"
Jun 11 09:54:14.882825 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:14.882795    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:54:14.883512 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:14.883495    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:54:18.846885 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.846834    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"]
Jun 11 09:54:18.853347 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.853322    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:18.855950 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.855922    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Jun 11 09:54:18.855950 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.855931    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jun 11 09:54:18.856327 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.856307    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-x8f8p\""
Jun 11 09:54:18.856424 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.856406    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Jun 11 09:54:18.863849 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.863826    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"]
Jun 11 09:54:18.896245 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.896213    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-online-tls\") pod \"feast-driver-ranking-74b5f7d886-nvx6b\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") " pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:18.896395 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.896328    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njdkz\" (UniqueName: \"kubernetes.io/projected/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-kube-api-access-njdkz\") pod \"feast-driver-ranking-74b5f7d886-nvx6b\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") " pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:18.896395 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.896357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-registry-tls\") pod \"feast-driver-ranking-74b5f7d886-nvx6b\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") " pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:18.896395 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.896373    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-feast-data\") pod \"feast-driver-ranking-74b5f7d886-nvx6b\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") " pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:18.996980 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.996939    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njdkz\" (UniqueName: \"kubernetes.io/projected/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-kube-api-access-njdkz\") pod \"feast-driver-ranking-74b5f7d886-nvx6b\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") " pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:18.996980 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.996983    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-registry-tls\") pod \"feast-driver-ranking-74b5f7d886-nvx6b\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") " pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:18.997239 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.997002    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-feast-data\") pod \"feast-driver-ranking-74b5f7d886-nvx6b\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") " pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:18.997239 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.997041    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-online-tls\") pod \"feast-driver-ranking-74b5f7d886-nvx6b\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") " pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:18.997239 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:54:18.997142    2561 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-online-tls: secret "feast-driver-ranking-online-tls" not found
Jun 11 09:54:18.997239 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:54:18.997193    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-online-tls podName:3841a10b-3cf4-4447-8d7c-c08b32d8ef88 nodeName:}" failed. No retries permitted until 2026-06-11 09:54:19.497174706 +0000 UTC m=+1186.617891330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-online-tls") pod "feast-driver-ranking-74b5f7d886-nvx6b" (UID: "3841a10b-3cf4-4447-8d7c-c08b32d8ef88") : secret "feast-driver-ranking-online-tls" not found
Jun 11 09:54:18.997625 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.997432    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-feast-data\") pod \"feast-driver-ranking-74b5f7d886-nvx6b\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") " pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:18.999506 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:18.999485    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-registry-tls\") pod \"feast-driver-ranking-74b5f7d886-nvx6b\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") " pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:19.014023 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:19.013998    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njdkz\" (UniqueName: \"kubernetes.io/projected/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-kube-api-access-njdkz\") pod \"feast-driver-ranking-74b5f7d886-nvx6b\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") " pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:19.501171 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:19.501131    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-online-tls\") pod \"feast-driver-ranking-74b5f7d886-nvx6b\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") " pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:19.503510 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:19.503482    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-online-tls\") pod \"feast-driver-ranking-74b5f7d886-nvx6b\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") " pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:19.764088 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:19.763987    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:19.917082 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:19.917059    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"]
Jun 11 09:54:19.919034 ip-10-0-138-252 kubenswrapper[2561]: W0611 09:54:19.919008    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3841a10b_3cf4_4447_8d7c_c08b32d8ef88.slice/crio-41e270e2b6eb8f81350c42af272d1bf4b143d3e6cb0e966e20b98c9296f7d4b4 WatchSource:0}: Error finding container 41e270e2b6eb8f81350c42af272d1bf4b143d3e6cb0e966e20b98c9296f7d4b4: Status 404 returned error can't find the container with id 41e270e2b6eb8f81350c42af272d1bf4b143d3e6cb0e966e20b98c9296f7d4b4
Jun 11 09:54:20.847196 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:20.847163    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" event={"ID":"3841a10b-3cf4-4447-8d7c-c08b32d8ef88","Type":"ContainerStarted","Data":"b2cf9095bb12ff3dedb4f25ef8b0d0ab55b1ff005043749245f1d52b31f7af70"}
Jun 11 09:54:20.847367 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:20.847218    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" event={"ID":"3841a10b-3cf4-4447-8d7c-c08b32d8ef88","Type":"ContainerStarted","Data":"41e270e2b6eb8f81350c42af272d1bf4b143d3e6cb0e966e20b98c9296f7d4b4"}
Jun 11 09:54:24.864489 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:24.864449    2561 generic.go:356] "Generic (PLEG): container finished" podID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerID="b2cf9095bb12ff3dedb4f25ef8b0d0ab55b1ff005043749245f1d52b31f7af70" exitCode=0
Jun 11 09:54:24.864932 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:24.864528    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" event={"ID":"3841a10b-3cf4-4447-8d7c-c08b32d8ef88","Type":"ContainerDied","Data":"b2cf9095bb12ff3dedb4f25ef8b0d0ab55b1ff005043749245f1d52b31f7af70"}
Jun 11 09:54:25.871382 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:25.871346    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" event={"ID":"3841a10b-3cf4-4447-8d7c-c08b32d8ef88","Type":"ContainerStarted","Data":"4a97c2dc9a87063f083bcb17559c010d487cf3d97f15047584baa6ff98f77e0c"}
Jun 11 09:54:31.897347 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:31.897313    2561 generic.go:356] "Generic (PLEG): container finished" podID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerID="4a97c2dc9a87063f083bcb17559c010d487cf3d97f15047584baa6ff98f77e0c" exitCode=0
Jun 11 09:54:31.897735 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:31.897385    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" event={"ID":"3841a10b-3cf4-4447-8d7c-c08b32d8ef88","Type":"ContainerDied","Data":"4a97c2dc9a87063f083bcb17559c010d487cf3d97f15047584baa6ff98f77e0c"}
Jun 11 09:54:32.904388 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:32.904348    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" event={"ID":"3841a10b-3cf4-4447-8d7c-c08b32d8ef88","Type":"ContainerStarted","Data":"c81463a0e1ebc0e43be104f8ee00ca087cb6539fac036d6fcf3d78ccfc16b998"}
Jun 11 09:54:32.904777 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:32.904419    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" event={"ID":"3841a10b-3cf4-4447-8d7c-c08b32d8ef88","Type":"ContainerStarted","Data":"4522703d3a1d5044f4ce3347abbfd17af208ec926d24116d1fae40c0904f2d9d"}
Jun 11 09:54:32.930279 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:32.930231    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" podStartSLOduration=14.930216668 podStartE2EDuration="14.930216668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:54:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:54:32.928685017 +0000 UTC m=+1200.049401663" watchObservedRunningTime="2026-06-11 09:54:32.930216668 +0000 UTC m=+1200.050933362"
Jun 11 09:54:33.416795 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:33.416769    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 09:54:33.419590 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:33.419568    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 09:54:34.764502 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:34.764460    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:34.764876 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:34.764540    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:34.766135 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:34.766100    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
Jun 11 09:54:34.766260 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:34.766142    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
Jun 11 09:54:37.764369 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:37.764320    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
Jun 11 09:54:37.962487 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:37.962450    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:37.962944 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:37.962918    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:37.965536 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:37.965504    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:39.764924 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:39.764882    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:40.764965 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:40.764923    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
Jun 11 09:54:43.765342 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:43.765315    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:54:43.766099 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:54:43.766080    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:55:58.015431 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:58.015400    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"]
Jun 11 09:55:58.016009 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:58.015616    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="registry" containerID="cri-o://59be7e874c286ef348d378d635496703e12421b2ddde8c48f22f179e9cd4cea5" gracePeriod=30
Jun 11 09:55:58.016009 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:58.015723    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="online" containerID="cri-o://00538dfcebeb431aafecf408e6ba0e8f51a464b907fd524176a1c8b2fb0f4458" gracePeriod=30
Jun 11 09:55:58.025850 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:58.025825    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"]
Jun 11 09:55:58.026023 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:58.026006    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="registry" containerID="cri-o://4522703d3a1d5044f4ce3347abbfd17af208ec926d24116d1fae40c0904f2d9d" gracePeriod=30
Jun 11 09:55:58.026088 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:58.026046    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="online" containerID="cri-o://c81463a0e1ebc0e43be104f8ee00ca087cb6539fac036d6fcf3d78ccfc16b998" gracePeriod=30
Jun 11 09:55:58.889026 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:58.888985    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
Jun 11 09:55:59.264805 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.264772    2561 generic.go:356] "Generic (PLEG): container finished" podID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerID="c81463a0e1ebc0e43be104f8ee00ca087cb6539fac036d6fcf3d78ccfc16b998" exitCode=0
Jun 11 09:55:59.265220 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.264811    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" event={"ID":"3841a10b-3cf4-4447-8d7c-c08b32d8ef88","Type":"ContainerDied","Data":"c81463a0e1ebc0e43be104f8ee00ca087cb6539fac036d6fcf3d78ccfc16b998"}
Jun 11 09:55:59.267172 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.267150    2561 generic.go:356] "Generic (PLEG): container finished" podID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerID="00538dfcebeb431aafecf408e6ba0e8f51a464b907fd524176a1c8b2fb0f4458" exitCode=0
Jun 11 09:55:59.267289 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.267208    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" event={"ID":"70a9dd1a-ee4c-495d-96d1-01bcf018c88a","Type":"ContainerDied","Data":"00538dfcebeb431aafecf408e6ba0e8f51a464b907fd524176a1c8b2fb0f4458"}
Jun 11 09:55:59.396739 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.396714    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-mtwkd"]
Jun 11 09:55:59.396918 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.396861    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-mtwkd" podUID="4909d917-16b1-4c9c-894b-50589df40f07" containerName="postgres" containerID="cri-o://0bf991f88a6e7cb8cae9d92c56c4f7c347cc1e0604eb90880407824c2806e7c2" gracePeriod=30
Jun 11 09:55:59.415315 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.415288    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-rglbg"]
Jun 11 09:55:59.415464 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.415445    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-rglbg" podUID="46a70f9f-41dc-441f-ac36-cf043271ab13" containerName="redis" containerID="cri-o://cc454ab1febb9ea2880a6875bcc9373339efbc634101c2f82bda19ef0f90e800" gracePeriod=30
Jun 11 09:55:59.652924 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.652898    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-mtwkd"
Jun 11 09:55:59.659392 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.659373    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-rglbg"
Jun 11 09:55:59.729030 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.729007    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/4909d917-16b1-4c9c-894b-50589df40f07-postgresdata\") pod \"4909d917-16b1-4c9c-894b-50589df40f07\" (UID: \"4909d917-16b1-4c9c-894b-50589df40f07\") "
Jun 11 09:55:59.729173 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.729059    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc4tc\" (UniqueName: \"kubernetes.io/projected/46a70f9f-41dc-441f-ac36-cf043271ab13-kube-api-access-zc4tc\") pod \"46a70f9f-41dc-441f-ac36-cf043271ab13\" (UID: \"46a70f9f-41dc-441f-ac36-cf043271ab13\") "
Jun 11 09:55:59.729173 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.729084    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22ptf\" (UniqueName: \"kubernetes.io/projected/4909d917-16b1-4c9c-894b-50589df40f07-kube-api-access-22ptf\") pod \"4909d917-16b1-4c9c-894b-50589df40f07\" (UID: \"4909d917-16b1-4c9c-894b-50589df40f07\") "
Jun 11 09:55:59.731460 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.731426    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4909d917-16b1-4c9c-894b-50589df40f07-kube-api-access-22ptf" (OuterVolumeSpecName: "kube-api-access-22ptf") pod "4909d917-16b1-4c9c-894b-50589df40f07" (UID: "4909d917-16b1-4c9c-894b-50589df40f07"). InnerVolumeSpecName "kube-api-access-22ptf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 09:55:59.731573 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.731474    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46a70f9f-41dc-441f-ac36-cf043271ab13-kube-api-access-zc4tc" (OuterVolumeSpecName: "kube-api-access-zc4tc") pod "46a70f9f-41dc-441f-ac36-cf043271ab13" (UID: "46a70f9f-41dc-441f-ac36-cf043271ab13"). InnerVolumeSpecName "kube-api-access-zc4tc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 09:55:59.761291 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.761261    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4909d917-16b1-4c9c-894b-50589df40f07-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "4909d917-16b1-4c9c-894b-50589df40f07" (UID: "4909d917-16b1-4c9c-894b-50589df40f07"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 09:55:59.829894 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.829830    2561 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/4909d917-16b1-4c9c-894b-50589df40f07-postgresdata\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:55:59.829894 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.829853    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc4tc\" (UniqueName: \"kubernetes.io/projected/46a70f9f-41dc-441f-ac36-cf043271ab13-kube-api-access-zc4tc\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:55:59.829894 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:55:59.829863    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22ptf\" (UniqueName: \"kubernetes.io/projected/4909d917-16b1-4c9c-894b-50589df40f07-kube-api-access-22ptf\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:56:00.277667 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.277632    2561 generic.go:356] "Generic (PLEG): container finished" podID="4909d917-16b1-4c9c-894b-50589df40f07" containerID="0bf991f88a6e7cb8cae9d92c56c4f7c347cc1e0604eb90880407824c2806e7c2" exitCode=0
Jun 11 09:56:00.278125 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.277691    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-mtwkd"
Jun 11 09:56:00.278125 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.277721    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-mtwkd" event={"ID":"4909d917-16b1-4c9c-894b-50589df40f07","Type":"ContainerDied","Data":"0bf991f88a6e7cb8cae9d92c56c4f7c347cc1e0604eb90880407824c2806e7c2"}
Jun 11 09:56:00.278125 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.277772    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-mtwkd" event={"ID":"4909d917-16b1-4c9c-894b-50589df40f07","Type":"ContainerDied","Data":"33355d0effda2148d4b5271ed58898e7b3907a16f929849f81dfef8bbe4c3f82"}
Jun 11 09:56:00.278125 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.277799    2561 scope.go:117] "RemoveContainer" containerID="0bf991f88a6e7cb8cae9d92c56c4f7c347cc1e0604eb90880407824c2806e7c2"
Jun 11 09:56:00.279018 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.279000    2561 generic.go:356] "Generic (PLEG): container finished" podID="46a70f9f-41dc-441f-ac36-cf043271ab13" containerID="cc454ab1febb9ea2880a6875bcc9373339efbc634101c2f82bda19ef0f90e800" exitCode=0
Jun 11 09:56:00.279081 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.279031    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-rglbg" event={"ID":"46a70f9f-41dc-441f-ac36-cf043271ab13","Type":"ContainerDied","Data":"cc454ab1febb9ea2880a6875bcc9373339efbc634101c2f82bda19ef0f90e800"}
Jun 11 09:56:00.279081 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.279058    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-rglbg"
Jun 11 09:56:00.279081 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.279070    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-rglbg" event={"ID":"46a70f9f-41dc-441f-ac36-cf043271ab13","Type":"ContainerDied","Data":"6f9d176f9488601f9f9ed995f0d064886f19c6734295f02efc3af3c3eddb28b8"}
Jun 11 09:56:00.287055 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.287034    2561 scope.go:117] "RemoveContainer" containerID="0bf991f88a6e7cb8cae9d92c56c4f7c347cc1e0604eb90880407824c2806e7c2"
Jun 11 09:56:00.287295 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:56:00.287279    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bf991f88a6e7cb8cae9d92c56c4f7c347cc1e0604eb90880407824c2806e7c2\": container with ID starting with 0bf991f88a6e7cb8cae9d92c56c4f7c347cc1e0604eb90880407824c2806e7c2 not found: ID does not exist" containerID="0bf991f88a6e7cb8cae9d92c56c4f7c347cc1e0604eb90880407824c2806e7c2"
Jun 11 09:56:00.287363 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.287301    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf991f88a6e7cb8cae9d92c56c4f7c347cc1e0604eb90880407824c2806e7c2"} err="failed to get container status \"0bf991f88a6e7cb8cae9d92c56c4f7c347cc1e0604eb90880407824c2806e7c2\": rpc error: code = NotFound desc = could not find container \"0bf991f88a6e7cb8cae9d92c56c4f7c347cc1e0604eb90880407824c2806e7c2\": container with ID starting with 0bf991f88a6e7cb8cae9d92c56c4f7c347cc1e0604eb90880407824c2806e7c2 not found: ID does not exist"
Jun 11 09:56:00.287363 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.287316    2561 scope.go:117] "RemoveContainer" containerID="cc454ab1febb9ea2880a6875bcc9373339efbc634101c2f82bda19ef0f90e800"
Jun 11 09:56:00.294760 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.294677    2561 scope.go:117] "RemoveContainer" containerID="cc454ab1febb9ea2880a6875bcc9373339efbc634101c2f82bda19ef0f90e800"
Jun 11 09:56:00.294954 ip-10-0-138-252 kubenswrapper[2561]: E0611 09:56:00.294938    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc454ab1febb9ea2880a6875bcc9373339efbc634101c2f82bda19ef0f90e800\": container with ID starting with cc454ab1febb9ea2880a6875bcc9373339efbc634101c2f82bda19ef0f90e800 not found: ID does not exist" containerID="cc454ab1febb9ea2880a6875bcc9373339efbc634101c2f82bda19ef0f90e800"
Jun 11 09:56:00.295012 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.294962    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc454ab1febb9ea2880a6875bcc9373339efbc634101c2f82bda19ef0f90e800"} err="failed to get container status \"cc454ab1febb9ea2880a6875bcc9373339efbc634101c2f82bda19ef0f90e800\": rpc error: code = NotFound desc = could not find container \"cc454ab1febb9ea2880a6875bcc9373339efbc634101c2f82bda19ef0f90e800\": container with ID starting with cc454ab1febb9ea2880a6875bcc9373339efbc634101c2f82bda19ef0f90e800 not found: ID does not exist"
Jun 11 09:56:00.312905 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.312884    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-rglbg"]
Jun 11 09:56:00.328904 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.328887    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-rglbg"]
Jun 11 09:56:00.357422 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.357398    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-mtwkd"]
Jun 11 09:56:00.373511 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:00.373486    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-mtwkd"]
Jun 11 09:56:01.378481 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:01.378448    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46a70f9f-41dc-441f-ac36-cf043271ab13" path="/var/lib/kubelet/pods/46a70f9f-41dc-441f-ac36-cf043271ab13/volumes"
Jun 11 09:56:01.378873 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:01.378811    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4909d917-16b1-4c9c-894b-50589df40f07" path="/var/lib/kubelet/pods/4909d917-16b1-4c9c-894b-50589df40f07/volumes"
Jun 11 09:56:07.963934 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:07.963891    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
Jun 11 09:56:08.889156 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:08.889108    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
Jun 11 09:56:17.963143 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:17.963105    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
Jun 11 09:56:18.888669 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:18.888625    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
Jun 11 09:56:18.888875 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:18.888738    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:56:27.963321 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:27.963270    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
Jun 11 09:56:27.963752 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:27.963417    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:56:28.390318 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.390289    2561 generic.go:356] "Generic (PLEG): container finished" podID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerID="4522703d3a1d5044f4ce3347abbfd17af208ec926d24116d1fae40c0904f2d9d" exitCode=137
Jun 11 09:56:28.390489 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.390364    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" event={"ID":"3841a10b-3cf4-4447-8d7c-c08b32d8ef88","Type":"ContainerDied","Data":"4522703d3a1d5044f4ce3347abbfd17af208ec926d24116d1fae40c0904f2d9d"}
Jun 11 09:56:28.392461 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.392442    2561 generic.go:356] "Generic (PLEG): container finished" podID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerID="59be7e874c286ef348d378d635496703e12421b2ddde8c48f22f179e9cd4cea5" exitCode=137
Jun 11 09:56:28.392568 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.392499    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" event={"ID":"70a9dd1a-ee4c-495d-96d1-01bcf018c88a","Type":"ContainerDied","Data":"59be7e874c286ef348d378d635496703e12421b2ddde8c48f22f179e9cd4cea5"}
Jun 11 09:56:28.679630 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.679590    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:56:28.682358 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.682340    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:56:28.756696 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.756669    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-online-tls\") pod \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") "
Jun 11 09:56:28.756696 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.756698    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-registry-tls\") pod \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") "
Jun 11 09:56:28.756925 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.756729    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-online-tls\") pod \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") "
Jun 11 09:56:28.756925 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.756763    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ds8j\" (UniqueName: \"kubernetes.io/projected/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-kube-api-access-5ds8j\") pod \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") "
Jun 11 09:56:28.756925 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.756779    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njdkz\" (UniqueName: \"kubernetes.io/projected/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-kube-api-access-njdkz\") pod \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") "
Jun 11 09:56:28.756925 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.756844    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-feast-data\") pod \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\" (UID: \"3841a10b-3cf4-4447-8d7c-c08b32d8ef88\") "
Jun 11 09:56:28.756925 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.756881    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-feast-data\") pod \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") "
Jun 11 09:56:28.756925 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.756908    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-registry-tls\") pod \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\" (UID: \"70a9dd1a-ee4c-495d-96d1-01bcf018c88a\") "
Jun 11 09:56:28.757572 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.757497    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-feast-data" (OuterVolumeSpecName: "feast-data") pod "3841a10b-3cf4-4447-8d7c-c08b32d8ef88" (UID: "3841a10b-3cf4-4447-8d7c-c08b32d8ef88"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 09:56:28.759065 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.759039    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-kube-api-access-5ds8j" (OuterVolumeSpecName: "kube-api-access-5ds8j") pod "70a9dd1a-ee4c-495d-96d1-01bcf018c88a" (UID: "70a9dd1a-ee4c-495d-96d1-01bcf018c88a"). InnerVolumeSpecName "kube-api-access-5ds8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 09:56:28.759320 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.759288    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-online-tls" (OuterVolumeSpecName: "online-tls") pod "3841a10b-3cf4-4447-8d7c-c08b32d8ef88" (UID: "3841a10b-3cf4-4447-8d7c-c08b32d8ef88"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:56:28.759320 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.759299    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3841a10b-3cf4-4447-8d7c-c08b32d8ef88" (UID: "3841a10b-3cf4-4447-8d7c-c08b32d8ef88"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:56:28.759486 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.759351    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-online-tls" (OuterVolumeSpecName: "online-tls") pod "70a9dd1a-ee4c-495d-96d1-01bcf018c88a" (UID: "70a9dd1a-ee4c-495d-96d1-01bcf018c88a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:56:28.759486 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.759372    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "70a9dd1a-ee4c-495d-96d1-01bcf018c88a" (UID: "70a9dd1a-ee4c-495d-96d1-01bcf018c88a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 09:56:28.759486 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.759372    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-kube-api-access-njdkz" (OuterVolumeSpecName: "kube-api-access-njdkz") pod "3841a10b-3cf4-4447-8d7c-c08b32d8ef88" (UID: "3841a10b-3cf4-4447-8d7c-c08b32d8ef88"). InnerVolumeSpecName "kube-api-access-njdkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 09:56:28.766710 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.766685    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-feast-data" (OuterVolumeSpecName: "feast-data") pod "70a9dd1a-ee4c-495d-96d1-01bcf018c88a" (UID: "70a9dd1a-ee4c-495d-96d1-01bcf018c88a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 09:56:28.857744 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.857707    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-online-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:56:28.857744 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.857739    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-registry-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:56:28.857744 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.857748    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-online-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:56:28.857744 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.857756    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ds8j\" (UniqueName: \"kubernetes.io/projected/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-kube-api-access-5ds8j\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:56:28.857986 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.857767    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njdkz\" (UniqueName: \"kubernetes.io/projected/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-kube-api-access-njdkz\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:56:28.857986 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.857775    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3841a10b-3cf4-4447-8d7c-c08b32d8ef88-feast-data\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:56:28.857986 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.857783    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-feast-data\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:56:28.857986 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:28.857790    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/70a9dd1a-ee4c-495d-96d1-01bcf018c88a-registry-tls\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 09:56:29.398899 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:29.398874    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"
Jun 11 09:56:29.399310 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:29.398901    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b" event={"ID":"3841a10b-3cf4-4447-8d7c-c08b32d8ef88","Type":"ContainerDied","Data":"41e270e2b6eb8f81350c42af272d1bf4b143d3e6cb0e966e20b98c9296f7d4b4"}
Jun 11 09:56:29.399310 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:29.398968    2561 scope.go:117] "RemoveContainer" containerID="c81463a0e1ebc0e43be104f8ee00ca087cb6539fac036d6fcf3d78ccfc16b998"
Jun 11 09:56:29.401337 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:29.401313    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6" event={"ID":"70a9dd1a-ee4c-495d-96d1-01bcf018c88a","Type":"ContainerDied","Data":"7fca3ca4161625775383a65f64f6b1d80765b5063805c257cfca444b16c51f98"}
Jun 11 09:56:29.401436 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:29.401397    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"
Jun 11 09:56:29.407495 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:29.407477    2561 scope.go:117] "RemoveContainer" containerID="4522703d3a1d5044f4ce3347abbfd17af208ec926d24116d1fae40c0904f2d9d"
Jun 11 09:56:29.415349 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:29.415331    2561 scope.go:117] "RemoveContainer" containerID="4a97c2dc9a87063f083bcb17559c010d487cf3d97f15047584baa6ff98f77e0c"
Jun 11 09:56:29.422334 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:29.422315    2561 scope.go:117] "RemoveContainer" containerID="b2cf9095bb12ff3dedb4f25ef8b0d0ab55b1ff005043749245f1d52b31f7af70"
Jun 11 09:56:29.422386 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:29.422324    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"]
Jun 11 09:56:29.428050 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:29.428032    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-fd88bf769-69nm6"]
Jun 11 09:56:29.429767 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:29.429738    2561 scope.go:117] "RemoveContainer" containerID="00538dfcebeb431aafecf408e6ba0e8f51a464b907fd524176a1c8b2fb0f4458"
Jun 11 09:56:29.436677 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:29.436660    2561 scope.go:117] "RemoveContainer" containerID="59be7e874c286ef348d378d635496703e12421b2ddde8c48f22f179e9cd4cea5"
Jun 11 09:56:29.443932 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:29.443916    2561 scope.go:117] "RemoveContainer" containerID="efe7e454af927b81775eac63a4fa56a954f8200bea1b358a9ea23e2ce59cbe76"
Jun 11 09:56:29.444154 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:29.444136    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"]
Jun 11 09:56:29.449416 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:29.449396    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-74b5f7d886-nvx6b"]
Jun 11 09:56:29.450712 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:29.450699    2561 scope.go:117] "RemoveContainer" containerID="3f29558f089c244a475a24a7d01e24f8512849f0bc786d359f3f4c9200518eed"
Jun 11 09:56:31.377868 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:31.377826    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" path="/var/lib/kubelet/pods/3841a10b-3cf4-4447-8d7c-c08b32d8ef88/volumes"
Jun 11 09:56:31.378505 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:56:31.378485    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" path="/var/lib/kubelet/pods/70a9dd1a-ee4c-495d-96d1-01bcf018c88a/volumes"
Jun 11 09:59:33.445100 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:59:33.445073    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 09:59:33.448536 ip-10-0-138-252 kubenswrapper[2561]: I0611 09:59:33.448517    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 10:04:33.467503 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:04:33.467423    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 10:04:33.471527 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:04:33.471507    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 10:06:59.188543 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188508    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-99vvv/must-gather-txmpc"]
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188821    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="registry"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188833    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="registry"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188843    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4909d917-16b1-4c9c-894b-50589df40f07" containerName="postgres"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188849    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4909d917-16b1-4c9c-894b-50589df40f07" containerName="postgres"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188855    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="registry"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188861    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="registry"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188869    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="feast-init"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188874    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="feast-init"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188881    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="online"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188886    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="online"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188895    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="feast-init"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188900    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="feast-init"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188908    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="online"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188913    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="online"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188920    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46a70f9f-41dc-441f-ac36-cf043271ab13" containerName="redis"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188925    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="46a70f9f-41dc-441f-ac36-cf043271ab13" containerName="redis"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188932    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="feast-apply"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188937    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="feast-apply"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188943    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="feast-apply"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188948    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="feast-apply"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.188994    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="46a70f9f-41dc-441f-ac36-cf043271ab13" containerName="redis"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.189001    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="online"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.189007    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="registry"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.189012    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3841a10b-3cf4-4447-8d7c-c08b32d8ef88" containerName="registry"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.189018    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="70a9dd1a-ee4c-495d-96d1-01bcf018c88a" containerName="online"
Jun 11 10:06:59.189093 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.189023    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4909d917-16b1-4c9c-894b-50589df40f07" containerName="postgres"
Jun 11 10:06:59.191026 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.191010    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-99vvv/must-gather-txmpc"
Jun 11 10:06:59.195210 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.195192    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-99vvv\"/\"default-dockercfg-l8nn2\""
Jun 11 10:06:59.195553 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.195540    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-99vvv\"/\"openshift-service-ca.crt\""
Jun 11 10:06:59.196071 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.196055    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-99vvv\"/\"kube-root-ca.crt\""
Jun 11 10:06:59.218961 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.218938    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-99vvv/must-gather-txmpc"]
Jun 11 10:06:59.224705 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.224683    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/584322db-9fb0-4762-902f-753420dc7357-must-gather-output\") pod \"must-gather-txmpc\" (UID: \"584322db-9fb0-4762-902f-753420dc7357\") " pod="openshift-must-gather-99vvv/must-gather-txmpc"
Jun 11 10:06:59.224808 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.224726    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q45vb\" (UniqueName: \"kubernetes.io/projected/584322db-9fb0-4762-902f-753420dc7357-kube-api-access-q45vb\") pod \"must-gather-txmpc\" (UID: \"584322db-9fb0-4762-902f-753420dc7357\") " pod="openshift-must-gather-99vvv/must-gather-txmpc"
Jun 11 10:06:59.325264 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.325232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q45vb\" (UniqueName: \"kubernetes.io/projected/584322db-9fb0-4762-902f-753420dc7357-kube-api-access-q45vb\") pod \"must-gather-txmpc\" (UID: \"584322db-9fb0-4762-902f-753420dc7357\") " pod="openshift-must-gather-99vvv/must-gather-txmpc"
Jun 11 10:06:59.325414 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.325286    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/584322db-9fb0-4762-902f-753420dc7357-must-gather-output\") pod \"must-gather-txmpc\" (UID: \"584322db-9fb0-4762-902f-753420dc7357\") " pod="openshift-must-gather-99vvv/must-gather-txmpc"
Jun 11 10:06:59.325569 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.325551    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/584322db-9fb0-4762-902f-753420dc7357-must-gather-output\") pod \"must-gather-txmpc\" (UID: \"584322db-9fb0-4762-902f-753420dc7357\") " pod="openshift-must-gather-99vvv/must-gather-txmpc"
Jun 11 10:06:59.333934 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.333908    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q45vb\" (UniqueName: \"kubernetes.io/projected/584322db-9fb0-4762-902f-753420dc7357-kube-api-access-q45vb\") pod \"must-gather-txmpc\" (UID: \"584322db-9fb0-4762-902f-753420dc7357\") " pod="openshift-must-gather-99vvv/must-gather-txmpc"
Jun 11 10:06:59.499512 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.499486    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-99vvv/must-gather-txmpc"
Jun 11 10:06:59.625389 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.625357    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-99vvv/must-gather-txmpc"]
Jun 11 10:06:59.628376 ip-10-0-138-252 kubenswrapper[2561]: W0611 10:06:59.628352    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod584322db_9fb0_4762_902f_753420dc7357.slice/crio-9492379334dc75dde133dc076431fcdc19e7189447640bd1c057af049eee3c07 WatchSource:0}: Error finding container 9492379334dc75dde133dc076431fcdc19e7189447640bd1c057af049eee3c07: Status 404 returned error can't find the container with id 9492379334dc75dde133dc076431fcdc19e7189447640bd1c057af049eee3c07
Jun 11 10:06:59.630624 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.630609    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 11 10:06:59.671632 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:06:59.671583    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-99vvv/must-gather-txmpc" event={"ID":"584322db-9fb0-4762-902f-753420dc7357","Type":"ContainerStarted","Data":"9492379334dc75dde133dc076431fcdc19e7189447640bd1c057af049eee3c07"}
Jun 11 10:07:05.700789 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:05.700755    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-99vvv/must-gather-txmpc" event={"ID":"584322db-9fb0-4762-902f-753420dc7357","Type":"ContainerStarted","Data":"2656170270cb9c479d90626fd0fbb6fc1574fcc98787628f33c48c8e8b67878c"}
Jun 11 10:07:06.709041 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:06.709000    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-99vvv/must-gather-txmpc" event={"ID":"584322db-9fb0-4762-902f-753420dc7357","Type":"ContainerStarted","Data":"47d85ef1e2f69df518b8326ec6a074887f7f112f30b9a0ca3ceb0fbbd8bf2192"}
Jun 11 10:07:06.728369 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:06.728314    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-99vvv/must-gather-txmpc" podStartSLOduration=1.801610362 podStartE2EDuration="7.728295582s" totalImagesPullingTime="5.92668522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:07:06.727643048 +0000 UTC m=+1953.848359693" watchObservedRunningTime="2026-06-11 10:07:06.728295582 +0000 UTC m=+1953.849012228"
Jun 11 10:07:15.744106 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:15.744071    2561 generic.go:356] "Generic (PLEG): container finished" podID="584322db-9fb0-4762-902f-753420dc7357" containerID="2656170270cb9c479d90626fd0fbb6fc1574fcc98787628f33c48c8e8b67878c" exitCode=0
Jun 11 10:07:15.744499 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:15.744131    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-99vvv/must-gather-txmpc" event={"ID":"584322db-9fb0-4762-902f-753420dc7357","Type":"ContainerDied","Data":"2656170270cb9c479d90626fd0fbb6fc1574fcc98787628f33c48c8e8b67878c"}
Jun 11 10:07:15.744499 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:15.744391    2561 scope.go:117] "RemoveContainer" containerID="2656170270cb9c479d90626fd0fbb6fc1574fcc98787628f33c48c8e8b67878c"
Jun 11 10:07:16.082355 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:16.082263    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-99vvv_must-gather-txmpc_584322db-9fb0-4762-902f-753420dc7357/gather/0.log"
Jun 11 10:07:19.582896 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:19.582872    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tgj2b_10ed3813-aabe-4f27-b95e-cdb9121ae64c/global-pull-secret-syncer/0.log"
Jun 11 10:07:19.711999 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:19.711971    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-llbqf_ebe653ef-f4b8-4c0c-8a90-4ce77aecf4f6/konnectivity-agent/0.log"
Jun 11 10:07:19.802372 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:19.802343    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-252.ec2.internal_ac22370277cd46b7ea9e7dd75889a79e/haproxy/0.log"
Jun 11 10:07:21.424742 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.424711    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-99vvv/must-gather-txmpc"]
Jun 11 10:07:21.425153 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.424885    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-99vvv/must-gather-txmpc" podUID="584322db-9fb0-4762-902f-753420dc7357" containerName="copy" containerID="cri-o://47d85ef1e2f69df518b8326ec6a074887f7f112f30b9a0ca3ceb0fbbd8bf2192" gracePeriod=2
Jun 11 10:07:21.432702 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.432679    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-99vvv/must-gather-txmpc"]
Jun 11 10:07:21.434151 ip-10-0-138-252 kubenswrapper[2561]: E0611 10:07:21.434116    2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"584322db-9fb0-4762-902f-753420dc7357\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-99vvv\"/\"must-gather-txmpc\": pods \"must-gather-txmpc\" not found" pod="openshift-must-gather-99vvv/must-gather-txmpc"
Jun 11 10:07:21.657293 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.657271    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-99vvv_must-gather-txmpc_584322db-9fb0-4762-902f-753420dc7357/copy/0.log"
Jun 11 10:07:21.658909 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.658890    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-99vvv/must-gather-txmpc"
Jun 11 10:07:21.661301 ip-10-0-138-252 kubenswrapper[2561]: E0611 10:07:21.661276    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-txmpc\" is forbidden: User \"system:node:ip-10-0-138-252.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-99vvv\": no relationship found between node 'ip-10-0-138-252.ec2.internal' and this object" podUID="584322db-9fb0-4762-902f-753420dc7357" pod="openshift-must-gather-99vvv/must-gather-txmpc"
Jun 11 10:07:21.701739 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.701682    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/584322db-9fb0-4762-902f-753420dc7357-must-gather-output\") pod \"584322db-9fb0-4762-902f-753420dc7357\" (UID: \"584322db-9fb0-4762-902f-753420dc7357\") "
Jun 11 10:07:21.701835 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.701747    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q45vb\" (UniqueName: \"kubernetes.io/projected/584322db-9fb0-4762-902f-753420dc7357-kube-api-access-q45vb\") pod \"584322db-9fb0-4762-902f-753420dc7357\" (UID: \"584322db-9fb0-4762-902f-753420dc7357\") "
Jun 11 10:07:21.702067 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.702048    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/584322db-9fb0-4762-902f-753420dc7357-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "584322db-9fb0-4762-902f-753420dc7357" (UID: "584322db-9fb0-4762-902f-753420dc7357"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 10:07:21.703797 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.703779    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/584322db-9fb0-4762-902f-753420dc7357-kube-api-access-q45vb" (OuterVolumeSpecName: "kube-api-access-q45vb") pod "584322db-9fb0-4762-902f-753420dc7357" (UID: "584322db-9fb0-4762-902f-753420dc7357"). InnerVolumeSpecName "kube-api-access-q45vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 10:07:21.769291 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.769271    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-99vvv_must-gather-txmpc_584322db-9fb0-4762-902f-753420dc7357/copy/0.log"
Jun 11 10:07:21.769637 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.769592    2561 generic.go:356] "Generic (PLEG): container finished" podID="584322db-9fb0-4762-902f-753420dc7357" containerID="47d85ef1e2f69df518b8326ec6a074887f7f112f30b9a0ca3ceb0fbbd8bf2192" exitCode=143
Jun 11 10:07:21.769721 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.769657    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-99vvv/must-gather-txmpc"
Jun 11 10:07:21.769721 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.769712    2561 scope.go:117] "RemoveContainer" containerID="47d85ef1e2f69df518b8326ec6a074887f7f112f30b9a0ca3ceb0fbbd8bf2192"
Jun 11 10:07:21.772021 ip-10-0-138-252 kubenswrapper[2561]: E0611 10:07:21.771990    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-txmpc\" is forbidden: User \"system:node:ip-10-0-138-252.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-99vvv\": no relationship found between node 'ip-10-0-138-252.ec2.internal' and this object" podUID="584322db-9fb0-4762-902f-753420dc7357" pod="openshift-must-gather-99vvv/must-gather-txmpc"
Jun 11 10:07:21.777665 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.777646    2561 scope.go:117] "RemoveContainer" containerID="2656170270cb9c479d90626fd0fbb6fc1574fcc98787628f33c48c8e8b67878c"
Jun 11 10:07:21.780083 ip-10-0-138-252 kubenswrapper[2561]: E0611 10:07:21.780061    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-txmpc\" is forbidden: User \"system:node:ip-10-0-138-252.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-99vvv\": no relationship found between node 'ip-10-0-138-252.ec2.internal' and this object" podUID="584322db-9fb0-4762-902f-753420dc7357" pod="openshift-must-gather-99vvv/must-gather-txmpc"
Jun 11 10:07:21.788371 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.788354    2561 scope.go:117] "RemoveContainer" containerID="47d85ef1e2f69df518b8326ec6a074887f7f112f30b9a0ca3ceb0fbbd8bf2192"
Jun 11 10:07:21.788634 ip-10-0-138-252 kubenswrapper[2561]: E0611 10:07:21.788616    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47d85ef1e2f69df518b8326ec6a074887f7f112f30b9a0ca3ceb0fbbd8bf2192\": container with ID starting with 47d85ef1e2f69df518b8326ec6a074887f7f112f30b9a0ca3ceb0fbbd8bf2192 not found: ID does not exist" containerID="47d85ef1e2f69df518b8326ec6a074887f7f112f30b9a0ca3ceb0fbbd8bf2192"
Jun 11 10:07:21.788688 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.788643    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d85ef1e2f69df518b8326ec6a074887f7f112f30b9a0ca3ceb0fbbd8bf2192"} err="failed to get container status \"47d85ef1e2f69df518b8326ec6a074887f7f112f30b9a0ca3ceb0fbbd8bf2192\": rpc error: code = NotFound desc = could not find container \"47d85ef1e2f69df518b8326ec6a074887f7f112f30b9a0ca3ceb0fbbd8bf2192\": container with ID starting with 47d85ef1e2f69df518b8326ec6a074887f7f112f30b9a0ca3ceb0fbbd8bf2192 not found: ID does not exist"
Jun 11 10:07:21.788688 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.788660    2561 scope.go:117] "RemoveContainer" containerID="2656170270cb9c479d90626fd0fbb6fc1574fcc98787628f33c48c8e8b67878c"
Jun 11 10:07:21.788878 ip-10-0-138-252 kubenswrapper[2561]: E0611 10:07:21.788862    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2656170270cb9c479d90626fd0fbb6fc1574fcc98787628f33c48c8e8b67878c\": container with ID starting with 2656170270cb9c479d90626fd0fbb6fc1574fcc98787628f33c48c8e8b67878c not found: ID does not exist" containerID="2656170270cb9c479d90626fd0fbb6fc1574fcc98787628f33c48c8e8b67878c"
Jun 11 10:07:21.788919 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.788884    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2656170270cb9c479d90626fd0fbb6fc1574fcc98787628f33c48c8e8b67878c"} err="failed to get container status \"2656170270cb9c479d90626fd0fbb6fc1574fcc98787628f33c48c8e8b67878c\": rpc error: code = NotFound desc = could not find container \"2656170270cb9c479d90626fd0fbb6fc1574fcc98787628f33c48c8e8b67878c\": container with ID starting with 2656170270cb9c479d90626fd0fbb6fc1574fcc98787628f33c48c8e8b67878c not found: ID does not exist"
Jun 11 10:07:21.803252 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.803234    2561 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/584322db-9fb0-4762-902f-753420dc7357-must-gather-output\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 10:07:21.803252 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:21.803251    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q45vb\" (UniqueName: \"kubernetes.io/projected/584322db-9fb0-4762-902f-753420dc7357-kube-api-access-q45vb\") on node \"ip-10-0-138-252.ec2.internal\" DevicePath \"\""
Jun 11 10:07:23.378321 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:23.378290    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="584322db-9fb0-4762-902f-753420dc7357" path="/var/lib/kubelet/pods/584322db-9fb0-4762-902f-753420dc7357/volumes"
Jun 11 10:07:23.379588 ip-10-0-138-252 kubenswrapper[2561]: E0611 10:07:23.379562    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-txmpc\" is forbidden: User \"system:node:ip-10-0-138-252.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-99vvv\": no relationship found between node 'ip-10-0-138-252.ec2.internal' and this object" podUID="584322db-9fb0-4762-902f-753420dc7357" pod="openshift-must-gather-99vvv/must-gather-txmpc"
Jun 11 10:07:23.505367 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:23.505341    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5/alertmanager/0.log"
Jun 11 10:07:23.531172 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:23.531148    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5/config-reloader/0.log"
Jun 11 10:07:23.559810 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:23.559786    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5/kube-rbac-proxy-web/0.log"
Jun 11 10:07:23.591337 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:23.591319    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5/kube-rbac-proxy/0.log"
Jun 11 10:07:23.617826 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:23.617798    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5/kube-rbac-proxy-metric/0.log"
Jun 11 10:07:23.647808 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:23.647735    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5/prom-label-proxy/0.log"
Jun 11 10:07:23.678729 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:23.678706    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38a3e771-78e6-4c5b-8f2b-1512e3a3e5b5/init-config-reloader/0.log"
Jun 11 10:07:23.906307 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:23.906216    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bm2nt_467788e2-8e4d-4a64-9f60-a23e74c31913/node-exporter/0.log"
Jun 11 10:07:23.936326 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:23.936299    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bm2nt_467788e2-8e4d-4a64-9f60-a23e74c31913/kube-rbac-proxy/0.log"
Jun 11 10:07:23.963001 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:23.962975    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bm2nt_467788e2-8e4d-4a64-9f60-a23e74c31913/init-textfile/0.log"
Jun 11 10:07:24.649964 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:24.649942    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7fb6c5b8d9-lzrn8_7d8a779d-68f0-4ea3-87fc-87955ac4458c/telemeter-client/0.log"
Jun 11 10:07:24.676987 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:24.676967    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7fb6c5b8d9-lzrn8_7d8a779d-68f0-4ea3-87fc-87955ac4458c/reload/0.log"
Jun 11 10:07:24.706972 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:24.706950    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7fb6c5b8d9-lzrn8_7d8a779d-68f0-4ea3-87fc-87955ac4458c/kube-rbac-proxy/0.log"
Jun 11 10:07:26.676910 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.676877    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"]
Jun 11 10:07:26.677318 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.677155    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="584322db-9fb0-4762-902f-753420dc7357" containerName="gather"
Jun 11 10:07:26.677318 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.677166    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="584322db-9fb0-4762-902f-753420dc7357" containerName="gather"
Jun 11 10:07:26.677318 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.677175    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="584322db-9fb0-4762-902f-753420dc7357" containerName="copy"
Jun 11 10:07:26.677318 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.677181    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="584322db-9fb0-4762-902f-753420dc7357" containerName="copy"
Jun 11 10:07:26.677318 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.677226    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="584322db-9fb0-4762-902f-753420dc7357" containerName="gather"
Jun 11 10:07:26.677318 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.677234    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="584322db-9fb0-4762-902f-753420dc7357" containerName="copy"
Jun 11 10:07:26.680875 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.680852    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:26.683229 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.683209    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r8hw7\"/\"kube-root-ca.crt\""
Jun 11 10:07:26.684088 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.684073    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r8hw7\"/\"openshift-service-ca.crt\""
Jun 11 10:07:26.684135 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.684114    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r8hw7\"/\"default-dockercfg-s89st\""
Jun 11 10:07:26.689222 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.689198    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"]
Jun 11 10:07:26.743118 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.743083    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86ad4b28-b18e-4d67-b2ca-4b08966ce540-sys\") pod \"perf-node-gather-daemonset-njx8x\" (UID: \"86ad4b28-b18e-4d67-b2ca-4b08966ce540\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:26.743307 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.743130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/86ad4b28-b18e-4d67-b2ca-4b08966ce540-proc\") pod \"perf-node-gather-daemonset-njx8x\" (UID: \"86ad4b28-b18e-4d67-b2ca-4b08966ce540\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:26.743307 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.743223    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/86ad4b28-b18e-4d67-b2ca-4b08966ce540-podres\") pod \"perf-node-gather-daemonset-njx8x\" (UID: \"86ad4b28-b18e-4d67-b2ca-4b08966ce540\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:26.743307 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.743253    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9lnt\" (UniqueName: \"kubernetes.io/projected/86ad4b28-b18e-4d67-b2ca-4b08966ce540-kube-api-access-b9lnt\") pod \"perf-node-gather-daemonset-njx8x\" (UID: \"86ad4b28-b18e-4d67-b2ca-4b08966ce540\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:26.743307 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.743286    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86ad4b28-b18e-4d67-b2ca-4b08966ce540-lib-modules\") pod \"perf-node-gather-daemonset-njx8x\" (UID: \"86ad4b28-b18e-4d67-b2ca-4b08966ce540\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:26.843963 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.843929    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86ad4b28-b18e-4d67-b2ca-4b08966ce540-sys\") pod \"perf-node-gather-daemonset-njx8x\" (UID: \"86ad4b28-b18e-4d67-b2ca-4b08966ce540\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:26.844140 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.843995    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/86ad4b28-b18e-4d67-b2ca-4b08966ce540-proc\") pod \"perf-node-gather-daemonset-njx8x\" (UID: \"86ad4b28-b18e-4d67-b2ca-4b08966ce540\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:26.844140 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.844052    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/86ad4b28-b18e-4d67-b2ca-4b08966ce540-podres\") pod \"perf-node-gather-daemonset-njx8x\" (UID: \"86ad4b28-b18e-4d67-b2ca-4b08966ce540\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:26.844140 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.844074    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9lnt\" (UniqueName: \"kubernetes.io/projected/86ad4b28-b18e-4d67-b2ca-4b08966ce540-kube-api-access-b9lnt\") pod \"perf-node-gather-daemonset-njx8x\" (UID: \"86ad4b28-b18e-4d67-b2ca-4b08966ce540\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:26.844140 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.844076    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86ad4b28-b18e-4d67-b2ca-4b08966ce540-sys\") pod \"perf-node-gather-daemonset-njx8x\" (UID: \"86ad4b28-b18e-4d67-b2ca-4b08966ce540\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:26.844140 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.844100    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86ad4b28-b18e-4d67-b2ca-4b08966ce540-lib-modules\") pod \"perf-node-gather-daemonset-njx8x\" (UID: \"86ad4b28-b18e-4d67-b2ca-4b08966ce540\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:26.844140 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.844076    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/86ad4b28-b18e-4d67-b2ca-4b08966ce540-proc\") pod \"perf-node-gather-daemonset-njx8x\" (UID: \"86ad4b28-b18e-4d67-b2ca-4b08966ce540\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:26.844339 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.844177    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/86ad4b28-b18e-4d67-b2ca-4b08966ce540-podres\") pod \"perf-node-gather-daemonset-njx8x\" (UID: \"86ad4b28-b18e-4d67-b2ca-4b08966ce540\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:26.844339 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.844206    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86ad4b28-b18e-4d67-b2ca-4b08966ce540-lib-modules\") pod \"perf-node-gather-daemonset-njx8x\" (UID: \"86ad4b28-b18e-4d67-b2ca-4b08966ce540\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:26.853971 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.853942    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9lnt\" (UniqueName: \"kubernetes.io/projected/86ad4b28-b18e-4d67-b2ca-4b08966ce540-kube-api-access-b9lnt\") pod \"perf-node-gather-daemonset-njx8x\" (UID: \"86ad4b28-b18e-4d67-b2ca-4b08966ce540\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:26.991102 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:26.991068    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:27.035733 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:27.035698    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-dk9xk_368885f5-24a5-4239-b2a1-82a49f932621/download-server/0.log"
Jun 11 10:07:27.116404 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:27.116379    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"]
Jun 11 10:07:27.119059 ip-10-0-138-252 kubenswrapper[2561]: W0611 10:07:27.119021    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod86ad4b28_b18e_4d67_b2ca_4b08966ce540.slice/crio-f41348a357a531221e6cd1cf5533476976d362409407e60c55e9b520c06d0b33 WatchSource:0}: Error finding container f41348a357a531221e6cd1cf5533476976d362409407e60c55e9b520c06d0b33: Status 404 returned error can't find the container with id f41348a357a531221e6cd1cf5533476976d362409407e60c55e9b520c06d0b33
Jun 11 10:07:27.567292 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:27.567260    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-cnfd7_91684f14-75fa-423b-924b-240fa0b3970d/volume-data-source-validator/0.log"
Jun 11 10:07:27.796489 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:27.796453    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x" event={"ID":"86ad4b28-b18e-4d67-b2ca-4b08966ce540","Type":"ContainerStarted","Data":"d73980b2f6c22449b245eea1ca017d925f59415745b10a594c2978b739df3452"}
Jun 11 10:07:27.796958 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:27.796506    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x" event={"ID":"86ad4b28-b18e-4d67-b2ca-4b08966ce540","Type":"ContainerStarted","Data":"f41348a357a531221e6cd1cf5533476976d362409407e60c55e9b520c06d0b33"}
Jun 11 10:07:27.796958 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:27.796550    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:27.814329 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:27.814286    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x" podStartSLOduration=1.814272587 podStartE2EDuration="1.814272587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 10:07:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:07:27.813755779 +0000 UTC m=+1974.934472437" watchObservedRunningTime="2026-06-11 10:07:27.814272587 +0000 UTC m=+1974.934989232"
Jun 11 10:07:28.512709 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:28.512676    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kwdx4_79ac9c32-23fe-459c-b7b9-af6c4bb5c707/dns/0.log"
Jun 11 10:07:28.538448 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:28.538425    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kwdx4_79ac9c32-23fe-459c-b7b9-af6c4bb5c707/kube-rbac-proxy/0.log"
Jun 11 10:07:28.599284 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:28.599255    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lmpvz_b28fa7f8-061b-482e-bfeb-f0e51364c83e/dns-node-resolver/0.log"
Jun 11 10:07:29.090086 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:29.090045    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-65c7fd86d7-wm2g4_0d9dfda7-5d46-4a9e-9edf-c14d35297db9/registry/0.log"
Jun 11 10:07:29.096025 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:29.096004    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-65c7fd86d7-wm2g4_0d9dfda7-5d46-4a9e-9edf-c14d35297db9/registry/1.log"
Jun 11 10:07:29.154466 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:29.154443    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fmjh8_cadd281c-6a46-4e89-b608-ee346f7729ce/node-ca/0.log"
Jun 11 10:07:30.481852 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:30.481816    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gwvf5_e59603fc-27ab-414e-8394-7c4114bc6236/serve-healthcheck-canary/0.log"
Jun 11 10:07:31.005868 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:31.005841    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6rkm_aa887de6-d292-49b2-8476-1730c4c71a7c/kube-rbac-proxy/0.log"
Jun 11 10:07:31.031885 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:31.031863    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6rkm_aa887de6-d292-49b2-8476-1730c4c71a7c/exporter/0.log"
Jun 11 10:07:31.058045 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:31.058024    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6rkm_aa887de6-d292-49b2-8476-1730c4c71a7c/extractor/0.log"
Jun 11 10:07:33.810346 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:33.810272    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-njx8x"
Jun 11 10:07:36.003066 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:36.003037    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-zz9hs_64caae0f-4a99-43b9-ac49-eba95920dc33/migrator/0.log"
Jun 11 10:07:36.035148 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:36.035121    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-zz9hs_64caae0f-4a99-43b9-ac49-eba95920dc33/graceful-termination/0.log"
Jun 11 10:07:37.408844 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:37.408819    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-95th7_f2862586-aa82-4ee0-9c74-53feb7254237/kube-multus/0.log"
Jun 11 10:07:37.441662 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:37.441634    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hrr2_dfebb8d0-c009-4be3-9d8a-36100da43c39/kube-multus-additional-cni-plugins/0.log"
Jun 11 10:07:37.471447 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:37.471417    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hrr2_dfebb8d0-c009-4be3-9d8a-36100da43c39/egress-router-binary-copy/0.log"
Jun 11 10:07:37.501150 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:37.501122    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hrr2_dfebb8d0-c009-4be3-9d8a-36100da43c39/cni-plugins/0.log"
Jun 11 10:07:37.532767 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:37.532736    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hrr2_dfebb8d0-c009-4be3-9d8a-36100da43c39/bond-cni-plugin/0.log"
Jun 11 10:07:37.556426 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:37.556359    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hrr2_dfebb8d0-c009-4be3-9d8a-36100da43c39/routeoverride-cni/0.log"
Jun 11 10:07:37.583090 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:37.583057    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hrr2_dfebb8d0-c009-4be3-9d8a-36100da43c39/whereabouts-cni-bincopy/0.log"
Jun 11 10:07:37.610109 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:37.610081    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2hrr2_dfebb8d0-c009-4be3-9d8a-36100da43c39/whereabouts-cni/0.log"
Jun 11 10:07:38.169374 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:38.169350    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cfj5p_44a3719b-9e55-4619-bb8f-104095970f64/network-metrics-daemon/0.log"
Jun 11 10:07:38.194395 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:38.194369    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cfj5p_44a3719b-9e55-4619-bb8f-104095970f64/kube-rbac-proxy/0.log"
Jun 11 10:07:39.100767 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:39.100728    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-controller/0.log"
Jun 11 10:07:39.122467 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:39.122434    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/1.log"
Jun 11 10:07:39.122467 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:39.122454    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovn-acl-logging/0.log"
Jun 11 10:07:39.150373 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:39.150343    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/kube-rbac-proxy-node/0.log"
Jun 11 10:07:39.181133 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:39.181105    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/kube-rbac-proxy-ovn-metrics/0.log"
Jun 11 10:07:39.213653 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:39.213621    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/northd/0.log"
Jun 11 10:07:39.242211 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:39.242182    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/nbdb/0.log"
Jun 11 10:07:39.272103 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:39.272075    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/sbdb/0.log"
Jun 11 10:07:39.320678 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:39.320645    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7zrp8_2ccffbfc-8341-49eb-9082-723d34c5a8bd/ovnkube-controller/0.log"
Jun 11 10:07:41.213283 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:41.213251    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rnwsp_4a11ac7e-41cc-4546-944a-cf3ad7866a76/network-check-target-container/0.log"
Jun 11 10:07:42.347235 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:42.347205    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-ggzwc_0b5d3f03-bc6f-4a5f-abb0-b8ab6fa69b53/iptables-alerter/0.log"
Jun 11 10:07:43.292456 ip-10-0-138-252 kubenswrapper[2561]: I0611 10:07:43.292427    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-qwzvt_80146ee6-1a7c-414a-bac3-d48cdf1ecc8a/tuned/0.log"