Jun 03 16:44:18.188025 ip-10-0-143-30 systemd[1]: Starting Kubernetes Kubelet...
Jun 03 16:44:18.510936 ip-10-0-143-30 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 16:44:18.510936 ip-10-0-143-30 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 03 16:44:18.510936 ip-10-0-143-30 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 16:44:18.510936 ip-10-0-143-30 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 03 16:44:18.510936 ip-10-0-143-30 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 16:44:18.512859 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.512745    2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 03 16:44:18.515900 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515885    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 16:44:18.515900 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515900    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515904    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515907    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515910    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515913    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515916    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515918    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515921    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515923    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515926    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515929    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515931    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515934    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515936    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515939    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515942    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515944    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515947    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515949    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515952    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 16:44:18.515960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515954    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515957    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515959    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515963    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515966    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515970    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515972    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515975    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515978    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515981    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515985    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515988    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515991    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515994    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515996    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.515999    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516002    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516004    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516007    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 16:44:18.516436 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516010    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516012    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516015    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516017    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516019    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516022    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516024    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516027    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516030    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516032    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516035    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516037    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516040    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516042    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516045    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516049    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516052    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516054    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516057    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 16:44:18.516959 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516060    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516063    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516065    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516068    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516072    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516074    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516077    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516079    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516082    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516085    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516087    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516090    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516092    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516095    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516097    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516101    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516104    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516107    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516110    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516113    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 16:44:18.517425 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516115    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516118    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516121    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516124    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516127    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516129    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516132    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516486    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516492    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516495    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516499    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516501    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516507    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516510    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516513    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516515    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516518    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516520    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516523    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516526    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 16:44:18.517919 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516529    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516531    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516534    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516536    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516539    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516542    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516544    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516547    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516550    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516552    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516555    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516557    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516560    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516562    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516565    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516567    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516570    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516572    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516574    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516577    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 16:44:18.518398 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516580    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516583    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516585    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516588    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516591    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516594    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516596    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516599    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516601    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516604    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516606    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516609    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516611    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516614    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516616    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516620    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516622    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516625    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516627    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516630    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 16:44:18.518920 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516632    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516635    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516637    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516639    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516642    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516645    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516649    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516652    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516654    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516657    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516659    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516662    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516665    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516668    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516670    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516674    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516676    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516679    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516682    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 16:44:18.519452 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516684    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516687    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516689    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516692    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516696    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516699    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516702    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516705    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516708    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516711    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516714    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516716    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516719    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.516722    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.517943    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.517952    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.517959    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.517963    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.517968    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.517971    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.517976    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 03 16:44:18.519942 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.517981    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.517985    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.517988    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.517992    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.517996    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518000    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518003    2563 flags.go:64] FLAG: --cgroup-root=""
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518006    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518009    2563 flags.go:64] FLAG: --client-ca-file=""
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518012    2563 flags.go:64] FLAG: --cloud-config=""
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518015    2563 flags.go:64] FLAG: --cloud-provider="external"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518018    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518022    2563 flags.go:64] FLAG: --cluster-domain=""
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518025    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518028    2563 flags.go:64] FLAG: --config-dir=""
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518031    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518034    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518038    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518041    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518044    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518047    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518050    2563 flags.go:64] FLAG: --contention-profiling="false"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518053    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518056    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518059    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 03 16:44:18.520456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518062    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518066    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518070    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518073    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518076    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518079    2563 flags.go:64] FLAG: --enable-server="true"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518082    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518087    2563 flags.go:64] FLAG: --event-burst="100"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518090    2563 flags.go:64] FLAG: --event-qps="50"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518093    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518097    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518100    2563 flags.go:64] FLAG: --eviction-hard=""
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518103    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518106    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518110    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518113    2563 flags.go:64] FLAG: --eviction-soft=""
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518115    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518119    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518122    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518126    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518129    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518132    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518135    2563 flags.go:64] FLAG: --feature-gates=""
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518139    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518142    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 03 16:44:18.521074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518145    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518148    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518151    2563 flags.go:64] FLAG: --healthz-port="10248"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518154    2563 flags.go:64] FLAG: --help="false"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518157    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-143-30.ec2.internal"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518160    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518163    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518166    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518169    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518172    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518175    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518178    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518181    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518184    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518187    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518190    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518193    2563 flags.go:64] FLAG: --kube-reserved=""
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518196    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518199    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518202    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518204    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518207    2563 flags.go:64] FLAG: --lock-file=""
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518210    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518213    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 03 16:44:18.521666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518216    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518221    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518224    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518228    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518230    2563 flags.go:64] FLAG: --logging-format="text"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518233    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518237    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518240    2563 flags.go:64] FLAG: --manifest-url=""
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518243    2563 flags.go:64] FLAG: --manifest-url-header=""
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518252    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518255    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518259    2563 flags.go:64] FLAG: --max-pods="110"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518261    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518264    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518268    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518270    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518273    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518276    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518279    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518286    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518289    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518292    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518296    2563 flags.go:64] FLAG: --pod-cidr=""
Jun 03 16:44:18.522257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518300    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518305    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518308    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518311    2563 flags.go:64] FLAG: --pods-per-core="0"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518314    2563 flags.go:64] FLAG: --port="10250"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518317    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518321    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02b4fdbb95ba29287"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518324    2563 flags.go:64] FLAG: --qos-reserved=""
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518326    2563 flags.go:64] FLAG: --read-only-port="10255"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518329    2563 flags.go:64] FLAG: --register-node="true"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518332    2563 flags.go:64] FLAG: --register-schedulable="true"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518335    2563 flags.go:64] FLAG: --register-with-taints=""
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518339    2563 flags.go:64] FLAG: --registry-burst="10"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518342    2563 flags.go:64] FLAG: --registry-qps="5"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518345    2563 flags.go:64] FLAG: --reserved-cpus=""
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518348    2563 flags.go:64] FLAG: --reserved-memory=""
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518352    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518354    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518357    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518360    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518363    2563 flags.go:64] FLAG: --runonce="false"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518366    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518369    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518372    2563 flags.go:64] FLAG: --seccomp-default="false"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518380    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518384    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 03 16:44:18.522835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518386    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518389    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518393    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518396    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518399    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518402    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518405    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518408    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518411    2563 flags.go:64] FLAG: --system-cgroups=""
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518414    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518419    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518422    2563 flags.go:64] FLAG: --tls-cert-file=""
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518425    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518432    2563 flags.go:64] FLAG: --tls-min-version=""
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518435    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518438    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518441    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518443    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518446    2563 flags.go:64] FLAG: --v="2"
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518450    2563 flags.go:64] FLAG: --version="false"
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518455    2563 flags.go:64] FLAG: --vmodule=""
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518459    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.518462    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518557    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 16:44:18.523473 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518560    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518564    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518567    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518569    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518573    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518575    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518580    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518583    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518585    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518588    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518593    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518596    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518599    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518601    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518604    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518607    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518610    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518612    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518615    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518617    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 16:44:18.524081 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518620    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518622    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518625    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518628    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518630    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518633    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518637    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518640    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518642    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518646    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518648    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518651    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518653    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518656    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518658    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518661    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518664    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518666    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518670    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 16:44:18.524590 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518672    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518675    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518679    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518684    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518687    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518689    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518692    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518695    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518697    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518700    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518702    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518705    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518707    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518710    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518712    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518715    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518717    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518720    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518722    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518725    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 16:44:18.525200 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518740    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518743    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518746    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518749    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518752    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518754    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518757    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518759    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518762    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518764    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518767    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518771    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518773    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518776    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518778    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518784    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518786    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518789    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518792    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518794    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 16:44:18.525960 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518797    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 16:44:18.526693 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518800    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 16:44:18.526693 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518802    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 16:44:18.526693 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518804    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 16:44:18.526693 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518807    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 16:44:18.526693 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.518810    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 16:44:18.526693 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.519255    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 16:44:18.526889 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.526836    2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.12"
Jun 03 16:44:18.526889 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.526861    2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 03 16:44:18.526944 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526907    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 16:44:18.526944 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526913    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 16:44:18.526944 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526916    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 16:44:18.526944 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526919    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 16:44:18.526944 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526922    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 16:44:18.526944 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526926    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 16:44:18.526944 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526929    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 16:44:18.526944 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526931    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 16:44:18.526944 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526934    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 16:44:18.526944 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526937    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 16:44:18.526944 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526939    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 16:44:18.526944 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526942    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 16:44:18.526944 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526945    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 16:44:18.526944 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526947    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 16:44:18.526944 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526950    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526953    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526956    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526959    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526962    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526964    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526966    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526969    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526972    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526974    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526977    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526979    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526982    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526984    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526987    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526989    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526992    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526994    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526997    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 16:44:18.527362 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.526999    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527002    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527004    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527008    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527011    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527014    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527017    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527020    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527022    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527025    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527028    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527032    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527036    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527039    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527042    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527046    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527049    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527051    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527054    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 16:44:18.527861 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527057    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527059    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527062    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527065    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527068    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527070    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527073    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527075    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527078    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527081    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527083    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527086    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527088    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527091    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527093    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527095    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527098    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527100    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527103    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527105    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 16:44:18.528330 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527108    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 16:44:18.528830 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527111    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 16:44:18.528830 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527113    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 16:44:18.528830 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527116    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 16:44:18.528830 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527119    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 16:44:18.528830 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527122    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 16:44:18.528830 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527124    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 16:44:18.528830 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527127    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 16:44:18.528830 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527130    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 16:44:18.528830 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527132    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 16:44:18.528830 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527135    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 16:44:18.528830 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527137    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 16:44:18.528830 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527139    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 16:44:18.528830 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527142    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 16:44:18.528830 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.527147    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 16:44:18.528830 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527240    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 16:44:18.528830 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527245    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527248    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527251    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527254    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527257    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527259    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527262    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527265    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527267    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527270    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527273    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527276    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527278    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527281    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527283    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527286    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527290    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527294    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527297    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 16:44:18.529220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527299    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527302    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527305    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527308    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527310    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527313    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527316    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527318    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527321    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527324    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527326    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527328    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527331    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527333    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527336    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527339    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527341    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527344    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527346    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527349    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 16:44:18.529682 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527351    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527354    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527356    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527359    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527361    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527364    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527366    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527369    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527372    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527375    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527377    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527380    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527382    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527385    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527387    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527390    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527393    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527395    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527398    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527400    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 16:44:18.530220 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527403    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527405    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527408    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527410    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527413    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527415    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527418    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527420    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527423    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527425    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527428    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527430    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527433    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527435    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527438    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527440    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527444    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527447    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527450    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 16:44:18.530708 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527453    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 16:44:18.531186 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527456    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 16:44:18.531186 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527459    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 16:44:18.531186 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527462    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 16:44:18.531186 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527465    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 16:44:18.531186 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527467    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 16:44:18.531186 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:18.527470    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 16:44:18.531186 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.527474    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 16:44:18.531186 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.528120    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 03 16:44:18.532159 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.532146    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 03 16:44:18.532865 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.532854    2563 server.go:1019] "Starting client certificate rotation"
Jun 03 16:44:18.532962 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.532949    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 16:44:18.532997 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.532976    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 16:44:18.551934 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.551888    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 16:44:18.553713 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.553695    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 16:44:18.562317 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.562300    2563 log.go:25] "Validated CRI v1 runtime API"
Jun 03 16:44:18.567555 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.567541    2563 log.go:25] "Validated CRI v1 image API"
Jun 03 16:44:18.572146 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.572121    2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 03 16:44:18.575092 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.575053    2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d36a2a3a-9612-459b-a2d5-d8e10057715b:/dev/nvme0n1p3 fb269f1a-eda1-4a4b-ac5e-2c955770fa6b:/dev/nvme0n1p4]
Jun 03 16:44:18.575183 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.575087    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 03 16:44:18.580529 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.580418    2563 manager.go:217] Machine: {Timestamp:2026-06-03 16:44:18.579928534 +0000 UTC m=+0.300820836 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097601 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29f057ea86832e72e77a87314f7ed3 SystemUUID:ec29f057-ea86-832e-72e7-7a87314f7ed3 BootID:fcfe5f94-dc19-4ba6-bebc-72c2b0fc0e4c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1b:f9:db:8f:1b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1b:f9:db:8f:1b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:ec:75:a3:0c:ed Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 03 16:44:18.580529 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.580519    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 03 16:44:18.580666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.580627    2563 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 03 16:44:18.581861 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.581844    2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 16:44:18.582032 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.582008    2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 03 16:44:18.582164 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.582036    2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-30.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 03 16:44:18.582212 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.582173    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jun 03 16:44:18.582212 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.582182    2563 container_manager_linux.go:306] "Creating device plugin manager"
Jun 03 16:44:18.582212 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.582189    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 16:44:18.582759 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.582749    2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 16:44:18.583962 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.583951    2563 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 16:44:18.584075 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.584065    2563 server.go:1267] "Using root directory" path="/var/lib/kubelet"
Jun 03 16:44:18.585679 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.585670    2563 kubelet.go:491] "Attempting to sync node with API server"
Jun 03 16:44:18.585716 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.585683    2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 03 16:44:18.585716 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.585695    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 03 16:44:18.585716 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.585703    2563 kubelet.go:397] "Adding apiserver pod source"
Jun 03 16:44:18.585716 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.585712    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 03 16:44:18.586604 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.586589    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 16:44:18.586648 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.586610    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 16:44:18.588895 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.588870    2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1"
Jun 03 16:44:18.590681 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.590665    2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 03 16:44:18.592176 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.592164    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 03 16:44:18.592221 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.592191    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 03 16:44:18.592221 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.592216    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 03 16:44:18.592283 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.592227    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 03 16:44:18.592283 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.592242    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 03 16:44:18.592283 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.592256    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 03 16:44:18.592283 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.592268    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 03 16:44:18.592283 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.592279    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 03 16:44:18.592409 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.592295    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 03 16:44:18.592409 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.592306    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 03 16:44:18.592409 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.592317    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 03 16:44:18.592409 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.592322    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 03 16:44:18.592993 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.592981    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 03 16:44:18.592993 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.592993    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 03 16:44:18.594896 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.594867    2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 03 16:44:18.594990 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.594856    2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-30.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 03 16:44:18.596199 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.596186    2563 watchdog_linux.go:99] "Systemd watchdog is not enabled"
Jun 03 16:44:18.596282 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.596228    2563 server.go:1295] "Started kubelet"
Jun 03 16:44:18.596413 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.596354    2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 03 16:44:18.596469 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.596445    2563 server_v1.go:47] "podresources" method="list" useActivePods=true
Jun 03 16:44:18.596469 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.596454    2563 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-30.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 03 16:44:18.596884 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.596858    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 03 16:44:18.597018 ip-10-0-143-30 systemd[1]: Started Kubernetes Kubelet.
Jun 03 16:44:18.597629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.597591    2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 03 16:44:18.599146 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.599131    2563 server.go:317] "Adding debug handlers to kubelet server"
Jun 03 16:44:18.603466 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.603450    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 03 16:44:18.603793 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.603770    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 03 16:44:18.605168 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.605056    2563 volume_manager.go:295] "The desired_state_of_world populator starts"
Jun 03 16:44:18.605168 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.605171    2563 volume_manager.go:297] "Starting Kubelet Volume Manager"
Jun 03 16:44:18.605301 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.603063    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-30.ec2.internal.18b59fead2699a3f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-30.ec2.internal,UID:ip-10-0-143-30.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-30.ec2.internal,},FirstTimestamp:2026-06-03 16:44:18.596198975 +0000 UTC m=+0.317091260,LastTimestamp:2026-06-03 16:44:18.596198975 +0000 UTC m=+0.317091260,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-30.ec2.internal,}"
Jun 03 16:44:18.605396 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.605383    2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
Jun 03 16:44:18.605476 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.605460    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-30.ec2.internal\" not found"
Jun 03 16:44:18.605547 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.605472    2563 reconstruct.go:97] "Volume reconstruction finished"
Jun 03 16:44:18.605617 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.605608    2563 reconciler.go:26] "Reconciler: start to sync state"
Jun 03 16:44:18.606216 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.606156    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sqtqf"
Jun 03 16:44:18.606293 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.606280    2563 factory.go:55] Registering systemd factory
Jun 03 16:44:18.606354 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.606295    2563 factory.go:223] Registration of the systemd container factory successfully
Jun 03 16:44:18.606399 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.606382    2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 03 16:44:18.606830 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.606814    2563 factory.go:153] Registering CRI-O factory
Jun 03 16:44:18.606951 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.606931    2563 factory.go:223] Registration of the crio container factory successfully
Jun 03 16:44:18.607059 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.607015    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 03 16:44:18.607548 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.607532    2563 factory.go:103] Registering Raw factory
Jun 03 16:44:18.607616 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.607560    2563 manager.go:1196] Started watching for new ooms in manager
Jun 03 16:44:18.608125 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.608098    2563 manager.go:319] Starting recovery of all containers
Jun 03 16:44:18.609178 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.609156    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-30.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 03 16:44:18.609335 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.609312    2563 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 03 16:44:18.614790 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.614071    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sqtqf"
Jun 03 16:44:18.618952 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.618929    2563 manager.go:324] Recovery completed
Jun 03 16:44:18.623154 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.623142    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 16:44:18.624882 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.624867    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 16:44:18.624960 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.624891    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 16:44:18.624960 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.624904    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientPID"
Jun 03 16:44:18.625388 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.625374    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 03 16:44:18.625388 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.625387    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 03 16:44:18.625484 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.625402    2563 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 16:44:18.626596 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.626535    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-30.ec2.internal.18b59fead41f40b6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-30.ec2.internal,UID:ip-10-0-143-30.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-30.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-30.ec2.internal,},FirstTimestamp:2026-06-03 16:44:18.624880822 +0000 UTC m=+0.345773105,LastTimestamp:2026-06-03 16:44:18.624880822 +0000 UTC m=+0.345773105,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-30.ec2.internal,}"
Jun 03 16:44:18.627108 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.627095    2563 policy_none.go:49] "None policy: Start"
Jun 03 16:44:18.627157 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.627113    2563 memory_manager.go:186] "Starting memorymanager" policy="None"
Jun 03 16:44:18.627157 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.627132    2563 state_mem.go:35] "Initializing new in-memory state store"
Jun 03 16:44:18.662301 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.662286    2563 manager.go:341] "Starting Device Plugin manager"
Jun 03 16:44:18.670628 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.662314    2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 03 16:44:18.670628 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.662323    2563 server.go:85] "Starting device plugin registration server"
Jun 03 16:44:18.670628 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.662511    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 03 16:44:18.670628 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.662621    2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 03 16:44:18.670628 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.662722    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 03 16:44:18.670628 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.662832    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 03 16:44:18.670628 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.662847    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 03 16:44:18.670628 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.663286    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 03 16:44:18.670628 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.663314    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-30.ec2.internal\" not found"
Jun 03 16:44:18.725996 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.725963    2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
Jun 03 16:44:18.727073 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.727050    2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
Jun 03 16:44:18.727162 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.727080    2563 status_manager.go:230] "Starting to sync pod status with apiserver"
Jun 03 16:44:18.727162 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.727102    2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 03 16:44:18.727162 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.727113    2563 kubelet.go:2451] "Starting kubelet main sync loop"
Jun 03 16:44:18.727276 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.727157    2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 03 16:44:18.731359 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.731343    2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 16:44:18.763512 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.763497    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 16:44:18.764199 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.764183    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 16:44:18.764261 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.764212    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 16:44:18.764261 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.764227    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientPID"
Jun 03 16:44:18.764261 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.764254    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-30.ec2.internal"
Jun 03 16:44:18.770161 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.770147    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-30.ec2.internal"
Jun 03 16:44:18.770205 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.770170    2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-30.ec2.internal\": node \"ip-10-0-143-30.ec2.internal\" not found"
Jun 03 16:44:18.798163 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.798143    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-30.ec2.internal\" not found"
Jun 03 16:44:18.828089 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.828010    2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal"]
Jun 03 16:44:18.828186 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.828095    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 16:44:18.828969 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.828955    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 16:44:18.829047 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.828981    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 16:44:18.829047 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.828993    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientPID"
Jun 03 16:44:18.830323 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.830311    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 16:44:18.830466 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.830453    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal"
Jun 03 16:44:18.830501 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.830481    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 16:44:18.830993 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.830975    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 16:44:18.831085 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.831004    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 16:44:18.831085 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.831014    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientPID"
Jun 03 16:44:18.831085 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.830981    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 16:44:18.831085 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.831063    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 16:44:18.831085 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.831072    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientPID"
Jun 03 16:44:18.832132 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.832117    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal"
Jun 03 16:44:18.832180 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.832141    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 16:44:18.832766 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.832752    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 16:44:18.832827 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.832776    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 16:44:18.832827 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.832788    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientPID"
Jun 03 16:44:18.847287 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.847268    2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-30.ec2.internal\" not found" node="ip-10-0-143-30.ec2.internal"
Jun 03 16:44:18.851107 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.851092    2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-30.ec2.internal\" not found" node="ip-10-0-143-30.ec2.internal"
Jun 03 16:44:18.899197 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.899178    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-30.ec2.internal\" not found"
Jun 03 16:44:18.908188 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.908165    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cb8d9365434b9a544806a411e71ebb0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal\" (UID: \"4cb8d9365434b9a544806a411e71ebb0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal"
Jun 03 16:44:18.908260 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.908190    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac4c8c9bbafe1b4ee435b19e9ed813ee-config\") pod \"kube-apiserver-proxy-ip-10-0-143-30.ec2.internal\" (UID: \"ac4c8c9bbafe1b4ee435b19e9ed813ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal"
Jun 03 16:44:18.908260 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:18.908210    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4cb8d9365434b9a544806a411e71ebb0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal\" (UID: \"4cb8d9365434b9a544806a411e71ebb0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal"
Jun 03 16:44:18.999502 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:18.999477    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-30.ec2.internal\" not found"
Jun 03 16:44:19.008830 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.008810    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4cb8d9365434b9a544806a411e71ebb0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal\" (UID: \"4cb8d9365434b9a544806a411e71ebb0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal"
Jun 03 16:44:19.008896 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.008838    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cb8d9365434b9a544806a411e71ebb0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal\" (UID: \"4cb8d9365434b9a544806a411e71ebb0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal"
Jun 03 16:44:19.008896 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.008853    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac4c8c9bbafe1b4ee435b19e9ed813ee-config\") pod \"kube-apiserver-proxy-ip-10-0-143-30.ec2.internal\" (UID: \"ac4c8c9bbafe1b4ee435b19e9ed813ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal"
Jun 03 16:44:19.008896 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.008866    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4cb8d9365434b9a544806a411e71ebb0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal\" (UID: \"4cb8d9365434b9a544806a411e71ebb0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal"
Jun 03 16:44:19.008896 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.008888    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac4c8c9bbafe1b4ee435b19e9ed813ee-config\") pod \"kube-apiserver-proxy-ip-10-0-143-30.ec2.internal\" (UID: \"ac4c8c9bbafe1b4ee435b19e9ed813ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal"
Jun 03 16:44:19.009042 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.008919    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cb8d9365434b9a544806a411e71ebb0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal\" (UID: \"4cb8d9365434b9a544806a411e71ebb0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal"
Jun 03 16:44:19.100206 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:19.100153    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-30.ec2.internal\" not found"
Jun 03 16:44:19.149618 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.149586    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal"
Jun 03 16:44:19.153941 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.153925    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal"
Jun 03 16:44:19.200427 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:19.200393    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-30.ec2.internal\" not found"
Jun 03 16:44:19.300920 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:19.300891    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-30.ec2.internal\" not found"
Jun 03 16:44:19.401415 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:19.401348    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-30.ec2.internal\" not found"
Jun 03 16:44:19.501850 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:19.501809    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-30.ec2.internal\" not found"
Jun 03 16:44:19.533306 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.533282    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 03 16:44:19.533697 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.533413    2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 03 16:44:19.586984 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.586961    2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 16:44:19.602339 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:19.602318    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-30.ec2.internal\" not found"
Jun 03 16:44:19.604380 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.604364    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 03 16:44:19.617103 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.617077    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 16:39:18 +0000 UTC" deadline="2027-12-20 10:26:13.457231471 +0000 UTC"
Jun 03 16:44:19.617103 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.617101    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13553h41m53.840133546s"
Jun 03 16:44:19.618350 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.618319    2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 16:44:19.656866 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.656811    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-94jjk"
Jun 03 16:44:19.664168 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.664150    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-94jjk"
Jun 03 16:44:19.693068 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:19.693041    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb8d9365434b9a544806a411e71ebb0.slice/crio-86b2c54d32e3156ea159b2eefafbe185a426a8ff9bf29dfdafb67752b1d50bc4 WatchSource:0}: Error finding container 86b2c54d32e3156ea159b2eefafbe185a426a8ff9bf29dfdafb67752b1d50bc4: Status 404 returned error can't find the container with id 86b2c54d32e3156ea159b2eefafbe185a426a8ff9bf29dfdafb67752b1d50bc4
Jun 03 16:44:19.693297 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:19.693281    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4c8c9bbafe1b4ee435b19e9ed813ee.slice/crio-bc6166ce73d688d9611d18d0abb84827d307aad20ee1a162061a7a8f94f1917a WatchSource:0}: Error finding container bc6166ce73d688d9611d18d0abb84827d307aad20ee1a162061a7a8f94f1917a: Status 404 returned error can't find the container with id bc6166ce73d688d9611d18d0abb84827d307aad20ee1a162061a7a8f94f1917a
Jun 03 16:44:19.696601 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.696588    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 16:44:19.703061 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:19.703040    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-30.ec2.internal\" not found"
Jun 03 16:44:19.730174 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.730140    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" event={"ID":"4cb8d9365434b9a544806a411e71ebb0","Type":"ContainerStarted","Data":"86b2c54d32e3156ea159b2eefafbe185a426a8ff9bf29dfdafb67752b1d50bc4"}
Jun 03 16:44:19.731016 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.730998    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal" event={"ID":"ac4c8c9bbafe1b4ee435b19e9ed813ee","Type":"ContainerStarted","Data":"bc6166ce73d688d9611d18d0abb84827d307aad20ee1a162061a7a8f94f1917a"}
Jun 03 16:44:19.771787 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.771765    2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 16:44:19.805711 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.805692    2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal"
Jun 03 16:44:19.816741 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.816712    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 16:44:19.817436 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.817425    2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal"
Jun 03 16:44:19.829739 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.829710    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 16:44:19.913357 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:19.913291    2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 16:44:20.587851 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.587763    2563 apiserver.go:52] "Watching apiserver"
Jun 03 16:44:20.598404 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.598372    2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 03 16:44:20.600351 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.600320    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5","openshift-image-registry/node-ca-k5dwb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal","openshift-multus/multus-additional-cni-plugins-sjspd","openshift-multus/multus-k2bzr","openshift-multus/network-metrics-daemon-82l8r","openshift-ovn-kubernetes/ovnkube-node-27p8j","kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal","openshift-cluster-node-tuning-operator/tuned-rqqzj","openshift-dns/node-resolver-lpn2p","openshift-network-diagnostics/network-check-target-ztv72","openshift-network-operator/iptables-alerter-hrt8r","kube-system/konnectivity-agent-ccwjz"]
Jun 03 16:44:20.601569 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.601547    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lpn2p"
Jun 03 16:44:20.602918 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.602897    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.603862 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.603843    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.604339 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.604318    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 03 16:44:20.604429 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.604373    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 03 16:44:20.605344 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.604886    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r2qzg\""
Jun 03 16:44:20.605344 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.605278    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 03 16:44:20.605654 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.605624    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.606690 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.606521    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 03 16:44:20.606789 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.606770    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vt5lj\""
Jun 03 16:44:20.607715 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.606938    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 03 16:44:20.607715 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.607199    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xctd4\""
Jun 03 16:44:20.607715 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.607268    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 03 16:44:20.607715 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.607553    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 03 16:44:20.607971 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.607741    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 03 16:44:20.609156 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.608906    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hrt8r"
Jun 03 16:44:20.609156 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.608940    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 03 16:44:20.609156 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.608975    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wfb7h\""
Jun 03 16:44:20.609156 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.609033    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.610522 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.610298    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 03 16:44:20.611812 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.611796    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ccwjz"
Jun 03 16:44:20.611987 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.611800    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 03 16:44:20.612462 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.612309    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 03 16:44:20.613467 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.613447    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k5dwb"
Jun 03 16:44:20.613663 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.613645    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 03 16:44:20.614621 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.613558    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lzxm7\""
Jun 03 16:44:20.614621 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.614071    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ktf7c\""
Jun 03 16:44:20.614621 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.614287    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 03 16:44:20.614621 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.614318    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 03 16:44:20.615008 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.614992    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 03 16:44:20.615154 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615137    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 03 16:44:20.615217 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615209    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ctrdt\""
Jun 03 16:44:20.615319 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615305    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 03 16:44:20.615539 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-multus-conf-dir\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.615680 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-sysconfig\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.615680 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-host\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.615680 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615606    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e5759cb-a305-41d7-90d6-29af458371a2-etc-tuned\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.615680 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615649    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d19049a5-6916-4d4f-8a64-2f9968f534b3-cnibin\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.615960 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-run-k8s-cni-cncf-io\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.615960 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-var-lib-cni-bin\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.615960 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615757    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-kubernetes\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.615960 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615803    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xk7x\" (UniqueName: \"kubernetes.io/projected/7e5759cb-a305-41d7-90d6-29af458371a2-kube-api-access-4xk7x\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.615960 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615826    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca235535-73f8-4549-bf3c-b7a3491f2b90-tmp-dir\") pod \"node-resolver-lpn2p\" (UID: \"ca235535-73f8-4549-bf3c-b7a3491f2b90\") " pod="openshift-dns/node-resolver-lpn2p"
Jun 03 16:44:20.615960 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-os-release\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.615960 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-multus-socket-dir-parent\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.615960 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-modprobe-d\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.615960 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615918    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-lib-modules\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.615960 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-registration-dir\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.615974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d19049a5-6916-4d4f-8a64-2f9968f534b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-etc-kubernetes\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616034    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rptgk\""
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwdb2\" (UniqueName: \"kubernetes.io/projected/79b323cd-77ab-489a-b0d2-8e2857600a35-kube-api-access-jwdb2\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616074    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e5759cb-a305-41d7-90d6-29af458371a2-tmp\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-etc-selinux\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616125    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-sys-fs\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtjv4\" (UniqueName: \"kubernetes.io/projected/03882a67-ec75-4d9e-af70-6f810fb5594e-kube-api-access-qtjv4\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ca235535-73f8-4549-bf3c-b7a3491f2b90-hosts-file\") pod \"node-resolver-lpn2p\" (UID: \"ca235535-73f8-4549-bf3c-b7a3491f2b90\") " pod="openshift-dns/node-resolver-lpn2p"
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d19049a5-6916-4d4f-8a64-2f9968f534b3-system-cni-dir\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d19049a5-6916-4d4f-8a64-2f9968f534b3-os-release\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616302    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/79b323cd-77ab-489a-b0d2-8e2857600a35-multus-daemon-config\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-sysctl-conf\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616401    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-device-dir\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d19049a5-6916-4d4f-8a64-2f9968f534b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.616498 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-run\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-socket-dir\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616518    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df4kh\" (UniqueName: \"kubernetes.io/projected/ca235535-73f8-4549-bf3c-b7a3491f2b90-kube-api-access-df4kh\") pod \"node-resolver-lpn2p\" (UID: \"ca235535-73f8-4549-bf3c-b7a3491f2b90\") " pod="openshift-dns/node-resolver-lpn2p"
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-system-cni-dir\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616569    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616571    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-var-lib-kubelet\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616756    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-run-multus-certs\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-sys\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-multus-cni-dir\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616824    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-cnibin\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616847    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79b323cd-77ab-489a-b0d2-8e2857600a35-cni-binary-copy\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616853    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616869    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-run-netns\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616892    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-var-lib-cni-multus\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616915    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-sysctl-d\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616942    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-systemd\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616991    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-var-lib-kubelet\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.616781    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.617387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.617016    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d19049a5-6916-4d4f-8a64-2f9968f534b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.618275 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.617041    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d19049a5-6916-4d4f-8a64-2f9968f534b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.618275 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.617071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgnnx\" (UniqueName: \"kubernetes.io/projected/d19049a5-6916-4d4f-8a64-2f9968f534b3-kube-api-access-jgnnx\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.618275 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.617108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-hostroot\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.618520 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.618478    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 03 16:44:20.618654 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.618638    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:20.618721 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.618654    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:20.618797 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:20.618775    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:20.618866 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:20.618772    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:20.619627 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.619459    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 03 16:44:20.620858 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.620501    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ssw54\""
Jun 03 16:44:20.620858 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.620552    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 03 16:44:20.620858 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.620792    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 03 16:44:20.620858 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.620832    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 03 16:44:20.620858 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.620835    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 03 16:44:20.621144 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.620795    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 03 16:44:20.666506 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.666248    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 16:39:19 +0000 UTC" deadline="2028-01-20 10:51:39.356592003 +0000 UTC"
Jun 03 16:44:20.666506 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.666289    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14298h7m18.690306444s"
Jun 03 16:44:20.707137 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.707116    2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
Jun 03 16:44:20.717324 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-run-ovn\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.717439 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717340    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d19049a5-6916-4d4f-8a64-2f9968f534b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.717439 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717370    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f3a7bc8-0c54-454a-a8fd-bb8060f466ae-agent-certs\") pod \"konnectivity-agent-ccwjz\" (UID: \"8f3a7bc8-0c54-454a-a8fd-bb8060f466ae\") " pod="kube-system/konnectivity-agent-ccwjz"
Jun 03 16:44:20.717439 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq7kg\" (UniqueName: \"kubernetes.io/projected/a3fc7985-ac36-48b1-8634-3ef9c3dbfedd-kube-api-access-rq7kg\") pod \"iptables-alerter-hrt8r\" (UID: \"a3fc7985-ac36-48b1-8634-3ef9c3dbfedd\") " pod="openshift-network-operator/iptables-alerter-hrt8r"
Jun 03 16:44:20.717439 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bvqk\" (UniqueName: \"kubernetes.io/projected/794e1bba-9e19-4e85-af4a-d0cf61fba88f-kube-api-access-2bvqk\") pod \"node-ca-k5dwb\" (UID: \"794e1bba-9e19-4e85-af4a-d0cf61fba88f\") " pod="openshift-image-registry/node-ca-k5dwb"
Jun 03 16:44:20.717621 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717450    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb34b062-1e4c-4b7c-b23f-6bd80497b334-env-overrides\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.717621 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717514    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/79b323cd-77ab-489a-b0d2-8e2857600a35-multus-daemon-config\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.717621 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717594    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-sysctl-conf\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.717784 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717644    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.717784 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717695    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-device-dir\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.717784 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717770    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-sysctl-conf\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.717932 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717781    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-device-dir\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.717932 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717774    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.717932 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-var-lib-openvswitch\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.717932 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-run-openvswitch\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.717932 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd46p\" (UniqueName: \"kubernetes.io/projected/eb34b062-1e4c-4b7c-b23f-6bd80497b334-kube-api-access-kd46p\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.717932 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717907    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-socket-dir\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.718203 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717934    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-etc-openvswitch\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.718203 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-run-ovn-kubernetes\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.718203 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.717981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb34b062-1e4c-4b7c-b23f-6bd80497b334-ovn-node-metrics-cert\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.718203 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718007    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-run-multus-certs\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.718203 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718015    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-socket-dir\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.718203 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb34b062-1e4c-4b7c-b23f-6bd80497b334-ovnkube-config\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.718203 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwqbv\" (UniqueName: \"kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv\") pod \"network-check-target-ztv72\" (UID: \"2f28e154-d9d4-42d9-aec8-e161a3614ca9\") " pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:20.718203 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718064    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-run-multus-certs\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.718203 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718086    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-multus-cni-dir\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.718203 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718104    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/79b323cd-77ab-489a-b0d2-8e2857600a35-multus-daemon-config\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.718203 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718143    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-cnibin\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.718203 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718108    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-cnibin\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.718203 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718191    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-systemd\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718248    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-run-netns\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718270    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d19049a5-6916-4d4f-8a64-2f9968f534b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718287    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-hostroot\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718250    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-systemd\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718306    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-multus-cni-dir\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718318    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-multus-conf-dir\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718353    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-sysconfig\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718383    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-hostroot\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718355    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-multus-conf-dir\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-systemd-units\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718413    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-sysconfig\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718422    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d19049a5-6916-4d4f-8a64-2f9968f534b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718431    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d19049a5-6916-4d4f-8a64-2f9968f534b3-cnibin\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718455    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-var-lib-cni-bin\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718480    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d19049a5-6916-4d4f-8a64-2f9968f534b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718487    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d19049a5-6916-4d4f-8a64-2f9968f534b3-cnibin\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.718724 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718537    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca235535-73f8-4549-bf3c-b7a3491f2b90-tmp-dir\") pod \"node-resolver-lpn2p\" (UID: \"ca235535-73f8-4549-bf3c-b7a3491f2b90\") " pod="openshift-dns/node-resolver-lpn2p"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718553    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-registration-dir\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718492    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-var-lib-cni-bin\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-cni-bin\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718608    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-registration-dir\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718642    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-etc-kubernetes\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718661    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwdb2\" (UniqueName: \"kubernetes.io/projected/79b323cd-77ab-489a-b0d2-8e2857600a35-kube-api-access-jwdb2\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718676    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e5759cb-a305-41d7-90d6-29af458371a2-tmp\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718722    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-etc-kubernetes\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718759    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-etc-selinux\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718787    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-sys-fs\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718811    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qtjv4\" (UniqueName: \"kubernetes.io/projected/03882a67-ec75-4d9e-af70-6f810fb5594e-kube-api-access-qtjv4\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718837    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f3a7bc8-0c54-454a-a8fd-bb8060f466ae-konnectivity-ca\") pod \"konnectivity-agent-ccwjz\" (UID: \"8f3a7bc8-0c54-454a-a8fd-bb8060f466ae\") " pod="kube-system/konnectivity-agent-ccwjz"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718874    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ca235535-73f8-4549-bf3c-b7a3491f2b90-hosts-file\") pod \"node-resolver-lpn2p\" (UID: \"ca235535-73f8-4549-bf3c-b7a3491f2b90\") " pod="openshift-dns/node-resolver-lpn2p"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718883    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca235535-73f8-4549-bf3c-b7a3491f2b90-tmp-dir\") pod \"node-resolver-lpn2p\" (UID: \"ca235535-73f8-4549-bf3c-b7a3491f2b90\") " pod="openshift-dns/node-resolver-lpn2p"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718901    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d19049a5-6916-4d4f-8a64-2f9968f534b3-system-cni-dir\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.719486 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718928    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d19049a5-6916-4d4f-8a64-2f9968f534b3-os-release\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718939    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-etc-selinux\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718955    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d19049a5-6916-4d4f-8a64-2f9968f534b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.718989    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719000    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d19049a5-6916-4d4f-8a64-2f9968f534b3-system-cni-dir\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719000    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03882a67-ec75-4d9e-af70-6f810fb5594e-sys-fs\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719053    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d19049a5-6916-4d4f-8a64-2f9968f534b3-os-release\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719060    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ca235535-73f8-4549-bf3c-b7a3491f2b90-hosts-file\") pod \"node-resolver-lpn2p\" (UID: \"ca235535-73f8-4549-bf3c-b7a3491f2b90\") " pod="openshift-dns/node-resolver-lpn2p"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719086    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-run\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719114    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/794e1bba-9e19-4e85-af4a-d0cf61fba88f-host\") pod \"node-ca-k5dwb\" (UID: \"794e1bba-9e19-4e85-af4a-d0cf61fba88f\") " pod="openshift-image-registry/node-ca-k5dwb"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719121    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-run\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs\") pod \"network-metrics-daemon-82l8r\" (UID: \"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff\") " pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-node-log\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719194    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-df4kh\" (UniqueName: \"kubernetes.io/projected/ca235535-73f8-4549-bf3c-b7a3491f2b90-kube-api-access-df4kh\") pod \"node-resolver-lpn2p\" (UID: \"ca235535-73f8-4549-bf3c-b7a3491f2b90\") " pod="openshift-dns/node-resolver-lpn2p"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719218    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-system-cni-dir\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719241    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-var-lib-kubelet\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719264    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-sys\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tqzt\" (UniqueName: \"kubernetes.io/projected/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-kube-api-access-6tqzt\") pod \"network-metrics-daemon-82l8r\" (UID: \"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff\") " pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:20.720074 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719307    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-system-cni-dir\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-cni-netd\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719346    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-var-lib-kubelet\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719364    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-sys\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719353    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d19049a5-6916-4d4f-8a64-2f9968f534b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb34b062-1e4c-4b7c-b23f-6bd80497b334-ovnkube-script-lib\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719427    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79b323cd-77ab-489a-b0d2-8e2857600a35-cni-binary-copy\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719452    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-run-netns\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719478    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-var-lib-cni-multus\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719513    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-sysctl-d\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719521    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-var-lib-cni-multus\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719536    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-run-netns\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719548    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-var-lib-kubelet\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719568    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-host\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719588    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d19049a5-6916-4d4f-8a64-2f9968f534b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719615    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgnnx\" (UniqueName: \"kubernetes.io/projected/d19049a5-6916-4d4f-8a64-2f9968f534b3-kube-api-access-jgnnx\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719637    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e5759cb-a305-41d7-90d6-29af458371a2-etc-tuned\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.720712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719644    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-var-lib-kubelet\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719672    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-sysctl-d\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719683    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xk7x\" (UniqueName: \"kubernetes.io/projected/7e5759cb-a305-41d7-90d6-29af458371a2-kube-api-access-4xk7x\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3fc7985-ac36-48b1-8634-3ef9c3dbfedd-host-slash\") pod \"iptables-alerter-hrt8r\" (UID: \"a3fc7985-ac36-48b1-8634-3ef9c3dbfedd\") " pod="openshift-network-operator/iptables-alerter-hrt8r"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-kubelet\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-slash\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-log-socket\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719812    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-run-k8s-cni-cncf-io\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719834    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-kubernetes\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719857    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3fc7985-ac36-48b1-8634-3ef9c3dbfedd-iptables-alerter-script\") pod \"iptables-alerter-hrt8r\" (UID: \"a3fc7985-ac36-48b1-8634-3ef9c3dbfedd\") " pod="openshift-network-operator/iptables-alerter-hrt8r"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/794e1bba-9e19-4e85-af4a-d0cf61fba88f-serviceca\") pod \"node-ca-k5dwb\" (UID: \"794e1bba-9e19-4e85-af4a-d0cf61fba88f\") " pod="openshift-image-registry/node-ca-k5dwb"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719905    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-run-systemd\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719942    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-os-release\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719959    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-host\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719961    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-multus-socket-dir-parent\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.719961    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79b323cd-77ab-489a-b0d2-8e2857600a35-cni-binary-copy\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.720020    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-host-run-k8s-cni-cncf-io\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.721296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.720026    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-multus-socket-dir-parent\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.721935 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.720068    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-modprobe-d\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.721935 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.720073    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-kubernetes\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.721935 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.720086    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79b323cd-77ab-489a-b0d2-8e2857600a35-os-release\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.721935 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.720128    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-lib-modules\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.721935 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.720165    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d19049a5-6916-4d4f-8a64-2f9968f534b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.721935 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.720245    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-lib-modules\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.721935 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.720277    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e5759cb-a305-41d7-90d6-29af458371a2-etc-modprobe-d\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.722680 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.722593    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e5759cb-a305-41d7-90d6-29af458371a2-tmp\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.722680 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.722642    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e5759cb-a305-41d7-90d6-29af458371a2-etc-tuned\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.734543 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.734517    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgnnx\" (UniqueName: \"kubernetes.io/projected/d19049a5-6916-4d4f-8a64-2f9968f534b3-kube-api-access-jgnnx\") pod \"multus-additional-cni-plugins-sjspd\" (UID: \"d19049a5-6916-4d4f-8a64-2f9968f534b3\") " pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.734900 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.734855    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwdb2\" (UniqueName: \"kubernetes.io/projected/79b323cd-77ab-489a-b0d2-8e2857600a35-kube-api-access-jwdb2\") pod \"multus-k2bzr\" (UID: \"79b323cd-77ab-489a-b0d2-8e2857600a35\") " pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.735109 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.735089    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df4kh\" (UniqueName: \"kubernetes.io/projected/ca235535-73f8-4549-bf3c-b7a3491f2b90-kube-api-access-df4kh\") pod \"node-resolver-lpn2p\" (UID: \"ca235535-73f8-4549-bf3c-b7a3491f2b90\") " pod="openshift-dns/node-resolver-lpn2p"
Jun 03 16:44:20.735670 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.735642    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtjv4\" (UniqueName: \"kubernetes.io/projected/03882a67-ec75-4d9e-af70-6f810fb5594e-kube-api-access-qtjv4\") pod \"aws-ebs-csi-driver-node-8m6t5\" (UID: \"03882a67-ec75-4d9e-af70-6f810fb5594e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.735875 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.735856    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xk7x\" (UniqueName: \"kubernetes.io/projected/7e5759cb-a305-41d7-90d6-29af458371a2-kube-api-access-4xk7x\") pod \"tuned-rqqzj\" (UID: \"7e5759cb-a305-41d7-90d6-29af458371a2\") " pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.820811 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.820778    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f3a7bc8-0c54-454a-a8fd-bb8060f466ae-konnectivity-ca\") pod \"konnectivity-agent-ccwjz\" (UID: \"8f3a7bc8-0c54-454a-a8fd-bb8060f466ae\") " pod="kube-system/konnectivity-agent-ccwjz"
Jun 03 16:44:20.820811 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.820820    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/794e1bba-9e19-4e85-af4a-d0cf61fba88f-host\") pod \"node-ca-k5dwb\" (UID: \"794e1bba-9e19-4e85-af4a-d0cf61fba88f\") " pod="openshift-image-registry/node-ca-k5dwb"
Jun 03 16:44:20.821045 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.820844    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs\") pod \"network-metrics-daemon-82l8r\" (UID: \"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff\") " pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:20.821045 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.820864    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-node-log\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.821045 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.820892    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6tqzt\" (UniqueName: \"kubernetes.io/projected/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-kube-api-access-6tqzt\") pod \"network-metrics-daemon-82l8r\" (UID: \"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff\") " pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:20.821045 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.820915    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-cni-netd\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.821045 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.820934    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb34b062-1e4c-4b7c-b23f-6bd80497b334-ovnkube-script-lib\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.821045 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.820951    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-node-log\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.821045 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.820963    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3fc7985-ac36-48b1-8634-3ef9c3dbfedd-host-slash\") pod \"iptables-alerter-hrt8r\" (UID: \"a3fc7985-ac36-48b1-8634-3ef9c3dbfedd\") " pod="openshift-network-operator/iptables-alerter-hrt8r"
Jun 03 16:44:20.821045 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:20.820986    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 16:44:20.821045 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821004    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3fc7985-ac36-48b1-8634-3ef9c3dbfedd-host-slash\") pod \"iptables-alerter-hrt8r\" (UID: \"a3fc7985-ac36-48b1-8634-3ef9c3dbfedd\") " pod="openshift-network-operator/iptables-alerter-hrt8r"
Jun 03 16:44:20.821045 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821013    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-kubelet\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821051    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-cni-netd\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821059    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-kubelet\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:20.821080    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs podName:3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff nodeName:}" failed. No retries permitted until 2026-06-03 16:44:21.321040561 +0000 UTC m=+3.041932849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs") pod "network-metrics-daemon-82l8r" (UID: "3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821102    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/794e1bba-9e19-4e85-af4a-d0cf61fba88f-host\") pod \"node-ca-k5dwb\" (UID: \"794e1bba-9e19-4e85-af4a-d0cf61fba88f\") " pod="openshift-image-registry/node-ca-k5dwb"
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821102    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-slash\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821134    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-log-socket\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821160    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3fc7985-ac36-48b1-8634-3ef9c3dbfedd-iptables-alerter-script\") pod \"iptables-alerter-hrt8r\" (UID: \"a3fc7985-ac36-48b1-8634-3ef9c3dbfedd\") " pod="openshift-network-operator/iptables-alerter-hrt8r"
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821184    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/794e1bba-9e19-4e85-af4a-d0cf61fba88f-serviceca\") pod \"node-ca-k5dwb\" (UID: \"794e1bba-9e19-4e85-af4a-d0cf61fba88f\") " pod="openshift-image-registry/node-ca-k5dwb"
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821188    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-slash\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821206    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-run-systemd\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821234    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-run-ovn\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821257    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f3a7bc8-0c54-454a-a8fd-bb8060f466ae-agent-certs\") pod \"konnectivity-agent-ccwjz\" (UID: \"8f3a7bc8-0c54-454a-a8fd-bb8060f466ae\") " pod="kube-system/konnectivity-agent-ccwjz"
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821294    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-log-socket\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821322    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rq7kg\" (UniqueName: \"kubernetes.io/projected/a3fc7985-ac36-48b1-8634-3ef9c3dbfedd-kube-api-access-rq7kg\") pod \"iptables-alerter-hrt8r\" (UID: \"a3fc7985-ac36-48b1-8634-3ef9c3dbfedd\") " pod="openshift-network-operator/iptables-alerter-hrt8r"
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821347    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bvqk\" (UniqueName: \"kubernetes.io/projected/794e1bba-9e19-4e85-af4a-d0cf61fba88f-kube-api-access-2bvqk\") pod \"node-ca-k5dwb\" (UID: \"794e1bba-9e19-4e85-af4a-d0cf61fba88f\") " pod="openshift-image-registry/node-ca-k5dwb"
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821372    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb34b062-1e4c-4b7c-b23f-6bd80497b334-env-overrides\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.821496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821438    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-var-lib-openvswitch\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821463    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-run-openvswitch\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821466    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f3a7bc8-0c54-454a-a8fd-bb8060f466ae-konnectivity-ca\") pod \"konnectivity-agent-ccwjz\" (UID: \"8f3a7bc8-0c54-454a-a8fd-bb8060f466ae\") " pod="kube-system/konnectivity-agent-ccwjz"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821487    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kd46p\" (UniqueName: \"kubernetes.io/projected/eb34b062-1e4c-4b7c-b23f-6bd80497b334-kube-api-access-kd46p\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821513    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-etc-openvswitch\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821542    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-run-ovn-kubernetes\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821567    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb34b062-1e4c-4b7c-b23f-6bd80497b334-ovn-node-metrics-cert\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821593    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb34b062-1e4c-4b7c-b23f-6bd80497b334-ovnkube-config\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821615    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwqbv\" (UniqueName: \"kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv\") pod \"network-check-target-ztv72\" (UID: \"2f28e154-d9d4-42d9-aec8-e161a3614ca9\") " pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821654    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-run-netns\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821664    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb34b062-1e4c-4b7c-b23f-6bd80497b334-ovnkube-script-lib\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821671    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3fc7985-ac36-48b1-8634-3ef9c3dbfedd-iptables-alerter-script\") pod \"iptables-alerter-hrt8r\" (UID: \"a3fc7985-ac36-48b1-8634-3ef9c3dbfedd\") " pod="openshift-network-operator/iptables-alerter-hrt8r"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821682    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-systemd-units\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821709    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821723    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-run-ovn-kubernetes\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821753    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-cni-bin\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821824    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-cni-bin\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.822327 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821865    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb34b062-1e4c-4b7c-b23f-6bd80497b334-env-overrides\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.823019 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821949    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-systemd-units\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.823019 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.821994    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-run-netns\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.823019 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.822025    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-run-systemd\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.823019 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.822039    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.823019 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.822081    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-run-ovn\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.823019 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.822103    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-var-lib-openvswitch\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.823019 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.822147    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-etc-openvswitch\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.823019 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.822183    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb34b062-1e4c-4b7c-b23f-6bd80497b334-run-openvswitch\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.823019 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.822204    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb34b062-1e4c-4b7c-b23f-6bd80497b334-ovnkube-config\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.823019 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.822413    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/794e1bba-9e19-4e85-af4a-d0cf61fba88f-serviceca\") pod \"node-ca-k5dwb\" (UID: \"794e1bba-9e19-4e85-af4a-d0cf61fba88f\") " pod="openshift-image-registry/node-ca-k5dwb"
Jun 03 16:44:20.823902 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.823883    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f3a7bc8-0c54-454a-a8fd-bb8060f466ae-agent-certs\") pod \"konnectivity-agent-ccwjz\" (UID: \"8f3a7bc8-0c54-454a-a8fd-bb8060f466ae\") " pod="kube-system/konnectivity-agent-ccwjz"
Jun 03 16:44:20.824145 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.824126    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb34b062-1e4c-4b7c-b23f-6bd80497b334-ovn-node-metrics-cert\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.835436 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:20.835092    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 16:44:20.835436 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:20.835117    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 16:44:20.835436 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:20.835132    2563 projected.go:194] Error preparing data for projected volume kube-api-access-kwqbv for pod openshift-network-diagnostics/network-check-target-ztv72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 16:44:20.835436 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:20.835285    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv podName:2f28e154-d9d4-42d9-aec8-e161a3614ca9 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:21.335248621 +0000 UTC m=+3.056140907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kwqbv" (UniqueName: "kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv") pod "network-check-target-ztv72" (UID: "2f28e154-d9d4-42d9-aec8-e161a3614ca9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 16:44:20.835436 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.835353    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tqzt\" (UniqueName: \"kubernetes.io/projected/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-kube-api-access-6tqzt\") pod \"network-metrics-daemon-82l8r\" (UID: \"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff\") " pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:20.836291 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.836250    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq7kg\" (UniqueName: \"kubernetes.io/projected/a3fc7985-ac36-48b1-8634-3ef9c3dbfedd-kube-api-access-rq7kg\") pod \"iptables-alerter-hrt8r\" (UID: \"a3fc7985-ac36-48b1-8634-3ef9c3dbfedd\") " pod="openshift-network-operator/iptables-alerter-hrt8r"
Jun 03 16:44:20.836943 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.836921    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bvqk\" (UniqueName: \"kubernetes.io/projected/794e1bba-9e19-4e85-af4a-d0cf61fba88f-kube-api-access-2bvqk\") pod \"node-ca-k5dwb\" (UID: \"794e1bba-9e19-4e85-af4a-d0cf61fba88f\") " pod="openshift-image-registry/node-ca-k5dwb"
Jun 03 16:44:20.837065 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.836981    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd46p\" (UniqueName: \"kubernetes.io/projected/eb34b062-1e4c-4b7c-b23f-6bd80497b334-kube-api-access-kd46p\") pod \"ovnkube-node-27p8j\" (UID: \"eb34b062-1e4c-4b7c-b23f-6bd80497b334\") " pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:20.844491 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.844439    2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 16:44:20.918921 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.918888    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lpn2p"
Jun 03 16:44:20.927161 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.927141    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sjspd"
Jun 03 16:44:20.936817 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.936799    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k2bzr"
Jun 03 16:44:20.941285 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.941267    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rqqzj"
Jun 03 16:44:20.949772 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.949755    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hrt8r"
Jun 03 16:44:20.956292 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.956276    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5"
Jun 03 16:44:20.963835 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.963815    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ccwjz"
Jun 03 16:44:20.972322 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.972306    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k5dwb"
Jun 03 16:44:20.977010 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:20.976976    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:21.324082 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:21.323988    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs\") pod \"network-metrics-daemon-82l8r\" (UID: \"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff\") " pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:21.324228 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:21.324145    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 16:44:21.324228 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:21.324222    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs podName:3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff nodeName:}" failed. No retries permitted until 2026-06-03 16:44:22.324203016 +0000 UTC m=+4.045095287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs") pod "network-metrics-daemon-82l8r" (UID: "3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 16:44:21.424578 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:21.424552    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwqbv\" (UniqueName: \"kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv\") pod \"network-check-target-ztv72\" (UID: \"2f28e154-d9d4-42d9-aec8-e161a3614ca9\") " pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:21.424709 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:21.424695    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 16:44:21.424764 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:21.424712    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 16:44:21.424764 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:21.424721    2563 projected.go:194] Error preparing data for projected volume kube-api-access-kwqbv for pod openshift-network-diagnostics/network-check-target-ztv72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 16:44:21.424838 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:21.424783    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv podName:2f28e154-d9d4-42d9-aec8-e161a3614ca9 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:22.424769969 +0000 UTC m=+4.145662244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwqbv" (UniqueName: "kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv") pod "network-check-target-ztv72" (UID: "2f28e154-d9d4-42d9-aec8-e161a3614ca9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 16:44:21.437296 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:21.437267    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd19049a5_6916_4d4f_8a64_2f9968f534b3.slice/crio-11274b320e7bc0a6c0e4ac09e1c375324c6b6e61e52f027954743e7dd0b70976 WatchSource:0}: Error finding container 11274b320e7bc0a6c0e4ac09e1c375324c6b6e61e52f027954743e7dd0b70976: Status 404 returned error can't find the container with id 11274b320e7bc0a6c0e4ac09e1c375324c6b6e61e52f027954743e7dd0b70976
Jun 03 16:44:21.438539 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:21.438494    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5759cb_a305_41d7_90d6_29af458371a2.slice/crio-bc68aa094080dd6bd163907bb54de126ac196657757cb8854327d76258560a37 WatchSource:0}: Error finding container bc68aa094080dd6bd163907bb54de126ac196657757cb8854327d76258560a37: Status 404 returned error can't find the container with id bc68aa094080dd6bd163907bb54de126ac196657757cb8854327d76258560a37
Jun 03 16:44:21.439368 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:21.439347    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3fc7985_ac36_48b1_8634_3ef9c3dbfedd.slice/crio-0bfaa9a37da389de3cef6c8b2b2427bf5526d036b760f4dfa189e20570fcd9df WatchSource:0}: Error finding container 0bfaa9a37da389de3cef6c8b2b2427bf5526d036b760f4dfa189e20570fcd9df: Status 404 returned error can't find the container with id 0bfaa9a37da389de3cef6c8b2b2427bf5526d036b760f4dfa189e20570fcd9df
Jun 03 16:44:21.440151 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:21.440092    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f3a7bc8_0c54_454a_a8fd_bb8060f466ae.slice/crio-841400897fedb842de1d488d88e9e7b546330a3cd6efa363a253d67194bfefd8 WatchSource:0}: Error finding container 841400897fedb842de1d488d88e9e7b546330a3cd6efa363a253d67194bfefd8: Status 404 returned error can't find the container with id 841400897fedb842de1d488d88e9e7b546330a3cd6efa363a253d67194bfefd8
Jun 03 16:44:21.442329 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:21.442266    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b323cd_77ab_489a_b0d2_8e2857600a35.slice/crio-49c981cb0237c0fd7d01072ec2f4720d743dd7f9a5216f5eaa0858043db959a8 WatchSource:0}: Error finding container 49c981cb0237c0fd7d01072ec2f4720d743dd7f9a5216f5eaa0858043db959a8: Status 404 returned error can't find the container with id 49c981cb0237c0fd7d01072ec2f4720d743dd7f9a5216f5eaa0858043db959a8
Jun 03 16:44:21.443572 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:21.443552    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca235535_73f8_4549_bf3c_b7a3491f2b90.slice/crio-8b7e6f40e33d64a208d616a61e846d7e084b3189df735f02b46b7b9a6538a117 WatchSource:0}: Error finding container 8b7e6f40e33d64a208d616a61e846d7e084b3189df735f02b46b7b9a6538a117: Status 404 returned error can't find the container with id 8b7e6f40e33d64a208d616a61e846d7e084b3189df735f02b46b7b9a6538a117
Jun 03 16:44:21.444903 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:21.444811    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03882a67_ec75_4d9e_af70_6f810fb5594e.slice/crio-f5e4e8439aa515bc50305a68d674fc95eff015be5ab6bf1ea3a35b34d9452fbe WatchSource:0}: Error finding container f5e4e8439aa515bc50305a68d674fc95eff015be5ab6bf1ea3a35b34d9452fbe: Status 404 returned error can't find the container with id f5e4e8439aa515bc50305a68d674fc95eff015be5ab6bf1ea3a35b34d9452fbe
Jun 03 16:44:21.446332 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:44:21.446307    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb34b062_1e4c_4b7c_b23f_6bd80497b334.slice/crio-62a51bedeb655b070c87db21b5051027a04c0d8bcf9e518c3a71a98941022908 WatchSource:0}: Error finding container 62a51bedeb655b070c87db21b5051027a04c0d8bcf9e518c3a71a98941022908: Status 404 returned error can't find the container with id 62a51bedeb655b070c87db21b5051027a04c0d8bcf9e518c3a71a98941022908
Jun 03 16:44:21.667216 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:21.667050    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 16:39:19 +0000 UTC" deadline="2027-10-29 05:00:44.016983448 +0000 UTC"
Jun 03 16:44:21.667216 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:21.667213    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12300h16m22.349773581s"
Jun 03 16:44:21.735276 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:21.735237    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k5dwb" event={"ID":"794e1bba-9e19-4e85-af4a-d0cf61fba88f","Type":"ContainerStarted","Data":"4dd68273c8fa39fb6fcdd60c6f9cfb25ca3dda9f0271eeb311a48efc4868b812"}
Jun 03 16:44:21.736353 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:21.736324    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k2bzr" event={"ID":"79b323cd-77ab-489a-b0d2-8e2857600a35","Type":"ContainerStarted","Data":"49c981cb0237c0fd7d01072ec2f4720d743dd7f9a5216f5eaa0858043db959a8"}
Jun 03 16:44:21.737505 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:21.737466    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjspd" event={"ID":"d19049a5-6916-4d4f-8a64-2f9968f534b3","Type":"ContainerStarted","Data":"11274b320e7bc0a6c0e4ac09e1c375324c6b6e61e52f027954743e7dd0b70976"}
Jun 03 16:44:21.739317 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:21.739282    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" event={"ID":"4cb8d9365434b9a544806a411e71ebb0","Type":"ContainerStarted","Data":"a7f46dbfb316196e476c7c3020fbf1c57311e344506e141cdf394a222fafdf56"}
Jun 03 16:44:21.740605 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:21.740580    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j" event={"ID":"eb34b062-1e4c-4b7c-b23f-6bd80497b334","Type":"ContainerStarted","Data":"62a51bedeb655b070c87db21b5051027a04c0d8bcf9e518c3a71a98941022908"}
Jun 03 16:44:21.741662 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:21.741632    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5" event={"ID":"03882a67-ec75-4d9e-af70-6f810fb5594e","Type":"ContainerStarted","Data":"f5e4e8439aa515bc50305a68d674fc95eff015be5ab6bf1ea3a35b34d9452fbe"}
Jun 03 16:44:21.742797 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:21.742747    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lpn2p" event={"ID":"ca235535-73f8-4549-bf3c-b7a3491f2b90","Type":"ContainerStarted","Data":"8b7e6f40e33d64a208d616a61e846d7e084b3189df735f02b46b7b9a6538a117"}
Jun 03 16:44:21.743891 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:21.743869    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ccwjz" event={"ID":"8f3a7bc8-0c54-454a-a8fd-bb8060f466ae","Type":"ContainerStarted","Data":"841400897fedb842de1d488d88e9e7b546330a3cd6efa363a253d67194bfefd8"}
Jun 03 16:44:21.744884 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:21.744861    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hrt8r" event={"ID":"a3fc7985-ac36-48b1-8634-3ef9c3dbfedd","Type":"ContainerStarted","Data":"0bfaa9a37da389de3cef6c8b2b2427bf5526d036b760f4dfa189e20570fcd9df"}
Jun 03 16:44:21.748873 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:21.748804    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rqqzj" event={"ID":"7e5759cb-a305-41d7-90d6-29af458371a2","Type":"ContainerStarted","Data":"bc68aa094080dd6bd163907bb54de126ac196657757cb8854327d76258560a37"}
Jun 03 16:44:21.750553 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:21.750528    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal" event={"ID":"ac4c8c9bbafe1b4ee435b19e9ed813ee","Type":"ContainerStarted","Data":"ea7d43b42bb7928befa40c2a559ffa987b5c3cbba535e893e4b713a90b5a4f27"}
Jun 03 16:44:22.332674 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:22.332636    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs\") pod \"network-metrics-daemon-82l8r\" (UID: \"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff\") " pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:22.332863 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:22.332810    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 16:44:22.332946 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:22.332880    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs podName:3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff nodeName:}" failed. No retries permitted until 2026-06-03 16:44:24.33285991 +0000 UTC m=+6.053752184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs") pod "network-metrics-daemon-82l8r" (UID: "3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 16:44:22.433852 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:22.433816    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwqbv\" (UniqueName: \"kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv\") pod \"network-check-target-ztv72\" (UID: \"2f28e154-d9d4-42d9-aec8-e161a3614ca9\") " pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:22.434036 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:22.434014    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 16:44:22.434099 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:22.434045    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 16:44:22.434099 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:22.434059    2563 projected.go:194] Error preparing data for projected volume kube-api-access-kwqbv for pod openshift-network-diagnostics/network-check-target-ztv72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 16:44:22.434210 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:22.434118    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv podName:2f28e154-d9d4-42d9-aec8-e161a3614ca9 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:24.434098528 +0000 UTC m=+6.154990801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwqbv" (UniqueName: "kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv") pod "network-check-target-ztv72" (UID: "2f28e154-d9d4-42d9-aec8-e161a3614ca9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 16:44:22.730505 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:22.727582    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:22.730505 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:22.727706    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:22.730505 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:22.729259    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:22.730505 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:22.729376    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:22.778758 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:22.777899    2563 generic.go:358] "Generic (PLEG): container finished" podID="4cb8d9365434b9a544806a411e71ebb0" containerID="a7f46dbfb316196e476c7c3020fbf1c57311e344506e141cdf394a222fafdf56" exitCode=0
Jun 03 16:44:22.779073 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:22.778974    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" event={"ID":"4cb8d9365434b9a544806a411e71ebb0","Type":"ContainerDied","Data":"a7f46dbfb316196e476c7c3020fbf1c57311e344506e141cdf394a222fafdf56"}
Jun 03 16:44:22.779073 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:22.779011    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" event={"ID":"4cb8d9365434b9a544806a411e71ebb0","Type":"ContainerStarted","Data":"9e1af0a6199110d17ca734a29e5d39c198c10066e66cfa352f21bb28d952d411"}
Jun 03 16:44:22.796165 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:22.796115    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal" podStartSLOduration=3.796097178 podStartE2EDuration="3.796097178s" podCreationTimestamp="2026-06-03 16:44:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:44:21.768597474 +0000 UTC m=+3.489489794" watchObservedRunningTime="2026-06-03 16:44:22.796097178 +0000 UTC m=+4.516989473"
Jun 03 16:44:24.350369 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:24.350334    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs\") pod \"network-metrics-daemon-82l8r\" (UID: \"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff\") " pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:24.350852 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:24.350485    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 16:44:24.350852 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:24.350557    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs podName:3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff nodeName:}" failed. No retries permitted until 2026-06-03 16:44:28.350538156 +0000 UTC m=+10.071430445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs") pod "network-metrics-daemon-82l8r" (UID: "3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 16:44:24.451428 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:24.451340    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwqbv\" (UniqueName: \"kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv\") pod \"network-check-target-ztv72\" (UID: \"2f28e154-d9d4-42d9-aec8-e161a3614ca9\") " pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:24.451589 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:24.451537    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 16:44:24.451589 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:24.451562    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 16:44:24.451589 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:24.451578    2563 projected.go:194] Error preparing data for projected volume kube-api-access-kwqbv for pod openshift-network-diagnostics/network-check-target-ztv72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 16:44:24.451712 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:24.451656    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv podName:2f28e154-d9d4-42d9-aec8-e161a3614ca9 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:28.451632327 +0000 UTC m=+10.172524600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwqbv" (UniqueName: "kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv") pod "network-check-target-ztv72" (UID: "2f28e154-d9d4-42d9-aec8-e161a3614ca9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 16:44:24.728235 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:24.727344    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:24.728235 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:24.727472    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:24.728235 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:24.727563    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:24.728235 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:24.727648    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:26.728567 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:26.728534    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:26.729019 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:26.728666    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:26.729019 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:26.728955    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:26.729149 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:26.729053    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:28.384510 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:28.384468    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs\") pod \"network-metrics-daemon-82l8r\" (UID: \"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff\") " pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:28.385020 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:28.384643    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 16:44:28.385020 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:28.384745    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs podName:3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff nodeName:}" failed. No retries permitted until 2026-06-03 16:44:36.384707848 +0000 UTC m=+18.105600126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs") pod "network-metrics-daemon-82l8r" (UID: "3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 16:44:28.485988 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:28.485950    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwqbv\" (UniqueName: \"kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv\") pod \"network-check-target-ztv72\" (UID: \"2f28e154-d9d4-42d9-aec8-e161a3614ca9\") " pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:28.486148 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:28.486113    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 16:44:28.486148 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:28.486131    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 16:44:28.486148 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:28.486144    2563 projected.go:194] Error preparing data for projected volume kube-api-access-kwqbv for pod openshift-network-diagnostics/network-check-target-ztv72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 16:44:28.486306 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:28.486218    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv podName:2f28e154-d9d4-42d9-aec8-e161a3614ca9 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:36.486199321 +0000 UTC m=+18.207091595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwqbv" (UniqueName: "kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv") pod "network-check-target-ztv72" (UID: "2f28e154-d9d4-42d9-aec8-e161a3614ca9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 16:44:28.728482 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:28.728399    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:28.728638 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:28.728488    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:28.728638 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:28.728596    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:28.728770 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:28.728690    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:30.727869 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:30.727808    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:30.728325 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:30.727808    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:30.728325 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:30.727952    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:30.728325 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:30.728034    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:31.798866 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:31.798770    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5" event={"ID":"03882a67-ec75-4d9e-af70-6f810fb5594e","Type":"ContainerStarted","Data":"518a418101ec7eb04a8734cbf5f6bad54234bc59942dfa779a116e6930cd1c14"}
Jun 03 16:44:31.800554 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:31.800515    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lpn2p" event={"ID":"ca235535-73f8-4549-bf3c-b7a3491f2b90","Type":"ContainerStarted","Data":"6e5f49af6da0305acb82059701e45663200c99739d0a8c69e78611b95c03cfe3"}
Jun 03 16:44:31.801989 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:31.801966    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ccwjz" event={"ID":"8f3a7bc8-0c54-454a-a8fd-bb8060f466ae","Type":"ContainerStarted","Data":"d02fb0750e91c018109da3daca15ca1458c54648a08bbc13915d2748748c3ac4"}
Jun 03 16:44:31.803419 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:31.803376    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rqqzj" event={"ID":"7e5759cb-a305-41d7-90d6-29af458371a2","Type":"ContainerStarted","Data":"3d4d71d5ca27987bd5241b263174e6b6ff9494631189ddb2b9fd05986aa64875"}
Jun 03 16:44:31.807432 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:31.805829    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k5dwb" event={"ID":"794e1bba-9e19-4e85-af4a-d0cf61fba88f","Type":"ContainerStarted","Data":"c7b0e000c4624cb74905c142db9c919aca85d6de16a7a9a25db76f8ad7e6b901"}
Jun 03 16:44:31.809178 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:31.808793    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjspd" event={"ID":"d19049a5-6916-4d4f-8a64-2f9968f534b3","Type":"ContainerStarted","Data":"bca5a04ae979a605856f8a78078c002305565a1868a42e9e424c74df7d3a89cd"}
Jun 03 16:44:31.819120 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:31.819075    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" podStartSLOduration=12.819043035 podStartE2EDuration="12.819043035s" podCreationTimestamp="2026-06-03 16:44:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:44:22.796684377 +0000 UTC m=+4.517576672" watchObservedRunningTime="2026-06-03 16:44:31.819043035 +0000 UTC m=+13.539935309"
Jun 03 16:44:31.819826 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:31.819767    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-lpn2p" podStartSLOduration=4.415771793 podStartE2EDuration="13.819755504s" podCreationTimestamp="2026-06-03 16:44:18 +0000 UTC" firstStartedPulling="2026-06-03 16:44:21.448131265 +0000 UTC m=+3.169023551" lastFinishedPulling="2026-06-03 16:44:30.852114985 +0000 UTC m=+12.573007262" observedRunningTime="2026-06-03 16:44:31.819120036 +0000 UTC m=+13.540012353" watchObservedRunningTime="2026-06-03 16:44:31.819755504 +0000 UTC m=+13.540647798"
Jun 03 16:44:31.861542 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:31.861503    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rqqzj" podStartSLOduration=4.337681642 podStartE2EDuration="13.861492189s" podCreationTimestamp="2026-06-03 16:44:18 +0000 UTC" firstStartedPulling="2026-06-03 16:44:21.44111748 +0000 UTC m=+3.162009752" lastFinishedPulling="2026-06-03 16:44:30.964928014 +0000 UTC m=+12.685820299" observedRunningTime="2026-06-03 16:44:31.861304697 +0000 UTC m=+13.582196989" watchObservedRunningTime="2026-06-03 16:44:31.861492189 +0000 UTC m=+13.582384482"
Jun 03 16:44:31.876844 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:31.876799    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ccwjz" podStartSLOduration=4.452602667 podStartE2EDuration="13.876785142s" podCreationTimestamp="2026-06-03 16:44:18 +0000 UTC" firstStartedPulling="2026-06-03 16:44:21.441962654 +0000 UTC m=+3.162854934" lastFinishedPulling="2026-06-03 16:44:30.866145134 +0000 UTC m=+12.587037409" observedRunningTime="2026-06-03 16:44:31.876332673 +0000 UTC m=+13.597224964" watchObservedRunningTime="2026-06-03 16:44:31.876785142 +0000 UTC m=+13.597677435"
Jun 03 16:44:32.728160 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:32.728077    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:32.728160 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:32.728121    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:32.728355 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:32.728211    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:32.728414 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:32.728383    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:32.812196 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:32.812142    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hrt8r" event={"ID":"a3fc7985-ac36-48b1-8634-3ef9c3dbfedd","Type":"ContainerStarted","Data":"c9ecbd98ff73d2edc3defeb297378fb0954209725f5d09fb1ef88af0f70b92c8"}
Jun 03 16:44:32.827609 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:32.827558    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hrt8r" podStartSLOduration=5.406822513 podStartE2EDuration="14.827541818s" podCreationTimestamp="2026-06-03 16:44:18 +0000 UTC" firstStartedPulling="2026-06-03 16:44:21.441860348 +0000 UTC m=+3.162752624" lastFinishedPulling="2026-06-03 16:44:30.862579643 +0000 UTC m=+12.583471929" observedRunningTime="2026-06-03 16:44:32.827222335 +0000 UTC m=+14.548114630" watchObservedRunningTime="2026-06-03 16:44:32.827541818 +0000 UTC m=+14.548434112"
Jun 03 16:44:32.827813 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:32.827787    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k5dwb" podStartSLOduration=4.43149476 podStartE2EDuration="13.827776374s" podCreationTimestamp="2026-06-03 16:44:19 +0000 UTC" firstStartedPulling="2026-06-03 16:44:21.449657432 +0000 UTC m=+3.170549703" lastFinishedPulling="2026-06-03 16:44:30.845939031 +0000 UTC m=+12.566831317" observedRunningTime="2026-06-03 16:44:31.890713614 +0000 UTC m=+13.611605908" watchObservedRunningTime="2026-06-03 16:44:32.827776374 +0000 UTC m=+14.548668667"
Jun 03 16:44:33.499748 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:33.499699    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ccwjz"
Jun 03 16:44:33.500371 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:33.500350    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ccwjz"
Jun 03 16:44:34.727697 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:34.727521    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:34.728161 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:34.727591    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:34.728161 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:34.727816    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:34.728161 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:34.727867    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:34.814971 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:34.814943    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 03 16:44:35.818454 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:35.818422    2563 generic.go:358] "Generic (PLEG): container finished" podID="d19049a5-6916-4d4f-8a64-2f9968f534b3" containerID="bca5a04ae979a605856f8a78078c002305565a1868a42e9e424c74df7d3a89cd" exitCode=0
Jun 03 16:44:35.819117 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:35.818474    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjspd" event={"ID":"d19049a5-6916-4d4f-8a64-2f9968f534b3","Type":"ContainerDied","Data":"bca5a04ae979a605856f8a78078c002305565a1868a42e9e424c74df7d3a89cd"}
Jun 03 16:44:36.448777 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:36.448739    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs\") pod \"network-metrics-daemon-82l8r\" (UID: \"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff\") " pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:36.448959 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:36.448847    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 16:44:36.448959 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:36.448921    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs podName:3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff nodeName:}" failed. No retries permitted until 2026-06-03 16:44:52.448903474 +0000 UTC m=+34.169795747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs") pod "network-metrics-daemon-82l8r" (UID: "3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 16:44:36.550018 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:36.549985    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwqbv\" (UniqueName: \"kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv\") pod \"network-check-target-ztv72\" (UID: \"2f28e154-d9d4-42d9-aec8-e161a3614ca9\") " pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:36.550190 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:36.550138    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 16:44:36.550190 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:36.550156    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 16:44:36.550190 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:36.550168    2563 projected.go:194] Error preparing data for projected volume kube-api-access-kwqbv for pod openshift-network-diagnostics/network-check-target-ztv72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 16:44:36.550315 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:36.550225    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv podName:2f28e154-d9d4-42d9-aec8-e161a3614ca9 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:52.550209542 +0000 UTC m=+34.271101832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwqbv" (UniqueName: "kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv") pod "network-check-target-ztv72" (UID: "2f28e154-d9d4-42d9-aec8-e161a3614ca9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 16:44:36.727513 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:36.727483    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:36.727691 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:36.727618    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:36.727691 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:36.727665    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:36.727819 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:36.727794    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:38.728463 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:38.728427    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:38.729031 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:38.728554    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:38.729031 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:38.728630    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:38.729031 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:38.728753    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:39.271177 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:39.271147    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ccwjz"
Jun 03 16:44:39.271389 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:39.271270    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 03 16:44:39.271689 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:39.271670    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ccwjz"
Jun 03 16:44:39.828309 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:39.828090    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k2bzr" event={"ID":"79b323cd-77ab-489a-b0d2-8e2857600a35","Type":"ContainerStarted","Data":"9de59e8a597ae40f47ae5efe8dc0c56e75c0524eeee96ac009e4d39bc15c70e1"}
Jun 03 16:44:39.836173 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:39.836060    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j" event={"ID":"eb34b062-1e4c-4b7c-b23f-6bd80497b334","Type":"ContainerStarted","Data":"b0353a64464a1bd78879b4f8b17398c96d0a9984a99c1275398457f9d97b378a"}
Jun 03 16:44:39.851208 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:39.850777    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-k2bzr" podStartSLOduration=3.586550514 podStartE2EDuration="21.85075823s" podCreationTimestamp="2026-06-03 16:44:18 +0000 UTC" firstStartedPulling="2026-06-03 16:44:21.445619237 +0000 UTC m=+3.166511526" lastFinishedPulling="2026-06-03 16:44:39.70982697 +0000 UTC m=+21.430719242" observedRunningTime="2026-06-03 16:44:39.850164771 +0000 UTC m=+21.571057064" watchObservedRunningTime="2026-06-03 16:44:39.85075823 +0000 UTC m=+21.571650516"
Jun 03 16:44:39.859747 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:39.859656    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 03 16:44:40.675178 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:40.675077    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T16:44:39.859677616Z","UUID":"b4e25ae4-96f4-4ec7-944d-8fa4d7a88b00","Handler":null,"Name":"","Endpoint":""}
Jun 03 16:44:40.677087 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:40.677063    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 03 16:44:40.677232 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:40.677095    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 03 16:44:40.727878 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:40.727844    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:40.728048 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:40.727845    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:40.728048 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:40.727993    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:40.728174 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:40.728042    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:40.840782 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:40.840549    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j" event={"ID":"eb34b062-1e4c-4b7c-b23f-6bd80497b334","Type":"ContainerStarted","Data":"d63783ea50c7a44118702a7abcedd0c2a2776e67ed97de707352bdca4aa7a0fd"}
Jun 03 16:44:40.841149 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:40.840796    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j" event={"ID":"eb34b062-1e4c-4b7c-b23f-6bd80497b334","Type":"ContainerStarted","Data":"58f4555ceb92656a44de33570465fe5287c5b40479b9f24c58084eed4aeaafcf"}
Jun 03 16:44:40.841149 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:40.840809    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j" event={"ID":"eb34b062-1e4c-4b7c-b23f-6bd80497b334","Type":"ContainerStarted","Data":"cd5857a9a03eb1f8245468e409fca1ed846dd47f316c057a1368a057062ec726"}
Jun 03 16:44:40.841149 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:40.840821    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j" event={"ID":"eb34b062-1e4c-4b7c-b23f-6bd80497b334","Type":"ContainerStarted","Data":"e4221d0ad04f70634b044b5765e4b8adb82d2bf763259be58c61e53c8acbb548"}
Jun 03 16:44:40.841149 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:40.840834    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j" event={"ID":"eb34b062-1e4c-4b7c-b23f-6bd80497b334","Type":"ContainerStarted","Data":"1d8c4c2f121babd97016c3828738e241eb5b23894aa027933269185244ae05bd"}
Jun 03 16:44:40.842762 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:40.842716    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5" event={"ID":"03882a67-ec75-4d9e-af70-6f810fb5594e","Type":"ContainerStarted","Data":"78751d86fc668db4ce6425ef958e8add96370329e06c843736e53ed6f7416901"}
Jun 03 16:44:40.842762 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:40.842764    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5" event={"ID":"03882a67-ec75-4d9e-af70-6f810fb5594e","Type":"ContainerStarted","Data":"ac55e5db4869487e79f5ac2a030c8a2b0f25495c660bbd8a0b138efa1b243b88"}
Jun 03 16:44:40.861487 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:40.861438    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8m6t5" podStartSLOduration=3.56749509 podStartE2EDuration="22.861422478s" podCreationTimestamp="2026-06-03 16:44:18 +0000 UTC" firstStartedPulling="2026-06-03 16:44:21.447878564 +0000 UTC m=+3.168770850" lastFinishedPulling="2026-06-03 16:44:40.741805951 +0000 UTC m=+22.462698238" observedRunningTime="2026-06-03 16:44:40.86118782 +0000 UTC m=+22.582080117" watchObservedRunningTime="2026-06-03 16:44:40.861422478 +0000 UTC m=+22.582314772"
Jun 03 16:44:42.728295 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:42.728255    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:42.728719 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:42.728299    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:42.728719 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:42.728387    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:42.728719 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:42.728518    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:42.849568 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:42.849534    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j" event={"ID":"eb34b062-1e4c-4b7c-b23f-6bd80497b334","Type":"ContainerStarted","Data":"65399af8439e96b1da463df441df47209d9fb31a1d7274f56a8cf6f1da9f3710"}
Jun 03 16:44:44.728119 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:44.728088    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:44.728554 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:44.728132    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:44.728554 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:44.728274    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:44.728554 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:44.728408    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:45.856646 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:45.856615    2563 generic.go:358] "Generic (PLEG): container finished" podID="d19049a5-6916-4d4f-8a64-2f9968f534b3" containerID="3a7ff1f52357f833f9f0c7efe3b85c7bc06dc5b89b9d918c7ba957a3b0dd5ea9" exitCode=0
Jun 03 16:44:45.857372 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:45.856681    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjspd" event={"ID":"d19049a5-6916-4d4f-8a64-2f9968f534b3","Type":"ContainerDied","Data":"3a7ff1f52357f833f9f0c7efe3b85c7bc06dc5b89b9d918c7ba957a3b0dd5ea9"}
Jun 03 16:44:45.859815 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:45.859795    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j" event={"ID":"eb34b062-1e4c-4b7c-b23f-6bd80497b334","Type":"ContainerStarted","Data":"11b0b8ba39975d61c089b7ebcf9b97babc9d0083f453838c5bf4df460647339c"}
Jun 03 16:44:45.860107 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:45.860087    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:45.875998 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:45.875981    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:45.904911 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:45.904873    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j" podStartSLOduration=8.644363973 podStartE2EDuration="26.904862094s" podCreationTimestamp="2026-06-03 16:44:19 +0000 UTC" firstStartedPulling="2026-06-03 16:44:21.4496228 +0000 UTC m=+3.170515076" lastFinishedPulling="2026-06-03 16:44:39.710120916 +0000 UTC m=+21.431013197" observedRunningTime="2026-06-03 16:44:45.904822133 +0000 UTC m=+27.625714429" watchObservedRunningTime="2026-06-03 16:44:45.904862094 +0000 UTC m=+27.625754387"
Jun 03 16:44:46.727979 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:46.727750    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:46.728119 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:46.727779    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:46.728119 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:46.728100    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:46.728184 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:46.728122    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:46.865618 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:46.865582    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjspd" event={"ID":"d19049a5-6916-4d4f-8a64-2f9968f534b3","Type":"ContainerStarted","Data":"80035c838e2641227cbe572f4b979354d5c5ae14734fb60839e4517a226c7293"}
Jun 03 16:44:46.866067 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:46.866013    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:46.866067 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:46.866051    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:46.879911 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:46.879890    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:44:47.222126 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:47.222086    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-82l8r"]
Jun 03 16:44:47.222280 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:47.222232    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:47.222344 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:47.222325    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:47.224832 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:47.224807    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ztv72"]
Jun 03 16:44:47.224925 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:47.224904    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:47.224996 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:47.224976    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:47.868977 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:47.868944    2563 generic.go:358] "Generic (PLEG): container finished" podID="d19049a5-6916-4d4f-8a64-2f9968f534b3" containerID="80035c838e2641227cbe572f4b979354d5c5ae14734fb60839e4517a226c7293" exitCode=0
Jun 03 16:44:47.869372 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:47.869018    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjspd" event={"ID":"d19049a5-6916-4d4f-8a64-2f9968f534b3","Type":"ContainerDied","Data":"80035c838e2641227cbe572f4b979354d5c5ae14734fb60839e4517a226c7293"}
Jun 03 16:44:48.728227 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:48.728201    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:48.728338 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:48.728284    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:48.728392 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:48.728376    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:48.728493 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:48.728472    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:48.872876 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:48.872799    2563 generic.go:358] "Generic (PLEG): container finished" podID="d19049a5-6916-4d4f-8a64-2f9968f534b3" containerID="a6fd782f64ad8bed00ead22145d2867a7c8070c18a93a816d8b6cf5575f7b93a" exitCode=0
Jun 03 16:44:48.872876 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:48.872866    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjspd" event={"ID":"d19049a5-6916-4d4f-8a64-2f9968f534b3","Type":"ContainerDied","Data":"a6fd782f64ad8bed00ead22145d2867a7c8070c18a93a816d8b6cf5575f7b93a"}
Jun 03 16:44:50.731154 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:50.730957    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:50.731557 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:50.730965    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:50.731557 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:50.731251    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztv72" podUID="2f28e154-d9d4-42d9-aec8-e161a3614ca9"
Jun 03 16:44:50.731557 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:50.731355    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:44:52.468087 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.467996    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs\") pod \"network-metrics-daemon-82l8r\" (UID: \"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff\") " pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:52.468561 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:52.468173    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 16:44:52.468561 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:52.468255    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs podName:3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff nodeName:}" failed. No retries permitted until 2026-06-03 16:45:24.468235145 +0000 UTC m=+66.189127435 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs") pod "network-metrics-daemon-82l8r" (UID: "3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 16:44:52.569145 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.569112    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwqbv\" (UniqueName: \"kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv\") pod \"network-check-target-ztv72\" (UID: \"2f28e154-d9d4-42d9-aec8-e161a3614ca9\") " pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:52.569316 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:52.569232    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 16:44:52.569316 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:52.569248    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 16:44:52.569316 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:52.569256    2563 projected.go:194] Error preparing data for projected volume kube-api-access-kwqbv for pod openshift-network-diagnostics/network-check-target-ztv72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 16:44:52.569316 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:52.569303    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv podName:2f28e154-d9d4-42d9-aec8-e161a3614ca9 nodeName:}" failed. No retries permitted until 2026-06-03 16:45:24.569289623 +0000 UTC m=+66.290181894 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwqbv" (UniqueName: "kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv") pod "network-check-target-ztv72" (UID: "2f28e154-d9d4-42d9-aec8-e161a3614ca9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 16:44:52.614511 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.614475    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeReady"
Jun 03 16:44:52.614667 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.614626    2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
Jun 03 16:44:52.666299 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.666262    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qd8tz"]
Jun 03 16:44:52.745258 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.745228    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nvvnn"]
Jun 03 16:44:52.745401 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.745379    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:44:52.748034 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.747999    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 03 16:44:52.748388 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.748371    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 03 16:44:52.748470 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.748419    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g6lvq\""
Jun 03 16:44:52.767623 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.767597    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:44:52.767772 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.767636    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:44:52.767772 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.767707    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:44:52.770354 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.770334    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h6q5l\""
Jun 03 16:44:52.770476 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.770335    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 03 16:44:52.770476 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.770382    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qd8tz"]
Jun 03 16:44:52.770476 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.770407    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nvvnn"]
Jun 03 16:44:52.770476 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.770374    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 16:44:52.770476 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.770442    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 16:44:52.770476 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.770459    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 03 16:44:52.770476 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.770469    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6fvvv\""
Jun 03 16:44:52.770761 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.770636    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 03 16:44:52.770761 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.770700    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vw2lw\""
Jun 03 16:44:52.770761 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.770701    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 16:44:52.870112 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.870077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95cf9da9-dd78-4443-95a9-90e29b37c406-tmp-dir\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:44:52.870295 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.870192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:44:52.870295 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.870268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert\") pod \"ingress-canary-nvvnn\" (UID: \"fd962829-ced6-4a41-9570-0dc87e34f793\") " pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:44:52.870295 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.870294    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/95cf9da9-dd78-4443-95a9-90e29b37c406-config-volume\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:44:52.870440 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.870362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq5df\" (UniqueName: \"kubernetes.io/projected/fd962829-ced6-4a41-9570-0dc87e34f793-kube-api-access-mq5df\") pod \"ingress-canary-nvvnn\" (UID: \"fd962829-ced6-4a41-9570-0dc87e34f793\") " pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:44:52.870440 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.870403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nlks\" (UniqueName: \"kubernetes.io/projected/95cf9da9-dd78-4443-95a9-90e29b37c406-kube-api-access-8nlks\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:44:52.971628 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.971586    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert\") pod \"ingress-canary-nvvnn\" (UID: \"fd962829-ced6-4a41-9570-0dc87e34f793\") " pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:44:52.971628 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.971629    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/95cf9da9-dd78-4443-95a9-90e29b37c406-config-volume\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:44:52.971895 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.971656    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mq5df\" (UniqueName: \"kubernetes.io/projected/fd962829-ced6-4a41-9570-0dc87e34f793-kube-api-access-mq5df\") pod \"ingress-canary-nvvnn\" (UID: \"fd962829-ced6-4a41-9570-0dc87e34f793\") " pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:44:52.971895 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.971677    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8nlks\" (UniqueName: \"kubernetes.io/projected/95cf9da9-dd78-4443-95a9-90e29b37c406-kube-api-access-8nlks\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:44:52.971895 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.971694    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95cf9da9-dd78-4443-95a9-90e29b37c406-tmp-dir\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:44:52.971895 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.971752    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:44:52.971895 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:52.971749    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 16:44:52.971895 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:52.971840    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert podName:fd962829-ced6-4a41-9570-0dc87e34f793 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:53.471824346 +0000 UTC m=+35.192716618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert") pod "ingress-canary-nvvnn" (UID: "fd962829-ced6-4a41-9570-0dc87e34f793") : secret "canary-serving-cert" not found
Jun 03 16:44:52.971895 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:52.971857    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 16:44:52.972261 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:52.971911    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls podName:95cf9da9-dd78-4443-95a9-90e29b37c406 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:53.471895455 +0000 UTC m=+35.192787740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls") pod "dns-default-qd8tz" (UID: "95cf9da9-dd78-4443-95a9-90e29b37c406") : secret "dns-default-metrics-tls" not found
Jun 03 16:44:52.972261 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.972114    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95cf9da9-dd78-4443-95a9-90e29b37c406-tmp-dir\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:44:52.972353 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.972336    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/95cf9da9-dd78-4443-95a9-90e29b37c406-config-volume\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:44:52.984052 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.984027    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nlks\" (UniqueName: \"kubernetes.io/projected/95cf9da9-dd78-4443-95a9-90e29b37c406-kube-api-access-8nlks\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:44:52.984228 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:52.984210    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq5df\" (UniqueName: \"kubernetes.io/projected/fd962829-ced6-4a41-9570-0dc87e34f793-kube-api-access-mq5df\") pod \"ingress-canary-nvvnn\" (UID: \"fd962829-ced6-4a41-9570-0dc87e34f793\") " pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:44:53.475305 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:53.475271    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:44:53.475769 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:53.475316    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert\") pod \"ingress-canary-nvvnn\" (UID: \"fd962829-ced6-4a41-9570-0dc87e34f793\") " pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:44:53.475769 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:53.475419    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 16:44:53.475769 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:53.475421    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 16:44:53.475769 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:53.475470    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert podName:fd962829-ced6-4a41-9570-0dc87e34f793 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:54.47545583 +0000 UTC m=+36.196348101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert") pod "ingress-canary-nvvnn" (UID: "fd962829-ced6-4a41-9570-0dc87e34f793") : secret "canary-serving-cert" not found
Jun 03 16:44:53.475769 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:53.475482    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls podName:95cf9da9-dd78-4443-95a9-90e29b37c406 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:54.4754762 +0000 UTC m=+36.196368472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls") pod "dns-default-qd8tz" (UID: "95cf9da9-dd78-4443-95a9-90e29b37c406") : secret "dns-default-metrics-tls" not found
Jun 03 16:44:54.482839 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:54.482780    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:44:54.483442 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:54.482957    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 16:44:54.483442 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:54.482959    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert\") pod \"ingress-canary-nvvnn\" (UID: \"fd962829-ced6-4a41-9570-0dc87e34f793\") " pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:44:54.483442 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:54.483027    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls podName:95cf9da9-dd78-4443-95a9-90e29b37c406 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:56.483007663 +0000 UTC m=+38.203899959 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls") pod "dns-default-qd8tz" (UID: "95cf9da9-dd78-4443-95a9-90e29b37c406") : secret "dns-default-metrics-tls" not found
Jun 03 16:44:54.483442 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:54.483043    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 16:44:54.483442 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:54.483095    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert podName:fd962829-ced6-4a41-9570-0dc87e34f793 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:56.48307913 +0000 UTC m=+38.203971403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert") pod "ingress-canary-nvvnn" (UID: "fd962829-ced6-4a41-9570-0dc87e34f793") : secret "canary-serving-cert" not found
Jun 03 16:44:56.498393 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:56.498359    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:44:56.498825 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:56.498417    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert\") pod \"ingress-canary-nvvnn\" (UID: \"fd962829-ced6-4a41-9570-0dc87e34f793\") " pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:44:56.498825 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:56.498520    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 16:44:56.498825 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:56.498557    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 16:44:56.498825 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:56.498600    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls podName:95cf9da9-dd78-4443-95a9-90e29b37c406 nodeName:}" failed. No retries permitted until 2026-06-03 16:45:00.498580726 +0000 UTC m=+42.219473020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls") pod "dns-default-qd8tz" (UID: "95cf9da9-dd78-4443-95a9-90e29b37c406") : secret "dns-default-metrics-tls" not found
Jun 03 16:44:56.498825 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:44:56.498617    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert podName:fd962829-ced6-4a41-9570-0dc87e34f793 nodeName:}" failed. No retries permitted until 2026-06-03 16:45:00.498610671 +0000 UTC m=+42.219502941 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert") pod "ingress-canary-nvvnn" (UID: "fd962829-ced6-4a41-9570-0dc87e34f793") : secret "canary-serving-cert" not found
Jun 03 16:44:56.890489 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:56.890459    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjspd" event={"ID":"d19049a5-6916-4d4f-8a64-2f9968f534b3","Type":"ContainerStarted","Data":"74c75d1990657b755ff1391812f69dd5700c89367ac1228584ad73ab5f59ce92"}
Jun 03 16:44:57.894254 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:57.894215    2563 generic.go:358] "Generic (PLEG): container finished" podID="d19049a5-6916-4d4f-8a64-2f9968f534b3" containerID="74c75d1990657b755ff1391812f69dd5700c89367ac1228584ad73ab5f59ce92" exitCode=0
Jun 03 16:44:57.894892 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:57.894275    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjspd" event={"ID":"d19049a5-6916-4d4f-8a64-2f9968f534b3","Type":"ContainerDied","Data":"74c75d1990657b755ff1391812f69dd5700c89367ac1228584ad73ab5f59ce92"}
Jun 03 16:44:58.898028 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:58.897989    2563 generic.go:358] "Generic (PLEG): container finished" podID="d19049a5-6916-4d4f-8a64-2f9968f534b3" containerID="ad900ce2b746dc249cc68d0e82edfa8827b97b590e7f47cc8b7406715519e1e7" exitCode=0
Jun 03 16:44:58.898393 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:58.898046    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjspd" event={"ID":"d19049a5-6916-4d4f-8a64-2f9968f534b3","Type":"ContainerDied","Data":"ad900ce2b746dc249cc68d0e82edfa8827b97b590e7f47cc8b7406715519e1e7"}
Jun 03 16:44:59.902775 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:59.902571    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjspd" event={"ID":"d19049a5-6916-4d4f-8a64-2f9968f534b3","Type":"ContainerStarted","Data":"5a8438808ed84ac6e54d05d2fd0fe693af0acd5e5d1998cbcd589289d691f071"}
Jun 03 16:44:59.928419 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:44:59.928375    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sjspd" podStartSLOduration=6.647985278 podStartE2EDuration="41.928363859s" podCreationTimestamp="2026-06-03 16:44:18 +0000 UTC" firstStartedPulling="2026-06-03 16:44:21.438831705 +0000 UTC m=+3.159723977" lastFinishedPulling="2026-06-03 16:44:56.719210282 +0000 UTC m=+38.440102558" observedRunningTime="2026-06-03 16:44:59.927952983 +0000 UTC m=+41.648845278" watchObservedRunningTime="2026-06-03 16:44:59.928363859 +0000 UTC m=+41.649256151"
Jun 03 16:45:00.525859 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:00.525828    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:45:00.526026 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:00.525871    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert\") pod \"ingress-canary-nvvnn\" (UID: \"fd962829-ced6-4a41-9570-0dc87e34f793\") " pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:45:00.526026 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:00.525989    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 16:45:00.526095 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:00.526029    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 16:45:00.526095 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:00.526068    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls podName:95cf9da9-dd78-4443-95a9-90e29b37c406 nodeName:}" failed. No retries permitted until 2026-06-03 16:45:08.526047991 +0000 UTC m=+50.246940279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls") pod "dns-default-qd8tz" (UID: "95cf9da9-dd78-4443-95a9-90e29b37c406") : secret "dns-default-metrics-tls" not found
Jun 03 16:45:00.526095 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:00.526083    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert podName:fd962829-ced6-4a41-9570-0dc87e34f793 nodeName:}" failed. No retries permitted until 2026-06-03 16:45:08.526076474 +0000 UTC m=+50.246968744 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert") pod "ingress-canary-nvvnn" (UID: "fd962829-ced6-4a41-9570-0dc87e34f793") : secret "canary-serving-cert" not found
Jun 03 16:45:08.578832 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:08.578786    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert\") pod \"ingress-canary-nvvnn\" (UID: \"fd962829-ced6-4a41-9570-0dc87e34f793\") " pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:45:08.579356 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:08.578869    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:45:08.579356 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:08.578940    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 16:45:08.579356 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:08.579005    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert podName:fd962829-ced6-4a41-9570-0dc87e34f793 nodeName:}" failed. No retries permitted until 2026-06-03 16:45:24.578989423 +0000 UTC m=+66.299881694 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert") pod "ingress-canary-nvvnn" (UID: "fd962829-ced6-4a41-9570-0dc87e34f793") : secret "canary-serving-cert" not found
Jun 03 16:45:08.579356 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:08.578946    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 16:45:08.579356 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:08.579075    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls podName:95cf9da9-dd78-4443-95a9-90e29b37c406 nodeName:}" failed. No retries permitted until 2026-06-03 16:45:24.579063476 +0000 UTC m=+66.299955747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls") pod "dns-default-qd8tz" (UID: "95cf9da9-dd78-4443-95a9-90e29b37c406") : secret "dns-default-metrics-tls" not found
Jun 03 16:45:18.883222 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:18.883194    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-27p8j"
Jun 03 16:45:24.477044 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:24.477006    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs\") pod \"network-metrics-daemon-82l8r\" (UID: \"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff\") " pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:45:24.480267 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:24.480246    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 16:45:24.488116 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:24.488098    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 16:45:24.488185 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:24.488154    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs podName:3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff nodeName:}" failed. No retries permitted until 2026-06-03 16:46:28.488138234 +0000 UTC m=+130.209030504 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs") pod "network-metrics-daemon-82l8r" (UID: "3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff") : secret "metrics-daemon-secret" not found
Jun 03 16:45:24.578024 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:24.577978    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwqbv\" (UniqueName: \"kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv\") pod \"network-check-target-ztv72\" (UID: \"2f28e154-d9d4-42d9-aec8-e161a3614ca9\") " pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:45:24.580924 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:24.580906    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 16:45:24.591191 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:24.591170    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 16:45:24.601640 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:24.601616    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwqbv\" (UniqueName: \"kubernetes.io/projected/2f28e154-d9d4-42d9-aec8-e161a3614ca9-kube-api-access-kwqbv\") pod \"network-check-target-ztv72\" (UID: \"2f28e154-d9d4-42d9-aec8-e161a3614ca9\") " pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:45:24.678707 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:24.678680    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:45:24.678822 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:24.678716    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert\") pod \"ingress-canary-nvvnn\" (UID: \"fd962829-ced6-4a41-9570-0dc87e34f793\") " pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:45:24.678869 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:24.678821    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 16:45:24.678869 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:24.678825    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 16:45:24.678931 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:24.678876    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert podName:fd962829-ced6-4a41-9570-0dc87e34f793 nodeName:}" failed. No retries permitted until 2026-06-03 16:45:56.678862286 +0000 UTC m=+98.399754558 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert") pod "ingress-canary-nvvnn" (UID: "fd962829-ced6-4a41-9570-0dc87e34f793") : secret "canary-serving-cert" not found
Jun 03 16:45:24.678931 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:24.678888    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls podName:95cf9da9-dd78-4443-95a9-90e29b37c406 nodeName:}" failed. No retries permitted until 2026-06-03 16:45:56.678882097 +0000 UTC m=+98.399774368 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls") pod "dns-default-qd8tz" (UID: "95cf9da9-dd78-4443-95a9-90e29b37c406") : secret "dns-default-metrics-tls" not found
Jun 03 16:45:24.886802 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:24.886707    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h6q5l\""
Jun 03 16:45:24.894079 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:24.894062    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:45:25.018469 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:25.018436    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ztv72"]
Jun 03 16:45:25.022087 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:45:25.022063    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f28e154_d9d4_42d9_aec8_e161a3614ca9.slice/crio-676f6db3428d1297374d64370b6d4803bda9b12c8912c9a8a56f07eac3f00c1c WatchSource:0}: Error finding container 676f6db3428d1297374d64370b6d4803bda9b12c8912c9a8a56f07eac3f00c1c: Status 404 returned error can't find the container with id 676f6db3428d1297374d64370b6d4803bda9b12c8912c9a8a56f07eac3f00c1c
Jun 03 16:45:25.948997 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:25.948956    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ztv72" event={"ID":"2f28e154-d9d4-42d9-aec8-e161a3614ca9","Type":"ContainerStarted","Data":"676f6db3428d1297374d64370b6d4803bda9b12c8912c9a8a56f07eac3f00c1c"}
Jun 03 16:45:29.957331 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:29.957296    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ztv72" event={"ID":"2f28e154-d9d4-42d9-aec8-e161a3614ca9","Type":"ContainerStarted","Data":"113e0cd0fd6177a41b06224e9bd30a5babc05957c1be7ce7feaa02215ff33460"}
Jun 03 16:45:29.957723 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:29.957415    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:45:29.974039 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:29.973999    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ztv72" podStartSLOduration=66.537319087 podStartE2EDuration="1m10.973987403s" podCreationTimestamp="2026-06-03 16:44:19 +0000 UTC" firstStartedPulling="2026-06-03 16:45:25.02388667 +0000 UTC m=+66.744778951" lastFinishedPulling="2026-06-03 16:45:29.46055498 +0000 UTC m=+71.181447267" observedRunningTime="2026-06-03 16:45:29.973376787 +0000 UTC m=+71.694269081" watchObservedRunningTime="2026-06-03 16:45:29.973987403 +0000 UTC m=+71.694879695"
Jun 03 16:45:56.697921 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:56.697881    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert\") pod \"ingress-canary-nvvnn\" (UID: \"fd962829-ced6-4a41-9570-0dc87e34f793\") " pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:45:56.698333 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:45:56.697949    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:45:56.698333 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:56.698045    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 16:45:56.698333 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:56.698109    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls podName:95cf9da9-dd78-4443-95a9-90e29b37c406 nodeName:}" failed. No retries permitted until 2026-06-03 16:47:00.698095649 +0000 UTC m=+162.418987920 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls") pod "dns-default-qd8tz" (UID: "95cf9da9-dd78-4443-95a9-90e29b37c406") : secret "dns-default-metrics-tls" not found
Jun 03 16:45:56.698333 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:56.698043    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 16:45:56.698333 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:45:56.698197    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert podName:fd962829-ced6-4a41-9570-0dc87e34f793 nodeName:}" failed. No retries permitted until 2026-06-03 16:47:00.698182587 +0000 UTC m=+162.419074878 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert") pod "ingress-canary-nvvnn" (UID: "fd962829-ced6-4a41-9570-0dc87e34f793") : secret "canary-serving-cert" not found
Jun 03 16:46:00.961158 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:00.961123    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ztv72"
Jun 03 16:46:20.344919 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.344883    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-886d6"]
Jun 03 16:46:20.346680 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.346664    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-886d6"
Jun 03 16:46:20.349229 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.349206    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jun 03 16:46:20.349322 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.349210    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2pqwf\""
Jun 03 16:46:20.349322 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.349211    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jun 03 16:46:20.355315 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.355295    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-886d6"]
Jun 03 16:46:20.442337 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.442310    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-57k47"]
Jun 03 16:46:20.443980 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.443967    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-57k47"
Jun 03 16:46:20.446789 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.446765    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jun 03 16:46:20.446789 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.446781    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ln4rp\""
Jun 03 16:46:20.446961 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.446781    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jun 03 16:46:20.446961 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.446781    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jun 03 16:46:20.449745 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.447402    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jun 03 16:46:20.451560 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.451537    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-phgpp"]
Jun 03 16:46:20.453444 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.453425    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7dc7c5c64f-c4q48"]
Jun 03 16:46:20.453522 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.453508    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:20.454564 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.454544    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85qsk\" (UniqueName: \"kubernetes.io/projected/f4b0a205-48a4-43d3-886a-f2a0c1a4a88b-kube-api-access-85qsk\") pod \"volume-data-source-validator-7598fd5bd-886d6\" (UID: \"f4b0a205-48a4-43d3-886a-f2a0c1a4a88b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-886d6"
Jun 03 16:46:20.455030 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.455011    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:20.455873 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.455856    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jd4ll\""
Jun 03 16:46:20.456100 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.456079    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-57k47"]
Jun 03 16:46:20.456200 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.456182    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jun 03 16:46:20.456387 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.456369    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jun 03 16:46:20.456479 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.456369    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jun 03 16:46:20.459840 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.459713    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jun 03 16:46:20.459840 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.459722    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jun 03 16:46:20.460519 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.459846    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 03 16:46:20.460519 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.459904    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jun 03 16:46:20.460519 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.459982    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-k6xjp\""
Jun 03 16:46:20.460519 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.460044    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 03 16:46:20.460519 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.460180    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jun 03 16:46:20.460519 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.460235    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jun 03 16:46:20.467748 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.467708    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-phgpp"]
Jun 03 16:46:20.468354 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.468337    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jun 03 16:46:20.473913 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.473894    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7dc7c5c64f-c4q48"]
Jun 03 16:46:20.555095 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.555062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:20.555095 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.555096    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58250ca1-fc0c-443c-bc0b-adc42eb0f95e-serving-cert\") pod \"service-ca-operator-69877444c-57k47\" (UID: \"58250ca1-fc0c-443c-bc0b-adc42eb0f95e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-57k47"
Jun 03 16:46:20.555282 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.555149    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4rvt\" (UniqueName: \"kubernetes.io/projected/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-kube-api-access-w4rvt\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:20.555282 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.555246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccbe3e7a-fea1-419f-af7f-bc26eaa0089e-trusted-ca\") pod \"console-operator-86d7c6cc77-phgpp\" (UID: \"ccbe3e7a-fea1-419f-af7f-bc26eaa0089e\") " pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:20.555282 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.555269    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccbe3e7a-fea1-419f-af7f-bc26eaa0089e-config\") pod \"console-operator-86d7c6cc77-phgpp\" (UID: \"ccbe3e7a-fea1-419f-af7f-bc26eaa0089e\") " pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:20.555435 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.555290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:20.555435 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.555343    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccbe3e7a-fea1-419f-af7f-bc26eaa0089e-serving-cert\") pod \"console-operator-86d7c6cc77-phgpp\" (UID: \"ccbe3e7a-fea1-419f-af7f-bc26eaa0089e\") " pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:20.555435 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.555403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58250ca1-fc0c-443c-bc0b-adc42eb0f95e-config\") pod \"service-ca-operator-69877444c-57k47\" (UID: \"58250ca1-fc0c-443c-bc0b-adc42eb0f95e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-57k47"
Jun 03 16:46:20.555435 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.555431    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-stats-auth\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:20.555592 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.555456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w2qv\" (UniqueName: \"kubernetes.io/projected/ccbe3e7a-fea1-419f-af7f-bc26eaa0089e-kube-api-access-9w2qv\") pod \"console-operator-86d7c6cc77-phgpp\" (UID: \"ccbe3e7a-fea1-419f-af7f-bc26eaa0089e\") " pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:20.555592 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.555514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4x9k\" (UniqueName: \"kubernetes.io/projected/58250ca1-fc0c-443c-bc0b-adc42eb0f95e-kube-api-access-t4x9k\") pod \"service-ca-operator-69877444c-57k47\" (UID: \"58250ca1-fc0c-443c-bc0b-adc42eb0f95e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-57k47"
Jun 03 16:46:20.555592 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.555552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-default-certificate\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:20.555700 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.555599    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85qsk\" (UniqueName: \"kubernetes.io/projected/f4b0a205-48a4-43d3-886a-f2a0c1a4a88b-kube-api-access-85qsk\") pod \"volume-data-source-validator-7598fd5bd-886d6\" (UID: \"f4b0a205-48a4-43d3-886a-f2a0c1a4a88b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-886d6"
Jun 03 16:46:20.570557 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.570527    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85qsk\" (UniqueName: \"kubernetes.io/projected/f4b0a205-48a4-43d3-886a-f2a0c1a4a88b-kube-api-access-85qsk\") pod \"volume-data-source-validator-7598fd5bd-886d6\" (UID: \"f4b0a205-48a4-43d3-886a-f2a0c1a4a88b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-886d6"
Jun 03 16:46:20.654715 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.654625    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-886d6"
Jun 03 16:46:20.656448 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.656426    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:20.656527 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.656464    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58250ca1-fc0c-443c-bc0b-adc42eb0f95e-serving-cert\") pod \"service-ca-operator-69877444c-57k47\" (UID: \"58250ca1-fc0c-443c-bc0b-adc42eb0f95e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-57k47"
Jun 03 16:46:20.656527 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.656489    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4rvt\" (UniqueName: \"kubernetes.io/projected/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-kube-api-access-w4rvt\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:20.656635 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:20.656558    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 16:46:20.656635 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:20.656611    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs podName:9400fa0a-0dbe-4f6b-8e3b-09502bee5575 nodeName:}" failed. No retries permitted until 2026-06-03 16:46:21.156593688 +0000 UTC m=+122.877485960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs") pod "router-default-7dc7c5c64f-c4q48" (UID: "9400fa0a-0dbe-4f6b-8e3b-09502bee5575") : secret "router-metrics-certs-default" not found
Jun 03 16:46:20.656755 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.656681    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccbe3e7a-fea1-419f-af7f-bc26eaa0089e-trusted-ca\") pod \"console-operator-86d7c6cc77-phgpp\" (UID: \"ccbe3e7a-fea1-419f-af7f-bc26eaa0089e\") " pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:20.656755 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.656722    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccbe3e7a-fea1-419f-af7f-bc26eaa0089e-config\") pod \"console-operator-86d7c6cc77-phgpp\" (UID: \"ccbe3e7a-fea1-419f-af7f-bc26eaa0089e\") " pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:20.656849 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.656772    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:20.656849 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.656803    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccbe3e7a-fea1-419f-af7f-bc26eaa0089e-serving-cert\") pod \"console-operator-86d7c6cc77-phgpp\" (UID: \"ccbe3e7a-fea1-419f-af7f-bc26eaa0089e\") " pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:20.656849 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.656831    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58250ca1-fc0c-443c-bc0b-adc42eb0f95e-config\") pod \"service-ca-operator-69877444c-57k47\" (UID: \"58250ca1-fc0c-443c-bc0b-adc42eb0f95e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-57k47"
Jun 03 16:46:20.656989 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.656857    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-stats-auth\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:20.656989 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.656882    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9w2qv\" (UniqueName: \"kubernetes.io/projected/ccbe3e7a-fea1-419f-af7f-bc26eaa0089e-kube-api-access-9w2qv\") pod \"console-operator-86d7c6cc77-phgpp\" (UID: \"ccbe3e7a-fea1-419f-af7f-bc26eaa0089e\") " pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:20.656989 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:20.656894    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle podName:9400fa0a-0dbe-4f6b-8e3b-09502bee5575 nodeName:}" failed. No retries permitted until 2026-06-03 16:46:21.156878042 +0000 UTC m=+122.877770331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle") pod "router-default-7dc7c5c64f-c4q48" (UID: "9400fa0a-0dbe-4f6b-8e3b-09502bee5575") : configmap references non-existent config key: service-ca.crt
Jun 03 16:46:20.656989 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.656945    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t4x9k\" (UniqueName: \"kubernetes.io/projected/58250ca1-fc0c-443c-bc0b-adc42eb0f95e-kube-api-access-t4x9k\") pod \"service-ca-operator-69877444c-57k47\" (UID: \"58250ca1-fc0c-443c-bc0b-adc42eb0f95e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-57k47"
Jun 03 16:46:20.657185 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.656988    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-default-certificate\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:20.657531 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.657508    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccbe3e7a-fea1-419f-af7f-bc26eaa0089e-config\") pod \"console-operator-86d7c6cc77-phgpp\" (UID: \"ccbe3e7a-fea1-419f-af7f-bc26eaa0089e\") " pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:20.657622 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.657538    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58250ca1-fc0c-443c-bc0b-adc42eb0f95e-config\") pod \"service-ca-operator-69877444c-57k47\" (UID: \"58250ca1-fc0c-443c-bc0b-adc42eb0f95e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-57k47"
Jun 03 16:46:20.657806 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.657781    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccbe3e7a-fea1-419f-af7f-bc26eaa0089e-trusted-ca\") pod \"console-operator-86d7c6cc77-phgpp\" (UID: \"ccbe3e7a-fea1-419f-af7f-bc26eaa0089e\") " pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:20.659348 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.659322    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58250ca1-fc0c-443c-bc0b-adc42eb0f95e-serving-cert\") pod \"service-ca-operator-69877444c-57k47\" (UID: \"58250ca1-fc0c-443c-bc0b-adc42eb0f95e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-57k47"
Jun 03 16:46:20.659654 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.659635    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccbe3e7a-fea1-419f-af7f-bc26eaa0089e-serving-cert\") pod \"console-operator-86d7c6cc77-phgpp\" (UID: \"ccbe3e7a-fea1-419f-af7f-bc26eaa0089e\") " pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:20.660019 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.660000    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-stats-auth\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:20.660072 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.660016    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-default-certificate\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:20.668633 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.668609    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4x9k\" (UniqueName: \"kubernetes.io/projected/58250ca1-fc0c-443c-bc0b-adc42eb0f95e-kube-api-access-t4x9k\") pod \"service-ca-operator-69877444c-57k47\" (UID: \"58250ca1-fc0c-443c-bc0b-adc42eb0f95e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-57k47"
Jun 03 16:46:20.668757 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.668699    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4rvt\" (UniqueName: \"kubernetes.io/projected/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-kube-api-access-w4rvt\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:20.668819 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.668760    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w2qv\" (UniqueName: \"kubernetes.io/projected/ccbe3e7a-fea1-419f-af7f-bc26eaa0089e-kube-api-access-9w2qv\") pod \"console-operator-86d7c6cc77-phgpp\" (UID: \"ccbe3e7a-fea1-419f-af7f-bc26eaa0089e\") " pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:20.755923 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.755890    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-57k47"
Jun 03 16:46:20.764682 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.764656    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:20.770071 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.770033    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-886d6"]
Jun 03 16:46:20.773846 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:46:20.773804    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b0a205_48a4_43d3_886a_f2a0c1a4a88b.slice/crio-7f1828cee044b3b4ee2ef39a19de5be38caeed86e60aebf8857c0b54a6441494 WatchSource:0}: Error finding container 7f1828cee044b3b4ee2ef39a19de5be38caeed86e60aebf8857c0b54a6441494: Status 404 returned error can't find the container with id 7f1828cee044b3b4ee2ef39a19de5be38caeed86e60aebf8857c0b54a6441494
Jun 03 16:46:20.879570 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.879542    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-57k47"]
Jun 03 16:46:20.882287 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:46:20.882258    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58250ca1_fc0c_443c_bc0b_adc42eb0f95e.slice/crio-628f8fe07f1ef66175a2cb232bd91dc379c14f9d446562620aceda69d3ace986 WatchSource:0}: Error finding container 628f8fe07f1ef66175a2cb232bd91dc379c14f9d446562620aceda69d3ace986: Status 404 returned error can't find the container with id 628f8fe07f1ef66175a2cb232bd91dc379c14f9d446562620aceda69d3ace986
Jun 03 16:46:20.895546 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:20.895524    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-phgpp"]
Jun 03 16:46:20.898011 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:46:20.897986    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbe3e7a_fea1_419f_af7f_bc26eaa0089e.slice/crio-b8344caaff7c62bacd780c1471d4c1d320264dccfe41e23fca6715e293980a5f WatchSource:0}: Error finding container b8344caaff7c62bacd780c1471d4c1d320264dccfe41e23fca6715e293980a5f: Status 404 returned error can't find the container with id b8344caaff7c62bacd780c1471d4c1d320264dccfe41e23fca6715e293980a5f
Jun 03 16:46:21.049430 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:21.049398    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp" event={"ID":"ccbe3e7a-fea1-419f-af7f-bc26eaa0089e","Type":"ContainerStarted","Data":"b8344caaff7c62bacd780c1471d4c1d320264dccfe41e23fca6715e293980a5f"}
Jun 03 16:46:21.050282 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:21.050257    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-886d6" event={"ID":"f4b0a205-48a4-43d3-886a-f2a0c1a4a88b","Type":"ContainerStarted","Data":"7f1828cee044b3b4ee2ef39a19de5be38caeed86e60aebf8857c0b54a6441494"}
Jun 03 16:46:21.051150 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:21.051128    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-57k47" event={"ID":"58250ca1-fc0c-443c-bc0b-adc42eb0f95e","Type":"ContainerStarted","Data":"628f8fe07f1ef66175a2cb232bd91dc379c14f9d446562620aceda69d3ace986"}
Jun 03 16:46:21.160067 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:21.160032    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:21.160212 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:21.160096    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:21.160212 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:21.160185    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 16:46:21.160278 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:21.160212    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle podName:9400fa0a-0dbe-4f6b-8e3b-09502bee5575 nodeName:}" failed. No retries permitted until 2026-06-03 16:46:22.160196354 +0000 UTC m=+123.881088625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle") pod "router-default-7dc7c5c64f-c4q48" (UID: "9400fa0a-0dbe-4f6b-8e3b-09502bee5575") : configmap references non-existent config key: service-ca.crt
Jun 03 16:46:21.160278 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:21.160235    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs podName:9400fa0a-0dbe-4f6b-8e3b-09502bee5575 nodeName:}" failed. No retries permitted until 2026-06-03 16:46:22.160228241 +0000 UTC m=+123.881120512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs") pod "router-default-7dc7c5c64f-c4q48" (UID: "9400fa0a-0dbe-4f6b-8e3b-09502bee5575") : secret "router-metrics-certs-default" not found
Jun 03 16:46:22.168847 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:22.168804    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:22.169302 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:22.168913    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:22.169302 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:22.168987    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle podName:9400fa0a-0dbe-4f6b-8e3b-09502bee5575 nodeName:}" failed. No retries permitted until 2026-06-03 16:46:24.168963537 +0000 UTC m=+125.889855812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle") pod "router-default-7dc7c5c64f-c4q48" (UID: "9400fa0a-0dbe-4f6b-8e3b-09502bee5575") : configmap references non-existent config key: service-ca.crt
Jun 03 16:46:22.169302 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:22.169025    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 16:46:22.169302 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:22.169078    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs podName:9400fa0a-0dbe-4f6b-8e3b-09502bee5575 nodeName:}" failed. No retries permitted until 2026-06-03 16:46:24.169059962 +0000 UTC m=+125.889952241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs") pod "router-default-7dc7c5c64f-c4q48" (UID: "9400fa0a-0dbe-4f6b-8e3b-09502bee5575") : secret "router-metrics-certs-default" not found
Jun 03 16:46:23.057580 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:23.057546    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-886d6" event={"ID":"f4b0a205-48a4-43d3-886a-f2a0c1a4a88b","Type":"ContainerStarted","Data":"e998c3dbb7773e76aa6911c4df99f6cfeb22ddb68dff03c8d541ab93b58aaf99"}
Jun 03 16:46:23.075819 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:23.075770    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-886d6" podStartSLOduration=1.4898538590000001 podStartE2EDuration="3.075755526s" podCreationTimestamp="2026-06-03 16:46:20 +0000 UTC" firstStartedPulling="2026-06-03 16:46:20.775756247 +0000 UTC m=+122.496648518" lastFinishedPulling="2026-06-03 16:46:22.36165791 +0000 UTC m=+124.082550185" observedRunningTime="2026-06-03 16:46:23.074902361 +0000 UTC m=+124.795794658" watchObservedRunningTime="2026-06-03 16:46:23.075755526 +0000 UTC m=+124.796647818"
Jun 03 16:46:24.061107 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:24.061040    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-57k47" event={"ID":"58250ca1-fc0c-443c-bc0b-adc42eb0f95e","Type":"ContainerStarted","Data":"898864b4293c4f2d8bc763a157d88f58604f54d60612f9a0a473b6892d9c3231"}
Jun 03 16:46:24.062437 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:24.062418    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-phgpp_ccbe3e7a-fea1-419f-af7f-bc26eaa0089e/console-operator/0.log"
Jun 03 16:46:24.062508 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:24.062452    2563 generic.go:358] "Generic (PLEG): container finished" podID="ccbe3e7a-fea1-419f-af7f-bc26eaa0089e" containerID="e55c17ec45f618e8b96d03fb28dc958d3c6e7723ba06a8642855db0e7a6f7d55" exitCode=255
Jun 03 16:46:24.062546 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:24.062520    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp" event={"ID":"ccbe3e7a-fea1-419f-af7f-bc26eaa0089e","Type":"ContainerDied","Data":"e55c17ec45f618e8b96d03fb28dc958d3c6e7723ba06a8642855db0e7a6f7d55"}
Jun 03 16:46:24.062763 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:24.062741    2563 scope.go:117] "RemoveContainer" containerID="e55c17ec45f618e8b96d03fb28dc958d3c6e7723ba06a8642855db0e7a6f7d55"
Jun 03 16:46:24.076397 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:24.076361    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-57k47" podStartSLOduration=1.17927137 podStartE2EDuration="4.076349154s" podCreationTimestamp="2026-06-03 16:46:20 +0000 UTC" firstStartedPulling="2026-06-03 16:46:20.886527201 +0000 UTC m=+122.607419471" lastFinishedPulling="2026-06-03 16:46:23.78360498 +0000 UTC m=+125.504497255" observedRunningTime="2026-06-03 16:46:24.07568645 +0000 UTC m=+125.796578754" watchObservedRunningTime="2026-06-03 16:46:24.076349154 +0000 UTC m=+125.797241446"
Jun 03 16:46:24.183807 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:24.183778    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:24.183925 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:24.183872    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 16:46:24.183925 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:24.183892    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:24.184029 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:24.183945    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs podName:9400fa0a-0dbe-4f6b-8e3b-09502bee5575 nodeName:}" failed. No retries permitted until 2026-06-03 16:46:28.183924236 +0000 UTC m=+129.904816528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs") pod "router-default-7dc7c5c64f-c4q48" (UID: "9400fa0a-0dbe-4f6b-8e3b-09502bee5575") : secret "router-metrics-certs-default" not found
Jun 03 16:46:24.184355 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:24.184193    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle podName:9400fa0a-0dbe-4f6b-8e3b-09502bee5575 nodeName:}" failed. No retries permitted until 2026-06-03 16:46:28.184175814 +0000 UTC m=+129.905068087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle") pod "router-default-7dc7c5c64f-c4q48" (UID: "9400fa0a-0dbe-4f6b-8e3b-09502bee5575") : configmap references non-existent config key: service-ca.crt
Jun 03 16:46:25.065278 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.065240    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-g2p4g"]
Jun 03 16:46:25.066297 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.066275    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-phgpp_ccbe3e7a-fea1-419f-af7f-bc26eaa0089e/console-operator/1.log"
Jun 03 16:46:25.066713 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.066695    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-phgpp_ccbe3e7a-fea1-419f-af7f-bc26eaa0089e/console-operator/0.log"
Jun 03 16:46:25.066812 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.066743    2563 generic.go:358] "Generic (PLEG): container finished" podID="ccbe3e7a-fea1-419f-af7f-bc26eaa0089e" containerID="aa5d448a882428929bc286369c3b20cfd5207d7d1dcd53edadc5550a17db1510" exitCode=255
Jun 03 16:46:25.067281 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.067259    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp" event={"ID":"ccbe3e7a-fea1-419f-af7f-bc26eaa0089e","Type":"ContainerDied","Data":"aa5d448a882428929bc286369c3b20cfd5207d7d1dcd53edadc5550a17db1510"}
Jun 03 16:46:25.067337 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.067299    2563 scope.go:117] "RemoveContainer" containerID="e55c17ec45f618e8b96d03fb28dc958d3c6e7723ba06a8642855db0e7a6f7d55"
Jun 03 16:46:25.067578 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.067541    2563 scope.go:117] "RemoveContainer" containerID="aa5d448a882428929bc286369c3b20cfd5207d7d1dcd53edadc5550a17db1510"
Jun 03 16:46:25.067676 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.067553    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g2p4g"
Jun 03 16:46:25.067787 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:25.067763    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-phgpp_openshift-console-operator(ccbe3e7a-fea1-419f-af7f-bc26eaa0089e)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp" podUID="ccbe3e7a-fea1-419f-af7f-bc26eaa0089e"
Jun 03 16:46:25.070282 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.070265    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jun 03 16:46:25.070453 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.070433    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hkz2r\""
Jun 03 16:46:25.070519 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.070456    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jun 03 16:46:25.075488 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.075468    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-g2p4g"]
Jun 03 16:46:25.194603 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.194573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl6qj\" (UniqueName: \"kubernetes.io/projected/ea4d81a9-e648-4078-8f68-4a46b4fad8df-kube-api-access-tl6qj\") pod \"migrator-96c6f749-g2p4g\" (UID: \"ea4d81a9-e648-4078-8f68-4a46b4fad8df\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g2p4g"
Jun 03 16:46:25.295963 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.295923    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tl6qj\" (UniqueName: \"kubernetes.io/projected/ea4d81a9-e648-4078-8f68-4a46b4fad8df-kube-api-access-tl6qj\") pod \"migrator-96c6f749-g2p4g\" (UID: \"ea4d81a9-e648-4078-8f68-4a46b4fad8df\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g2p4g"
Jun 03 16:46:25.305053 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.305023    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl6qj\" (UniqueName: \"kubernetes.io/projected/ea4d81a9-e648-4078-8f68-4a46b4fad8df-kube-api-access-tl6qj\") pod \"migrator-96c6f749-g2p4g\" (UID: \"ea4d81a9-e648-4078-8f68-4a46b4fad8df\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g2p4g"
Jun 03 16:46:25.378109 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.378036    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g2p4g"
Jun 03 16:46:25.494507 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:25.494471    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-g2p4g"]
Jun 03 16:46:25.497816 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:46:25.497786    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4d81a9_e648_4078_8f68_4a46b4fad8df.slice/crio-d22913ea3045f3d6af6169ff1e5890a2c641a952d34f51b242d25c584dcbb627 WatchSource:0}: Error finding container d22913ea3045f3d6af6169ff1e5890a2c641a952d34f51b242d25c584dcbb627: Status 404 returned error can't find the container with id d22913ea3045f3d6af6169ff1e5890a2c641a952d34f51b242d25c584dcbb627
Jun 03 16:46:26.069781 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:26.069759    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-phgpp_ccbe3e7a-fea1-419f-af7f-bc26eaa0089e/console-operator/1.log"
Jun 03 16:46:26.070276 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:26.070169    2563 scope.go:117] "RemoveContainer" containerID="aa5d448a882428929bc286369c3b20cfd5207d7d1dcd53edadc5550a17db1510"
Jun 03 16:46:26.070376 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:26.070350    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-phgpp_openshift-console-operator(ccbe3e7a-fea1-419f-af7f-bc26eaa0089e)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp" podUID="ccbe3e7a-fea1-419f-af7f-bc26eaa0089e"
Jun 03 16:46:26.071058 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:26.071039    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g2p4g" event={"ID":"ea4d81a9-e648-4078-8f68-4a46b4fad8df","Type":"ContainerStarted","Data":"d22913ea3045f3d6af6169ff1e5890a2c641a952d34f51b242d25c584dcbb627"}
Jun 03 16:46:27.074948 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.074905    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g2p4g" event={"ID":"ea4d81a9-e648-4078-8f68-4a46b4fad8df","Type":"ContainerStarted","Data":"0b670cfed5be8343f2f7c12a8b4351cb6cc2fa6abd4dd043e5205e7bad258404"}
Jun 03 16:46:27.075308 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.074956    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g2p4g" event={"ID":"ea4d81a9-e648-4078-8f68-4a46b4fad8df","Type":"ContainerStarted","Data":"58412a6c424c5849875715407703a6398cdae4fa4be10b5858b8d33b03438538"}
Jun 03 16:46:27.094073 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.094035    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g2p4g" podStartSLOduration=0.86892133 podStartE2EDuration="2.094022144s" podCreationTimestamp="2026-06-03 16:46:25 +0000 UTC" firstStartedPulling="2026-06-03 16:46:25.499515465 +0000 UTC m=+127.220407741" lastFinishedPulling="2026-06-03 16:46:26.72461628 +0000 UTC m=+128.445508555" observedRunningTime="2026-06-03 16:46:27.093225057 +0000 UTC m=+128.814117349" watchObservedRunningTime="2026-06-03 16:46:27.094022144 +0000 UTC m=+128.814914462"
Jun 03 16:46:27.173046 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.173014    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-hwz77"]
Jun 03 16:46:27.174711 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.174693    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-hwz77"
Jun 03 16:46:27.177348 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.177331    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jun 03 16:46:27.177564 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.177543    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jun 03 16:46:27.177657 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.177577    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-ztc7t\""
Jun 03 16:46:27.177657 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.177581    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jun 03 16:46:27.177657 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.177608    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jun 03 16:46:27.185916 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.185895    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-hwz77"]
Jun 03 16:46:27.312641 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.312607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b0b355db-fac8-4e93-b4cb-acc0bf69b183-signing-key\") pod \"service-ca-685df94d57-hwz77\" (UID: \"b0b355db-fac8-4e93-b4cb-acc0bf69b183\") " pod="openshift-service-ca/service-ca-685df94d57-hwz77"
Jun 03 16:46:27.312641 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.312640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b0b355db-fac8-4e93-b4cb-acc0bf69b183-signing-cabundle\") pod \"service-ca-685df94d57-hwz77\" (UID: \"b0b355db-fac8-4e93-b4cb-acc0bf69b183\") " pod="openshift-service-ca/service-ca-685df94d57-hwz77"
Jun 03 16:46:27.312862 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.312707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckzhv\" (UniqueName: \"kubernetes.io/projected/b0b355db-fac8-4e93-b4cb-acc0bf69b183-kube-api-access-ckzhv\") pod \"service-ca-685df94d57-hwz77\" (UID: \"b0b355db-fac8-4e93-b4cb-acc0bf69b183\") " pod="openshift-service-ca/service-ca-685df94d57-hwz77"
Jun 03 16:46:27.413311 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.413203    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b0b355db-fac8-4e93-b4cb-acc0bf69b183-signing-key\") pod \"service-ca-685df94d57-hwz77\" (UID: \"b0b355db-fac8-4e93-b4cb-acc0bf69b183\") " pod="openshift-service-ca/service-ca-685df94d57-hwz77"
Jun 03 16:46:27.413311 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.413251    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b0b355db-fac8-4e93-b4cb-acc0bf69b183-signing-cabundle\") pod \"service-ca-685df94d57-hwz77\" (UID: \"b0b355db-fac8-4e93-b4cb-acc0bf69b183\") " pod="openshift-service-ca/service-ca-685df94d57-hwz77"
Jun 03 16:46:27.413311 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.413293    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzhv\" (UniqueName: \"kubernetes.io/projected/b0b355db-fac8-4e93-b4cb-acc0bf69b183-kube-api-access-ckzhv\") pod \"service-ca-685df94d57-hwz77\" (UID: \"b0b355db-fac8-4e93-b4cb-acc0bf69b183\") " pod="openshift-service-ca/service-ca-685df94d57-hwz77"
Jun 03 16:46:27.414037 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.414010    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b0b355db-fac8-4e93-b4cb-acc0bf69b183-signing-cabundle\") pod \"service-ca-685df94d57-hwz77\" (UID: \"b0b355db-fac8-4e93-b4cb-acc0bf69b183\") " pod="openshift-service-ca/service-ca-685df94d57-hwz77"
Jun 03 16:46:27.415679 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.415653    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b0b355db-fac8-4e93-b4cb-acc0bf69b183-signing-key\") pod \"service-ca-685df94d57-hwz77\" (UID: \"b0b355db-fac8-4e93-b4cb-acc0bf69b183\") " pod="openshift-service-ca/service-ca-685df94d57-hwz77"
Jun 03 16:46:27.421780 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.421761    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckzhv\" (UniqueName: \"kubernetes.io/projected/b0b355db-fac8-4e93-b4cb-acc0bf69b183-kube-api-access-ckzhv\") pod \"service-ca-685df94d57-hwz77\" (UID: \"b0b355db-fac8-4e93-b4cb-acc0bf69b183\") " pod="openshift-service-ca/service-ca-685df94d57-hwz77"
Jun 03 16:46:27.482767 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.482719    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-hwz77"
Jun 03 16:46:27.598897 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.598869    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-hwz77"]
Jun 03 16:46:27.602028 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:46:27.602002    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b355db_fac8_4e93_b4cb_acc0bf69b183.slice/crio-9d993c821aa65827604c6a94b179cee5b390a7fda228ed1b4aaf0c32dc52f9f6 WatchSource:0}: Error finding container 9d993c821aa65827604c6a94b179cee5b390a7fda228ed1b4aaf0c32dc52f9f6: Status 404 returned error can't find the container with id 9d993c821aa65827604c6a94b179cee5b390a7fda228ed1b4aaf0c32dc52f9f6
Jun 03 16:46:27.926628 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:27.926606    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lpn2p_ca235535-73f8-4549-bf3c-b7a3491f2b90/dns-node-resolver/0.log"
Jun 03 16:46:28.082595 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:28.082557    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-hwz77" event={"ID":"b0b355db-fac8-4e93-b4cb-acc0bf69b183","Type":"ContainerStarted","Data":"29dd64755c260bf63f6e390fc0ecbd77a9301426945fdb87fb0368b983c2ed6c"}
Jun 03 16:46:28.082595 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:28.082600    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-hwz77" event={"ID":"b0b355db-fac8-4e93-b4cb-acc0bf69b183","Type":"ContainerStarted","Data":"9d993c821aa65827604c6a94b179cee5b390a7fda228ed1b4aaf0c32dc52f9f6"}
Jun 03 16:46:28.102550 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:28.102505    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-hwz77" podStartSLOduration=1.102490692 podStartE2EDuration="1.102490692s" podCreationTimestamp="2026-06-03 16:46:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:46:28.100533858 +0000 UTC m=+129.821426153" watchObservedRunningTime="2026-06-03 16:46:28.102490692 +0000 UTC m=+129.823382988"
Jun 03 16:46:28.219616 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:28.219540    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:28.219797 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:28.219622    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:28.219797 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:28.219691    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 16:46:28.219797 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:28.219778    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs podName:9400fa0a-0dbe-4f6b-8e3b-09502bee5575 nodeName:}" failed. No retries permitted until 2026-06-03 16:46:36.219759434 +0000 UTC m=+137.940651725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs") pod "router-default-7dc7c5c64f-c4q48" (UID: "9400fa0a-0dbe-4f6b-8e3b-09502bee5575") : secret "router-metrics-certs-default" not found
Jun 03 16:46:28.219956 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:28.219846    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle podName:9400fa0a-0dbe-4f6b-8e3b-09502bee5575 nodeName:}" failed. No retries permitted until 2026-06-03 16:46:36.21982625 +0000 UTC m=+137.940718524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle") pod "router-default-7dc7c5c64f-c4q48" (UID: "9400fa0a-0dbe-4f6b-8e3b-09502bee5575") : configmap references non-existent config key: service-ca.crt
Jun 03 16:46:28.521700 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:28.521667    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs\") pod \"network-metrics-daemon-82l8r\" (UID: \"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff\") " pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:46:28.521894 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:28.521847    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 16:46:28.521966 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:28.521939    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs podName:3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff nodeName:}" failed. No retries permitted until 2026-06-03 16:48:30.521916881 +0000 UTC m=+252.242809166 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs") pod "network-metrics-daemon-82l8r" (UID: "3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff") : secret "metrics-daemon-secret" not found
Jun 03 16:46:29.129838 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:29.129806    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k5dwb_794e1bba-9e19-4e85-af4a-d0cf61fba88f/node-ca/0.log"
Jun 03 16:46:30.327931 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:30.327899    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-g2p4g_ea4d81a9-e648-4078-8f68-4a46b4fad8df/migrator/0.log"
Jun 03 16:46:30.528512 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:30.528481    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-g2p4g_ea4d81a9-e648-4078-8f68-4a46b4fad8df/graceful-termination/0.log"
Jun 03 16:46:30.765134 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:30.765100    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:30.765307 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:30.765144    2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:30.765561 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:30.765545    2563 scope.go:117] "RemoveContainer" containerID="aa5d448a882428929bc286369c3b20cfd5207d7d1dcd53edadc5550a17db1510"
Jun 03 16:46:30.765792 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:30.765769    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-phgpp_openshift-console-operator(ccbe3e7a-fea1-419f-af7f-bc26eaa0089e)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp" podUID="ccbe3e7a-fea1-419f-af7f-bc26eaa0089e"
Jun 03 16:46:31.089718 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:31.089641    2563 scope.go:117] "RemoveContainer" containerID="aa5d448a882428929bc286369c3b20cfd5207d7d1dcd53edadc5550a17db1510"
Jun 03 16:46:31.089872 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:31.089829    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-phgpp_openshift-console-operator(ccbe3e7a-fea1-419f-af7f-bc26eaa0089e)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp" podUID="ccbe3e7a-fea1-419f-af7f-bc26eaa0089e"
Jun 03 16:46:36.285313 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:36.285260    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:36.285704 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:36.285347    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:36.285933 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:36.285912    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-service-ca-bundle\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:36.287609 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:36.287586    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9400fa0a-0dbe-4f6b-8e3b-09502bee5575-metrics-certs\") pod \"router-default-7dc7c5c64f-c4q48\" (UID: \"9400fa0a-0dbe-4f6b-8e3b-09502bee5575\") " pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:36.369863 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:36.369839    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:36.489784 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:36.489757    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7dc7c5c64f-c4q48"]
Jun 03 16:46:36.493494 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:46:36.493467    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9400fa0a_0dbe_4f6b_8e3b_09502bee5575.slice/crio-963b24624be0378fcc876d0cd078551593280c2df87badbf1189c90b94aecee0 WatchSource:0}: Error finding container 963b24624be0378fcc876d0cd078551593280c2df87badbf1189c90b94aecee0: Status 404 returned error can't find the container with id 963b24624be0378fcc876d0cd078551593280c2df87badbf1189c90b94aecee0
Jun 03 16:46:37.104109 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:37.104072    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7dc7c5c64f-c4q48" event={"ID":"9400fa0a-0dbe-4f6b-8e3b-09502bee5575","Type":"ContainerStarted","Data":"be5115b0c2cfaa0819a566b2e2405d79b9438240408406667368d4f4846eb38e"}
Jun 03 16:46:37.104109 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:37.104109    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7dc7c5c64f-c4q48" event={"ID":"9400fa0a-0dbe-4f6b-8e3b-09502bee5575","Type":"ContainerStarted","Data":"963b24624be0378fcc876d0cd078551593280c2df87badbf1189c90b94aecee0"}
Jun 03 16:46:37.129946 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:37.129901    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-7dc7c5c64f-c4q48" podStartSLOduration=17.129888223 podStartE2EDuration="17.129888223s" podCreationTimestamp="2026-06-03 16:46:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:46:37.128158353 +0000 UTC m=+138.849050671" watchObservedRunningTime="2026-06-03 16:46:37.129888223 +0000 UTC m=+138.850780516"
Jun 03 16:46:37.370529 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:37.370443    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:37.373573 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:37.373390    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:38.106561 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:38.106521    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:38.107833 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:38.107815    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7dc7c5c64f-c4q48"
Jun 03 16:46:42.728087 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:42.728053    2563 scope.go:117] "RemoveContainer" containerID="aa5d448a882428929bc286369c3b20cfd5207d7d1dcd53edadc5550a17db1510"
Jun 03 16:46:43.120151 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:43.120074    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-phgpp_ccbe3e7a-fea1-419f-af7f-bc26eaa0089e/console-operator/1.log"
Jun 03 16:46:43.120290 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:43.120160    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp" event={"ID":"ccbe3e7a-fea1-419f-af7f-bc26eaa0089e","Type":"ContainerStarted","Data":"374e687d94d7e705f469f337d88bd2ae1bef38fdaf68f15e15fedfd5f808572f"}
Jun 03 16:46:43.120504 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:43.120476    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:43.138367 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:43.138320    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp" podStartSLOduration=20.254291272 podStartE2EDuration="23.13828339s" podCreationTimestamp="2026-06-03 16:46:20 +0000 UTC" firstStartedPulling="2026-06-03 16:46:20.899694633 +0000 UTC m=+122.620586907" lastFinishedPulling="2026-06-03 16:46:23.783686746 +0000 UTC m=+125.504579025" observedRunningTime="2026-06-03 16:46:43.137845083 +0000 UTC m=+144.858737376" watchObservedRunningTime="2026-06-03 16:46:43.13828339 +0000 UTC m=+144.859175683"
Jun 03 16:46:43.504929 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:43.504900    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-phgpp"
Jun 03 16:46:49.590092 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.590060    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrw2h"]
Jun 03 16:46:49.591753 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.591722    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9tlxs"]
Jun 03 16:46:49.591902 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.591883    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrw2h"
Jun 03 16:46:49.593502 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.593485    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.601656 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.601639    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 03 16:46:49.602750 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.602721    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 03 16:46:49.602837 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.602793    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rc6mw\""
Jun 03 16:46:49.604535 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.603563    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 03 16:46:49.604535 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.603849    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jun 03 16:46:49.604535 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.603940    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 03 16:46:49.604854 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.604716    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cd4z6\""
Jun 03 16:46:49.609672 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.609650    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9tlxs"]
Jun 03 16:46:49.610531 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.610511    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrw2h"]
Jun 03 16:46:49.682139 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.682116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5862791a-7fc1-49e2-bced-38ee4d3a9f70-data-volume\") pod \"insights-runtime-extractor-9tlxs\" (UID: \"5862791a-7fc1-49e2-bced-38ee4d3a9f70\") " pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.682270 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.682157    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7mxs\" (UniqueName: \"kubernetes.io/projected/5862791a-7fc1-49e2-bced-38ee4d3a9f70-kube-api-access-l7mxs\") pod \"insights-runtime-extractor-9tlxs\" (UID: \"5862791a-7fc1-49e2-bced-38ee4d3a9f70\") " pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.682270 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.682199    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5862791a-7fc1-49e2-bced-38ee4d3a9f70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9tlxs\" (UID: \"5862791a-7fc1-49e2-bced-38ee4d3a9f70\") " pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.682270 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.682223    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5862791a-7fc1-49e2-bced-38ee4d3a9f70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9tlxs\" (UID: \"5862791a-7fc1-49e2-bced-38ee4d3a9f70\") " pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.682270 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.682245    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e9a08578-6583-4bfc-b50c-1608905e8f39-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-jrw2h\" (UID: \"e9a08578-6583-4bfc-b50c-1608905e8f39\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrw2h"
Jun 03 16:46:49.682270 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.682264    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5862791a-7fc1-49e2-bced-38ee4d3a9f70-crio-socket\") pod \"insights-runtime-extractor-9tlxs\" (UID: \"5862791a-7fc1-49e2-bced-38ee4d3a9f70\") " pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.686878 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.686858    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-9brzt"]
Jun 03 16:46:49.688609 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.688594    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-9brzt"
Jun 03 16:46:49.696454 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.696438    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-brblt\""
Jun 03 16:46:49.696781 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.696766    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 03 16:46:49.696911 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.696896    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 03 16:46:49.705908 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.705888    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-9brzt"]
Jun 03 16:46:49.783564 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.783540    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e9a08578-6583-4bfc-b50c-1608905e8f39-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-jrw2h\" (UID: \"e9a08578-6583-4bfc-b50c-1608905e8f39\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrw2h"
Jun 03 16:46:49.783718 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.783573    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5862791a-7fc1-49e2-bced-38ee4d3a9f70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9tlxs\" (UID: \"5862791a-7fc1-49e2-bced-38ee4d3a9f70\") " pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.783718 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.783591    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5862791a-7fc1-49e2-bced-38ee4d3a9f70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9tlxs\" (UID: \"5862791a-7fc1-49e2-bced-38ee4d3a9f70\") " pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.783861 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.783807    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7mxs\" (UniqueName: \"kubernetes.io/projected/5862791a-7fc1-49e2-bced-38ee4d3a9f70-kube-api-access-l7mxs\") pod \"insights-runtime-extractor-9tlxs\" (UID: \"5862791a-7fc1-49e2-bced-38ee4d3a9f70\") " pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.783917 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.783859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8x72\" (UniqueName: \"kubernetes.io/projected/d88b2bfd-2f3c-4a8b-a72e-3a4a54fa4459-kube-api-access-c8x72\") pod \"downloads-c65b8dc4b-9brzt\" (UID: \"d88b2bfd-2f3c-4a8b-a72e-3a4a54fa4459\") " pod="openshift-console/downloads-c65b8dc4b-9brzt"
Jun 03 16:46:49.784028 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.784006    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5862791a-7fc1-49e2-bced-38ee4d3a9f70-crio-socket\") pod \"insights-runtime-extractor-9tlxs\" (UID: \"5862791a-7fc1-49e2-bced-38ee4d3a9f70\") " pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.784086 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.784053    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5862791a-7fc1-49e2-bced-38ee4d3a9f70-data-volume\") pod \"insights-runtime-extractor-9tlxs\" (UID: \"5862791a-7fc1-49e2-bced-38ee4d3a9f70\") " pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.784124 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.784082    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5862791a-7fc1-49e2-bced-38ee4d3a9f70-crio-socket\") pod \"insights-runtime-extractor-9tlxs\" (UID: \"5862791a-7fc1-49e2-bced-38ee4d3a9f70\") " pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.784240 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.784217    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5862791a-7fc1-49e2-bced-38ee4d3a9f70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9tlxs\" (UID: \"5862791a-7fc1-49e2-bced-38ee4d3a9f70\") " pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.784358 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.784289    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5862791a-7fc1-49e2-bced-38ee4d3a9f70-data-volume\") pod \"insights-runtime-extractor-9tlxs\" (UID: \"5862791a-7fc1-49e2-bced-38ee4d3a9f70\") " pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.785915 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.785888    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5862791a-7fc1-49e2-bced-38ee4d3a9f70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9tlxs\" (UID: \"5862791a-7fc1-49e2-bced-38ee4d3a9f70\") " pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.786072 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.786055    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e9a08578-6583-4bfc-b50c-1608905e8f39-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-jrw2h\" (UID: \"e9a08578-6583-4bfc-b50c-1608905e8f39\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrw2h"
Jun 03 16:46:49.798842 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.798824    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7mxs\" (UniqueName: \"kubernetes.io/projected/5862791a-7fc1-49e2-bced-38ee4d3a9f70-kube-api-access-l7mxs\") pod \"insights-runtime-extractor-9tlxs\" (UID: \"5862791a-7fc1-49e2-bced-38ee4d3a9f70\") " pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.884799 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.884772    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8x72\" (UniqueName: \"kubernetes.io/projected/d88b2bfd-2f3c-4a8b-a72e-3a4a54fa4459-kube-api-access-c8x72\") pod \"downloads-c65b8dc4b-9brzt\" (UID: \"d88b2bfd-2f3c-4a8b-a72e-3a4a54fa4459\") " pod="openshift-console/downloads-c65b8dc4b-9brzt"
Jun 03 16:46:49.901258 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.901240    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrw2h"
Jun 03 16:46:49.910704 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.910674    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9tlxs"
Jun 03 16:46:49.920275 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.920225    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8x72\" (UniqueName: \"kubernetes.io/projected/d88b2bfd-2f3c-4a8b-a72e-3a4a54fa4459-kube-api-access-c8x72\") pod \"downloads-c65b8dc4b-9brzt\" (UID: \"d88b2bfd-2f3c-4a8b-a72e-3a4a54fa4459\") " pod="openshift-console/downloads-c65b8dc4b-9brzt"
Jun 03 16:46:49.996502 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:49.996420    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-9brzt"
Jun 03 16:46:50.069524 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:50.069491    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrw2h"]
Jun 03 16:46:50.072188 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:46:50.072159    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a08578_6583_4bfc_b50c_1608905e8f39.slice/crio-8f602140831466fe732efc4c41f87646250afad8f0db47c93f2b1e5f9a52fbbd WatchSource:0}: Error finding container 8f602140831466fe732efc4c41f87646250afad8f0db47c93f2b1e5f9a52fbbd: Status 404 returned error can't find the container with id 8f602140831466fe732efc4c41f87646250afad8f0db47c93f2b1e5f9a52fbbd
Jun 03 16:46:50.080466 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:50.080412    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9tlxs"]
Jun 03 16:46:50.084491 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:46:50.084468    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5862791a_7fc1_49e2_bced_38ee4d3a9f70.slice/crio-660f2996611c34536b479f1bb20ab483276ce63041fdb2125fdfe81e8ce17766 WatchSource:0}: Error finding container 660f2996611c34536b479f1bb20ab483276ce63041fdb2125fdfe81e8ce17766: Status 404 returned error can't find the container with id 660f2996611c34536b479f1bb20ab483276ce63041fdb2125fdfe81e8ce17766
Jun 03 16:46:50.139807 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:50.139767    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9tlxs" event={"ID":"5862791a-7fc1-49e2-bced-38ee4d3a9f70","Type":"ContainerStarted","Data":"711e9223dc68f681cbfbbd5177332c24ac924b3fe77fbe611147dbeea4d5e8f1"}
Jun 03 16:46:50.139908 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:50.139822    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9tlxs" event={"ID":"5862791a-7fc1-49e2-bced-38ee4d3a9f70","Type":"ContainerStarted","Data":"660f2996611c34536b479f1bb20ab483276ce63041fdb2125fdfe81e8ce17766"}
Jun 03 16:46:50.140888 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:50.140866    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrw2h" event={"ID":"e9a08578-6583-4bfc-b50c-1608905e8f39","Type":"ContainerStarted","Data":"8f602140831466fe732efc4c41f87646250afad8f0db47c93f2b1e5f9a52fbbd"}
Jun 03 16:46:50.150716 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:50.150667    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-9brzt"]
Jun 03 16:46:50.152672 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:46:50.152650    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd88b2bfd_2f3c_4a8b_a72e_3a4a54fa4459.slice/crio-904b43c467f5d9ba44c93e22183b23cc091d3b14d68bda429057c6109e2a369b WatchSource:0}: Error finding container 904b43c467f5d9ba44c93e22183b23cc091d3b14d68bda429057c6109e2a369b: Status 404 returned error can't find the container with id 904b43c467f5d9ba44c93e22183b23cc091d3b14d68bda429057c6109e2a369b
Jun 03 16:46:51.145779 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:51.145661    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9tlxs" event={"ID":"5862791a-7fc1-49e2-bced-38ee4d3a9f70","Type":"ContainerStarted","Data":"ff62e395113f91af4854f535849303b1b6e47ebb25ac5318e8d003dc0292fc60"}
Jun 03 16:46:51.146801 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:51.146777    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-9brzt" event={"ID":"d88b2bfd-2f3c-4a8b-a72e-3a4a54fa4459","Type":"ContainerStarted","Data":"904b43c467f5d9ba44c93e22183b23cc091d3b14d68bda429057c6109e2a369b"}
Jun 03 16:46:52.150916 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.150886    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrw2h" event={"ID":"e9a08578-6583-4bfc-b50c-1608905e8f39","Type":"ContainerStarted","Data":"6a462facee15752f8828379b5680fbf15d566a7f71f5705ecdeb20aae8a1315f"}
Jun 03 16:46:52.151353 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.151096    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrw2h"
Jun 03 16:46:52.156298 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.156267    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrw2h"
Jun 03 16:46:52.187150 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.187104    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrw2h" podStartSLOduration=2.080039075 podStartE2EDuration="3.187088201s" podCreationTimestamp="2026-06-03 16:46:49 +0000 UTC" firstStartedPulling="2026-06-03 16:46:50.074076337 +0000 UTC m=+151.794968609" lastFinishedPulling="2026-06-03 16:46:51.181125461 +0000 UTC m=+152.902017735" observedRunningTime="2026-06-03 16:46:52.171555415 +0000 UTC m=+153.892447708" watchObservedRunningTime="2026-06-03 16:46:52.187088201 +0000 UTC m=+153.907980494"
Jun 03 16:46:52.534806 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.534774    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"]
Jun 03 16:46:52.538964 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.538928    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"
Jun 03 16:46:52.549401 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.543612    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jun 03 16:46:52.549401 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.543691    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 03 16:46:52.549401 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.544084    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jun 03 16:46:52.549401 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.544218    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 03 16:46:52.549401 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.545097    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lq4w5\""
Jun 03 16:46:52.549401 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.545710    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 03 16:46:52.549401 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.547589    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"]
Jun 03 16:46:52.609754 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.609430    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae636824-66fd-4ece-aa9e-03b3f1ac4b48-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-ghm9n\" (UID: \"ae636824-66fd-4ece-aa9e-03b3f1ac4b48\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"
Jun 03 16:46:52.609754 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.609491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sp5m\" (UniqueName: \"kubernetes.io/projected/ae636824-66fd-4ece-aa9e-03b3f1ac4b48-kube-api-access-6sp5m\") pod \"prometheus-operator-658bcd8bdf-ghm9n\" (UID: \"ae636824-66fd-4ece-aa9e-03b3f1ac4b48\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"
Jun 03 16:46:52.609754 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.609584    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae636824-66fd-4ece-aa9e-03b3f1ac4b48-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-ghm9n\" (UID: \"ae636824-66fd-4ece-aa9e-03b3f1ac4b48\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"
Jun 03 16:46:52.609754 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.609635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae636824-66fd-4ece-aa9e-03b3f1ac4b48-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-ghm9n\" (UID: \"ae636824-66fd-4ece-aa9e-03b3f1ac4b48\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"
Jun 03 16:46:52.710672 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.710567    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae636824-66fd-4ece-aa9e-03b3f1ac4b48-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-ghm9n\" (UID: \"ae636824-66fd-4ece-aa9e-03b3f1ac4b48\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"
Jun 03 16:46:52.710672 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.710599    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae636824-66fd-4ece-aa9e-03b3f1ac4b48-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-ghm9n\" (UID: \"ae636824-66fd-4ece-aa9e-03b3f1ac4b48\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"
Jun 03 16:46:52.710672 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.710631    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6sp5m\" (UniqueName: \"kubernetes.io/projected/ae636824-66fd-4ece-aa9e-03b3f1ac4b48-kube-api-access-6sp5m\") pod \"prometheus-operator-658bcd8bdf-ghm9n\" (UID: \"ae636824-66fd-4ece-aa9e-03b3f1ac4b48\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"
Jun 03 16:46:52.710956 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:52.710755    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jun 03 16:46:52.710956 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.710769    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae636824-66fd-4ece-aa9e-03b3f1ac4b48-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-ghm9n\" (UID: \"ae636824-66fd-4ece-aa9e-03b3f1ac4b48\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"
Jun 03 16:46:52.710956 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:52.710821    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae636824-66fd-4ece-aa9e-03b3f1ac4b48-prometheus-operator-tls podName:ae636824-66fd-4ece-aa9e-03b3f1ac4b48 nodeName:}" failed. No retries permitted until 2026-06-03 16:46:53.210802044 +0000 UTC m=+154.931694327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ae636824-66fd-4ece-aa9e-03b3f1ac4b48-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-ghm9n" (UID: "ae636824-66fd-4ece-aa9e-03b3f1ac4b48") : secret "prometheus-operator-tls" not found
Jun 03 16:46:52.711402 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.711384    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae636824-66fd-4ece-aa9e-03b3f1ac4b48-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-ghm9n\" (UID: \"ae636824-66fd-4ece-aa9e-03b3f1ac4b48\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"
Jun 03 16:46:52.713030 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.713007    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae636824-66fd-4ece-aa9e-03b3f1ac4b48-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-ghm9n\" (UID: \"ae636824-66fd-4ece-aa9e-03b3f1ac4b48\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"
Jun 03 16:46:52.719476 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:52.719457    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sp5m\" (UniqueName: \"kubernetes.io/projected/ae636824-66fd-4ece-aa9e-03b3f1ac4b48-kube-api-access-6sp5m\") pod \"prometheus-operator-658bcd8bdf-ghm9n\" (UID: \"ae636824-66fd-4ece-aa9e-03b3f1ac4b48\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"
Jun 03 16:46:53.159404 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:53.159362    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9tlxs" event={"ID":"5862791a-7fc1-49e2-bced-38ee4d3a9f70","Type":"ContainerStarted","Data":"3726383fcde560db23d6296687a3a85a615753460029ac1f4a85bad72c6d8283"}
Jun 03 16:46:53.214986 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:53.214939    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae636824-66fd-4ece-aa9e-03b3f1ac4b48-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-ghm9n\" (UID: \"ae636824-66fd-4ece-aa9e-03b3f1ac4b48\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"
Jun 03 16:46:53.217753 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:53.217705    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae636824-66fd-4ece-aa9e-03b3f1ac4b48-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-ghm9n\" (UID: \"ae636824-66fd-4ece-aa9e-03b3f1ac4b48\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"
Jun 03 16:46:53.458274 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:53.458187    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"
Jun 03 16:46:53.598538 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:53.598487    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9tlxs" podStartSLOduration=2.023825393 podStartE2EDuration="4.598470364s" podCreationTimestamp="2026-06-03 16:46:49 +0000 UTC" firstStartedPulling="2026-06-03 16:46:50.131171556 +0000 UTC m=+151.852063827" lastFinishedPulling="2026-06-03 16:46:52.705816523 +0000 UTC m=+154.426708798" observedRunningTime="2026-06-03 16:46:53.18221784 +0000 UTC m=+154.903110146" watchObservedRunningTime="2026-06-03 16:46:53.598470364 +0000 UTC m=+155.319362657"
Jun 03 16:46:53.599057 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:53.598998    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n"]
Jun 03 16:46:53.601435 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:46:53.601409    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae636824_66fd_4ece_aa9e_03b3f1ac4b48.slice/crio-e7145abb5106cef4dd613a8f7ff2ad5f6027490cf6c29f0d9323b6464d84f669 WatchSource:0}: Error finding container e7145abb5106cef4dd613a8f7ff2ad5f6027490cf6c29f0d9323b6464d84f669: Status 404 returned error can't find the container with id e7145abb5106cef4dd613a8f7ff2ad5f6027490cf6c29f0d9323b6464d84f669
Jun 03 16:46:54.162812 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:54.162776    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n" event={"ID":"ae636824-66fd-4ece-aa9e-03b3f1ac4b48","Type":"ContainerStarted","Data":"e7145abb5106cef4dd613a8f7ff2ad5f6027490cf6c29f0d9323b6464d84f669"}
Jun 03 16:46:55.167922 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:55.167844    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n" event={"ID":"ae636824-66fd-4ece-aa9e-03b3f1ac4b48","Type":"ContainerStarted","Data":"72118365ae249736b4f8b390ec1afa300c9428f439010f76705dafbe5e60ea3e"}
Jun 03 16:46:55.167922 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:55.167879    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n" event={"ID":"ae636824-66fd-4ece-aa9e-03b3f1ac4b48","Type":"ContainerStarted","Data":"05894048ee0836c63c394cd37cad1ab11891cb0bf1f5d444616a7aba13f6afae"}
Jun 03 16:46:55.185101 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:55.185043    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ghm9n" podStartSLOduration=1.893713962 podStartE2EDuration="3.185025319s" podCreationTimestamp="2026-06-03 16:46:52 +0000 UTC" firstStartedPulling="2026-06-03 16:46:53.6032399 +0000 UTC m=+155.324132171" lastFinishedPulling="2026-06-03 16:46:54.894551254 +0000 UTC m=+156.615443528" observedRunningTime="2026-06-03 16:46:55.184971053 +0000 UTC m=+156.905863347" watchObservedRunningTime="2026-06-03 16:46:55.185025319 +0000 UTC m=+156.905917614"
Jun 03 16:46:55.754777 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:55.754712    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qd8tz" podUID="95cf9da9-dd78-4443-95a9-90e29b37c406"
Jun 03 16:46:55.777016 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:55.776968    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-nvvnn" podUID="fd962829-ced6-4a41-9570-0dc87e34f793"
Jun 03 16:46:55.788125 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:55.788080    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-82l8r" podUID="3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff"
Jun 03 16:46:56.170877 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:56.170798    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:46:56.171328 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:56.171135    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:46:56.894510 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:56.894432    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"]
Jun 03 16:46:56.917919 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:56.917878    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"]
Jun 03 16:46:56.917919 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:56.917916    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-88zg4"]
Jun 03 16:46:56.918137 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:56.918047    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"
Jun 03 16:46:56.920957 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:56.920931    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jun 03 16:46:56.920957 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:56.920955    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jun 03 16:46:56.921155 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:56.920932    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wzprx\""
Jun 03 16:46:56.930015 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:56.929993    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:56.936971 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:56.936574    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 03 16:46:56.936971 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:56.936615    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 03 16:46:56.936971 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:56.936823    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f7b2x\""
Jun 03 16:46:56.936971 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:56.936878    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 03 16:46:57.051067 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.051033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-wtmp\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.051067 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.051069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b940afbe-dad6-4602-a1d7-288633b3990b-root\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.051315 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.051102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-tls\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.051315 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.051158    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98072612-04e8-4e0f-8eb7-679ccd36fca6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-jxbpj\" (UID: \"98072612-04e8-4e0f-8eb7-679ccd36fca6\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"
Jun 03 16:46:57.051315 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.051191    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhc2r\" (UniqueName: \"kubernetes.io/projected/98072612-04e8-4e0f-8eb7-679ccd36fca6-kube-api-access-mhc2r\") pod \"openshift-state-metrics-85658796db-jxbpj\" (UID: \"98072612-04e8-4e0f-8eb7-679ccd36fca6\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"
Jun 03 16:46:57.051315 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.051250    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t4gn\" (UniqueName: \"kubernetes.io/projected/b940afbe-dad6-4602-a1d7-288633b3990b-kube-api-access-5t4gn\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.051315 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.051284    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/98072612-04e8-4e0f-8eb7-679ccd36fca6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-jxbpj\" (UID: \"98072612-04e8-4e0f-8eb7-679ccd36fca6\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"
Jun 03 16:46:57.051594 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.051372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-textfile\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.051594 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.051398    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b940afbe-dad6-4602-a1d7-288633b3990b-metrics-client-ca\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.051594 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.051444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.051594 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.051481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98072612-04e8-4e0f-8eb7-679ccd36fca6-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-jxbpj\" (UID: \"98072612-04e8-4e0f-8eb7-679ccd36fca6\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"
Jun 03 16:46:57.051594 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.051503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b940afbe-dad6-4602-a1d7-288633b3990b-sys\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.051594 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.051527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-accelerators-collector-config\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.153026 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.152945    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5t4gn\" (UniqueName: \"kubernetes.io/projected/b940afbe-dad6-4602-a1d7-288633b3990b-kube-api-access-5t4gn\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.153026 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.152991    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/98072612-04e8-4e0f-8eb7-679ccd36fca6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-jxbpj\" (UID: \"98072612-04e8-4e0f-8eb7-679ccd36fca6\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"
Jun 03 16:46:57.153239 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.153095    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-textfile\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.153239 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.153116    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b940afbe-dad6-4602-a1d7-288633b3990b-metrics-client-ca\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.153239 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.153147    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.153239 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.153171    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98072612-04e8-4e0f-8eb7-679ccd36fca6-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-jxbpj\" (UID: \"98072612-04e8-4e0f-8eb7-679ccd36fca6\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"
Jun 03 16:46:57.153239 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.153187    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b940afbe-dad6-4602-a1d7-288633b3990b-sys\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.153239 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.153204    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-accelerators-collector-config\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.153239 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.153232    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-wtmp\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.153624 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.153250    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b940afbe-dad6-4602-a1d7-288633b3990b-root\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.153624 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.153287    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-tls\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.153624 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.153320    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98072612-04e8-4e0f-8eb7-679ccd36fca6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-jxbpj\" (UID: \"98072612-04e8-4e0f-8eb7-679ccd36fca6\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"
Jun 03 16:46:57.153624 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.153340    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mhc2r\" (UniqueName: \"kubernetes.io/projected/98072612-04e8-4e0f-8eb7-679ccd36fca6-kube-api-access-mhc2r\") pod \"openshift-state-metrics-85658796db-jxbpj\" (UID: \"98072612-04e8-4e0f-8eb7-679ccd36fca6\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"
Jun 03 16:46:57.153624 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.153388    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b940afbe-dad6-4602-a1d7-288633b3990b-sys\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.153624 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:57.153565    2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jun 03 16:46:57.153624 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:57.153626    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98072612-04e8-4e0f-8eb7-679ccd36fca6-openshift-state-metrics-tls podName:98072612-04e8-4e0f-8eb7-679ccd36fca6 nodeName:}" failed. No retries permitted until 2026-06-03 16:46:57.653605353 +0000 UTC m=+159.374497641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/98072612-04e8-4e0f-8eb7-679ccd36fca6-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-jxbpj" (UID: "98072612-04e8-4e0f-8eb7-679ccd36fca6") : secret "openshift-state-metrics-tls" not found
Jun 03 16:46:57.154009 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.153878    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b940afbe-dad6-4602-a1d7-288633b3990b-root\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.154067 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.154012    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-wtmp\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.154067 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.154013    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b940afbe-dad6-4602-a1d7-288633b3990b-metrics-client-ca\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.154161 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.154058    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-accelerators-collector-config\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.154161 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.154084    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-textfile\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.154161 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:57.154095    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jun 03 16:46:57.154161 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:57.154144    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-tls podName:b940afbe-dad6-4602-a1d7-288633b3990b nodeName:}" failed. No retries permitted until 2026-06-03 16:46:57.654128235 +0000 UTC m=+159.375020507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-tls") pod "node-exporter-88zg4" (UID: "b940afbe-dad6-4602-a1d7-288633b3990b") : secret "node-exporter-tls" not found
Jun 03 16:46:57.154776 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.154750    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98072612-04e8-4e0f-8eb7-679ccd36fca6-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-jxbpj\" (UID: \"98072612-04e8-4e0f-8eb7-679ccd36fca6\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"
Jun 03 16:46:57.156535 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.156510    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.156696 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.156676    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98072612-04e8-4e0f-8eb7-679ccd36fca6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-jxbpj\" (UID: \"98072612-04e8-4e0f-8eb7-679ccd36fca6\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"
Jun 03 16:46:57.163148 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.163124    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t4gn\" (UniqueName: \"kubernetes.io/projected/b940afbe-dad6-4602-a1d7-288633b3990b-kube-api-access-5t4gn\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.163273 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.163211    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhc2r\" (UniqueName: \"kubernetes.io/projected/98072612-04e8-4e0f-8eb7-679ccd36fca6-kube-api-access-mhc2r\") pod \"openshift-state-metrics-85658796db-jxbpj\" (UID: \"98072612-04e8-4e0f-8eb7-679ccd36fca6\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"
Jun 03 16:46:57.658047 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.658013    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-tls\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.658511 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.658090    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/98072612-04e8-4e0f-8eb7-679ccd36fca6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-jxbpj\" (UID: \"98072612-04e8-4e0f-8eb7-679ccd36fca6\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"
Jun 03 16:46:57.660750 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.660683    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b940afbe-dad6-4602-a1d7-288633b3990b-node-exporter-tls\") pod \"node-exporter-88zg4\" (UID: \"b940afbe-dad6-4602-a1d7-288633b3990b\") " pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.660750 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.660721    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/98072612-04e8-4e0f-8eb7-679ccd36fca6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-jxbpj\" (UID: \"98072612-04e8-4e0f-8eb7-679ccd36fca6\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"
Jun 03 16:46:57.828921 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.828778    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"
Jun 03 16:46:57.844110 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.843708    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-88zg4"
Jun 03 16:46:57.854430 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:46:57.854340    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb940afbe_dad6_4602_a1d7_288633b3990b.slice/crio-db2e9262174eb06fe1ac062c5709ee340da88c5dbb3f65680c5904ea8ccef114 WatchSource:0}: Error finding container db2e9262174eb06fe1ac062c5709ee340da88c5dbb3f65680c5904ea8ccef114: Status 404 returned error can't find the container with id db2e9262174eb06fe1ac062c5709ee340da88c5dbb3f65680c5904ea8ccef114
Jun 03 16:46:57.976253 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.976220    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 16:46:57.984706 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:46:57.984669    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98072612_04e8_4e0f_8eb7_679ccd36fca6.slice/crio-1ee8a2879155ae9aebb7bb9c28e0b3c38536d16ff373fd3864231bbbe64ce9e6 WatchSource:0}: Error finding container 1ee8a2879155ae9aebb7bb9c28e0b3c38536d16ff373fd3864231bbbe64ce9e6: Status 404 returned error can't find the container with id 1ee8a2879155ae9aebb7bb9c28e0b3c38536d16ff373fd3864231bbbe64ce9e6
Jun 03 16:46:57.998572 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.998549    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-jxbpj"]
Jun 03 16:46:57.998572 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.998574    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 16:46:57.998969 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:57.998716    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.001440 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.001418    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 03 16:46:58.001971 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.001655    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 03 16:46:58.001971 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.001817    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 03 16:46:58.001971 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.001936    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 03 16:46:58.001971 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.001953    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 03 16:46:58.002255 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.002123    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 03 16:46:58.002310 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.002254    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 03 16:46:58.002366 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.002336    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 03 16:46:58.002471 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.002442    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-z5557\""
Jun 03 16:46:58.002581 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.002560    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 03 16:46:58.067934 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.067906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/284f44d2-e997-4b6a-b91a-0340ac542491-tls-assets\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.068086 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.067945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/284f44d2-e997-4b6a-b91a-0340ac542491-config-out\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.068086 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.067974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.068086 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.068001    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.068086 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.068031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/284f44d2-e997-4b6a-b91a-0340ac542491-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.068260 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.068090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/284f44d2-e997-4b6a-b91a-0340ac542491-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.068260 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.068145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.068260 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.068188    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-config-volume\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.068260 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.068233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-web-config\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.068450 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.068259    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.068450 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.068359    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284f44d2-e997-4b6a-b91a-0340ac542491-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.068450 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.068390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.068450 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.068416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnkzd\" (UniqueName: \"kubernetes.io/projected/284f44d2-e997-4b6a-b91a-0340ac542491-kube-api-access-cnkzd\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.169478 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.169420    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.169478 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.169470    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-config-volume\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.169708 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.169632    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-web-config\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.169708 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.169669    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.169834 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.169757    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284f44d2-e997-4b6a-b91a-0340ac542491-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.169834 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.169787    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.169834 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.169818    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnkzd\" (UniqueName: \"kubernetes.io/projected/284f44d2-e997-4b6a-b91a-0340ac542491-kube-api-access-cnkzd\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.169977 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.169849    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/284f44d2-e997-4b6a-b91a-0340ac542491-tls-assets\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.169977 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.169879    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/284f44d2-e997-4b6a-b91a-0340ac542491-config-out\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.169977 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:46:58.169897    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/284f44d2-e997-4b6a-b91a-0340ac542491-alertmanager-trusted-ca-bundle podName:284f44d2-e997-4b6a-b91a-0340ac542491 nodeName:}" failed. No retries permitted until 2026-06-03 16:46:58.669874101 +0000 UTC m=+160.390766388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/284f44d2-e997-4b6a-b91a-0340ac542491-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "284f44d2-e997-4b6a-b91a-0340ac542491") : configmap references non-existent config key: ca-bundle.crt
Jun 03 16:46:58.169977 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.169933    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.169977 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.169963    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.170230 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.169996    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/284f44d2-e997-4b6a-b91a-0340ac542491-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.170230 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.170057    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/284f44d2-e997-4b6a-b91a-0340ac542491-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.170593 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.170574    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/284f44d2-e997-4b6a-b91a-0340ac542491-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.170952 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.170856    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/284f44d2-e997-4b6a-b91a-0340ac542491-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.173722 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.173353    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-config-volume\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.174758 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.174656    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.176351 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.175533    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-web-config\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.176351 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.175849    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/284f44d2-e997-4b6a-b91a-0340ac542491-config-out\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.176351 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.176227    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.176351 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.176312    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.177126 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.177104    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/284f44d2-e997-4b6a-b91a-0340ac542491-tls-assets\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.177414 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.177357    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.178234 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.178175    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj" event={"ID":"98072612-04e8-4e0f-8eb7-679ccd36fca6","Type":"ContainerStarted","Data":"116cbd1c84b6ad63ca0e1c282b07dba921b0fa126a1b869ce7aaec7ca3a5c7b3"}
Jun 03 16:46:58.178234 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.178215    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj" event={"ID":"98072612-04e8-4e0f-8eb7-679ccd36fca6","Type":"ContainerStarted","Data":"1ee8a2879155ae9aebb7bb9c28e0b3c38536d16ff373fd3864231bbbe64ce9e6"}
Jun 03 16:46:58.178782 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.178757    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.179849 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.179805    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-88zg4" event={"ID":"b940afbe-dad6-4602-a1d7-288633b3990b","Type":"ContainerStarted","Data":"db2e9262174eb06fe1ac062c5709ee340da88c5dbb3f65680c5904ea8ccef114"}
Jun 03 16:46:58.182636 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.182618    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnkzd\" (UniqueName: \"kubernetes.io/projected/284f44d2-e997-4b6a-b91a-0340ac542491-kube-api-access-cnkzd\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.675171 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.675135    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284f44d2-e997-4b6a-b91a-0340ac542491-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.676435 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.676412    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284f44d2-e997-4b6a-b91a-0340ac542491-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:58.914273 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:58.914231    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:46:59.184561 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:59.184513    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj" event={"ID":"98072612-04e8-4e0f-8eb7-679ccd36fca6","Type":"ContainerStarted","Data":"19f3abf6398670a62ccad5fbcd689f25853eac130cfea64059ac26d0512914df"}
Jun 03 16:46:59.470542 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:46:59.470398    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 16:46:59.472859 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:46:59.472835    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284f44d2_e997_4b6a_b91a_0340ac542491.slice/crio-3d06f1c04f3e0ea69f25bbdc1904285e0d0bff0d70f09d2a58a600876cd8ca40 WatchSource:0}: Error finding container 3d06f1c04f3e0ea69f25bbdc1904285e0d0bff0d70f09d2a58a600876cd8ca40: Status 404 returned error can't find the container with id 3d06f1c04f3e0ea69f25bbdc1904285e0d0bff0d70f09d2a58a600876cd8ca40
Jun 03 16:47:00.189700 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:00.189644    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj" event={"ID":"98072612-04e8-4e0f-8eb7-679ccd36fca6","Type":"ContainerStarted","Data":"f21935e2c0ea42e3c2cbd3980b11410f7e3c1e5b11a285eef664d52f6a578364"}
Jun 03 16:47:00.191338 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:00.191305    2563 generic.go:358] "Generic (PLEG): container finished" podID="b940afbe-dad6-4602-a1d7-288633b3990b" containerID="d14bcc6144957f86a4ff8157d4e2b9907c70c39cf9e2d5f2548393ec37e5b109" exitCode=0
Jun 03 16:47:00.191483 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:00.191383    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-88zg4" event={"ID":"b940afbe-dad6-4602-a1d7-288633b3990b","Type":"ContainerDied","Data":"d14bcc6144957f86a4ff8157d4e2b9907c70c39cf9e2d5f2548393ec37e5b109"}
Jun 03 16:47:00.192649 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:00.192619    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"284f44d2-e997-4b6a-b91a-0340ac542491","Type":"ContainerStarted","Data":"3d06f1c04f3e0ea69f25bbdc1904285e0d0bff0d70f09d2a58a600876cd8ca40"}
Jun 03 16:47:00.211037 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:00.210956    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-jxbpj" podStartSLOduration=3.103819669 podStartE2EDuration="4.210917968s" podCreationTimestamp="2026-06-03 16:46:56 +0000 UTC" firstStartedPulling="2026-06-03 16:46:58.201698105 +0000 UTC m=+159.922590380" lastFinishedPulling="2026-06-03 16:46:59.308796399 +0000 UTC m=+161.029688679" observedRunningTime="2026-06-03 16:47:00.207935415 +0000 UTC m=+161.928827709" watchObservedRunningTime="2026-06-03 16:47:00.210917968 +0000 UTC m=+161.931810265"
Jun 03 16:47:00.794939 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:00.794904    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:47:00.795109 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:00.794977    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert\") pod \"ingress-canary-nvvnn\" (UID: \"fd962829-ced6-4a41-9570-0dc87e34f793\") " pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:47:00.797468 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:00.797444    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95cf9da9-dd78-4443-95a9-90e29b37c406-metrics-tls\") pod \"dns-default-qd8tz\" (UID: \"95cf9da9-dd78-4443-95a9-90e29b37c406\") " pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:47:00.797688 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:00.797664    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd962829-ced6-4a41-9570-0dc87e34f793-cert\") pod \"ingress-canary-nvvnn\" (UID: \"fd962829-ced6-4a41-9570-0dc87e34f793\") " pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:47:00.974448 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:00.974369    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vw2lw\""
Jun 03 16:47:00.975422 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:00.975392    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g6lvq\""
Jun 03 16:47:00.981642 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:00.981618    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:47:00.981771 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:00.981677    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nvvnn"
Jun 03 16:47:01.161748 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.161685    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qd8tz"]
Jun 03 16:47:01.164879 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:47:01.164847    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95cf9da9_dd78_4443_95a9_90e29b37c406.slice/crio-c90978285af9b2b08c1a80c82be8e658e9fb25bb32bc9aad7d2147b7157670cd WatchSource:0}: Error finding container c90978285af9b2b08c1a80c82be8e658e9fb25bb32bc9aad7d2147b7157670cd: Status 404 returned error can't find the container with id c90978285af9b2b08c1a80c82be8e658e9fb25bb32bc9aad7d2147b7157670cd
Jun 03 16:47:01.182615 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.182594    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nvvnn"]
Jun 03 16:47:01.185546 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:47:01.185519    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd962829_ced6_4a41_9570_0dc87e34f793.slice/crio-5a853b1c2a7e07ffdcddef4ee0f2b49d11edeecf1ac2a6a71e88bc4df5ce1f04 WatchSource:0}: Error finding container 5a853b1c2a7e07ffdcddef4ee0f2b49d11edeecf1ac2a6a71e88bc4df5ce1f04: Status 404 returned error can't find the container with id 5a853b1c2a7e07ffdcddef4ee0f2b49d11edeecf1ac2a6a71e88bc4df5ce1f04
Jun 03 16:47:01.196777 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.196746    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-88zg4" event={"ID":"b940afbe-dad6-4602-a1d7-288633b3990b","Type":"ContainerStarted","Data":"7197116f6fd17a5af519da122aad400b405ec289b7f540625a2e57d15b259610"}
Jun 03 16:47:01.197126 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.196787    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-88zg4" event={"ID":"b940afbe-dad6-4602-a1d7-288633b3990b","Type":"ContainerStarted","Data":"dc24efc986148866f330c170367140fc220cddcecd6c606431418ee382c4e64a"}
Jun 03 16:47:01.198252 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.198221    2563 generic.go:358] "Generic (PLEG): container finished" podID="284f44d2-e997-4b6a-b91a-0340ac542491" containerID="eaf7f72538711d068f215131902436e28234ffa0ab96b06ff4851b656c48d09c" exitCode=0
Jun 03 16:47:01.198344 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.198291    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"284f44d2-e997-4b6a-b91a-0340ac542491","Type":"ContainerDied","Data":"eaf7f72538711d068f215131902436e28234ffa0ab96b06ff4851b656c48d09c"}
Jun 03 16:47:01.199598 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.199576    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nvvnn" event={"ID":"fd962829-ced6-4a41-9570-0dc87e34f793","Type":"ContainerStarted","Data":"5a853b1c2a7e07ffdcddef4ee0f2b49d11edeecf1ac2a6a71e88bc4df5ce1f04"}
Jun 03 16:47:01.200742 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.200700    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qd8tz" event={"ID":"95cf9da9-dd78-4443-95a9-90e29b37c406","Type":"ContainerStarted","Data":"c90978285af9b2b08c1a80c82be8e658e9fb25bb32bc9aad7d2147b7157670cd"}
Jun 03 16:47:01.216066 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.216015    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-88zg4" podStartSLOduration=3.764906614 podStartE2EDuration="5.216000846s" podCreationTimestamp="2026-06-03 16:46:56 +0000 UTC" firstStartedPulling="2026-06-03 16:46:57.856676166 +0000 UTC m=+159.577568450" lastFinishedPulling="2026-06-03 16:46:59.307770393 +0000 UTC m=+161.028662682" observedRunningTime="2026-06-03 16:47:01.215116513 +0000 UTC m=+162.936008806" watchObservedRunningTime="2026-06-03 16:47:01.216000846 +0000 UTC m=+162.936893141"
Jun 03 16:47:01.681568 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.681535    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-9689v"]
Jun 03 16:47:01.684496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.684468    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-9689v"
Jun 03 16:47:01.687082 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.687062    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jun 03 16:47:01.687180 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.687142    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-kr4p7\""
Jun 03 16:47:01.698913 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.698893    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-9689v"]
Jun 03 16:47:01.806684 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.806645    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed2a871e-c9cb-4e1e-bde0-6a527cd1e828-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-9689v\" (UID: \"ed2a871e-c9cb-4e1e-bde0-6a527cd1e828\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-9689v"
Jun 03 16:47:01.908509 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.908023    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed2a871e-c9cb-4e1e-bde0-6a527cd1e828-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-9689v\" (UID: \"ed2a871e-c9cb-4e1e-bde0-6a527cd1e828\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-9689v"
Jun 03 16:47:01.917063 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.915756    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed2a871e-c9cb-4e1e-bde0-6a527cd1e828-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-9689v\" (UID: \"ed2a871e-c9cb-4e1e-bde0-6a527cd1e828\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-9689v"
Jun 03 16:47:01.994046 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:01.994015    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-9689v"
Jun 03 16:47:02.153320 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.151663    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c496db4b5-x9crx"]
Jun 03 16:47:02.157471 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.156213    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.159252 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.159232    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jun 03 16:47:02.159503 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.159303    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jun 03 16:47:02.159683 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.159664    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jun 03 16:47:02.159797 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.159500    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jun 03 16:47:02.159950 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.159932    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jun 03 16:47:02.160118 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.159566    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zpsb4\""
Jun 03 16:47:02.168456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.168432    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c496db4b5-x9crx"]
Jun 03 16:47:02.168885 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.168865    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jun 03 16:47:02.174444 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.174421    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-9689v"]
Jun 03 16:47:02.206873 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.206845    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-9689v" event={"ID":"ed2a871e-c9cb-4e1e-bde0-6a527cd1e828","Type":"ContainerStarted","Data":"36495ab53ddf3aa15b070fbd8f4314f0f54d1bcd1f1232df9ec4115f1a4bfde5"}
Jun 03 16:47:02.213259 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.213239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-serving-certs-ca-bundle\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.213363 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.213323    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-metrics-client-ca\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.213421 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.213361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.213421 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.213403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srzvs\" (UniqueName: \"kubernetes.io/projected/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-kube-api-access-srzvs\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.213520 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.213434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-federate-client-tls\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.213520 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.213471    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.213623 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.213539    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-secret-telemeter-client\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.213623 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.213569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-telemeter-client-tls\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.314198 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.314103    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-metrics-client-ca\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.314198 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.314151    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.314198 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.314191    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srzvs\" (UniqueName: \"kubernetes.io/projected/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-kube-api-access-srzvs\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.314454 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.314238    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-federate-client-tls\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.314454 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.314272    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.314454 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.314364    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-secret-telemeter-client\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.314454 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.314392    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-telemeter-client-tls\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.314655 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.314471    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-serving-certs-ca-bundle\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.316023 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.315960    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-serving-certs-ca-bundle\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.316023 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.315964    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-metrics-client-ca\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.316443 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.316398    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.318761 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.318714    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-secret-telemeter-client\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.320189 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.320147    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.320606 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.320570    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-telemeter-client-tls\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.321856 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.321815    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-federate-client-tls\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.332814 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.332698    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srzvs\" (UniqueName: \"kubernetes.io/projected/2dabe3e8-bbb4-439f-8e33-e6ca218f610d-kube-api-access-srzvs\") pod \"telemeter-client-5c496db4b5-x9crx\" (UID: \"2dabe3e8-bbb4-439f-8e33-e6ca218f610d\") " pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.475723 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.475306    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx"
Jun 03 16:47:02.681922 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:02.681884    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c496db4b5-x9crx"]
Jun 03 16:47:03.184016 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:47:03.183964    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dabe3e8_bbb4_439f_8e33_e6ca218f610d.slice/crio-db58a8ceba990e136bd39b577910592a3c9c829c84f6b1f0377b885342a1b90f WatchSource:0}: Error finding container db58a8ceba990e136bd39b577910592a3c9c829c84f6b1f0377b885342a1b90f: Status 404 returned error can't find the container with id db58a8ceba990e136bd39b577910592a3c9c829c84f6b1f0377b885342a1b90f
Jun 03 16:47:03.211742 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.211670    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx" event={"ID":"2dabe3e8-bbb4-439f-8e33-e6ca218f610d","Type":"ContainerStarted","Data":"db58a8ceba990e136bd39b577910592a3c9c829c84f6b1f0377b885342a1b90f"}
Jun 03 16:47:03.243156 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.242201    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 16:47:03.245894 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.245862    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.251599 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.251206    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 03 16:47:03.251599 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.251469    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 03 16:47:03.251804 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.251652    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fofh78vr1uele\""
Jun 03 16:47:03.251893 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.251874    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 03 16:47:03.252125 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.252108    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 03 16:47:03.252751 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.252713    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 03 16:47:03.252966 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.252947    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rx8rz\""
Jun 03 16:47:03.253149 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.253130    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 03 16:47:03.253325 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.253307    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 03 16:47:03.253699 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.253681    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 03 16:47:03.254240 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.254223    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 03 16:47:03.254555 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.254535    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 03 16:47:03.261419 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.261215    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 03 16:47:03.262427 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.261685    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 03 16:47:03.262427 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.261801    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 03 16:47:03.263819 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.263723    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 16:47:03.325998 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.325958    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326161 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326161 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326161 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326161 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326098    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68fcc7b9-cb89-4095-9fe1-e809afd452e8-config-out\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326161 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326433 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-config\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326433 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326217    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326433 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326433 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326275    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-web-config\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326433 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326299    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326433 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326324    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68fcc7b9-cb89-4095-9fe1-e809afd452e8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326433 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326347    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326433 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326433 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326429    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326901 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326901 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.326901 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.326586    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5chb7\" (UniqueName: \"kubernetes.io/projected/68fcc7b9-cb89-4095-9fe1-e809afd452e8-kube-api-access-5chb7\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.428000 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.427929    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.428000 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.427973    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.428000 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.428007    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.428280 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.428032    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.428492    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5chb7\" (UniqueName: \"kubernetes.io/projected/68fcc7b9-cb89-4095-9fe1-e809afd452e8-kube-api-access-5chb7\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.428555    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.428605    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.428639    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.428665    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.428704    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68fcc7b9-cb89-4095-9fe1-e809afd452e8-config-out\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.428914    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.429165    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.429487    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.429545    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-config\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.429576    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.429610    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.429636    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-web-config\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.429665    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.429694    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68fcc7b9-cb89-4095-9fe1-e809afd452e8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.429718    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.431591 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.429815    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.439712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.433454    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.439712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.434103    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.439712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.434442    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.439712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.434501    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.439712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.435199    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.439712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.435553    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.439712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.436841    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.439712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.436903    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.439712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.436949    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-config\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.439712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.438385    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-web-config\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.439712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.439308    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68fcc7b9-cb89-4095-9fe1-e809afd452e8-config-out\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.439712 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.439523    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.440329 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.439855    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.441279 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.441256    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68fcc7b9-cb89-4095-9fe1-e809afd452e8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.442106 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.442061    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5chb7\" (UniqueName: \"kubernetes.io/projected/68fcc7b9-cb89-4095-9fe1-e809afd452e8-kube-api-access-5chb7\") pod \"prometheus-k8s-0\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:03.571027 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:03.570956    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:09.727604 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:09.727526    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:47:11.552131 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:11.552074    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 16:47:11.882231 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:47:11.882191    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68fcc7b9_cb89_4095_9fe1_e809afd452e8.slice/crio-6344cb05468786225ba8300554911ddc7389b654421b72a5b1babdbe832453aa WatchSource:0}: Error finding container 6344cb05468786225ba8300554911ddc7389b654421b72a5b1babdbe832453aa: Status 404 returned error can't find the container with id 6344cb05468786225ba8300554911ddc7389b654421b72a5b1babdbe832453aa
Jun 03 16:47:12.245467 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.245394    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx" event={"ID":"2dabe3e8-bbb4-439f-8e33-e6ca218f610d","Type":"ContainerStarted","Data":"69d4303607c597aaf45d378b1e28c597d5fdcc3fea472f3f9392958868fd809b"}
Jun 03 16:47:12.245467 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.245436    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx" event={"ID":"2dabe3e8-bbb4-439f-8e33-e6ca218f610d","Type":"ContainerStarted","Data":"daaa4aeac32349363f8c79a2b0888a8b0581f278aba52ebac708966d36e9414c"}
Jun 03 16:47:12.247456 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.247423    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-9brzt" event={"ID":"d88b2bfd-2f3c-4a8b-a72e-3a4a54fa4459","Type":"ContainerStarted","Data":"2669178c42f914fd7653fa40184d5eadc4c45eea4a541b504b6169b4599c39d3"}
Jun 03 16:47:12.248296 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.248256    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-9brzt"
Jun 03 16:47:12.249720 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.249598    2563 patch_prober.go:28] interesting pod/downloads-c65b8dc4b-9brzt container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.15:8080/\": dial tcp 10.134.0.15:8080: connect: connection refused" start-of-body=
Jun 03 16:47:12.249720 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.249656    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-c65b8dc4b-9brzt" podUID="d88b2bfd-2f3c-4a8b-a72e-3a4a54fa4459" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.15:8080/\": dial tcp 10.134.0.15:8080: connect: connection refused"
Jun 03 16:47:12.250791 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.250715    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qd8tz" event={"ID":"95cf9da9-dd78-4443-95a9-90e29b37c406","Type":"ContainerStarted","Data":"733be60a4c7f859e731f60696b9e91a926ad4c0d6525ca960d016404a4f615dd"}
Jun 03 16:47:12.250791 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.250764    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qd8tz" event={"ID":"95cf9da9-dd78-4443-95a9-90e29b37c406","Type":"ContainerStarted","Data":"b8bc88ad010b2892e21ff867640cd11c8acb46726850083c9f6fe888d83fa172"}
Jun 03 16:47:12.250957 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.250863    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:47:12.252892 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.252862    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-9689v" event={"ID":"ed2a871e-c9cb-4e1e-bde0-6a527cd1e828","Type":"ContainerStarted","Data":"c634acf645caa8ff56979f41b6ae62fbab94f284e7a45a7bb859b0b05ccb23bb"}
Jun 03 16:47:12.253748 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.253675    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-9689v"
Jun 03 16:47:12.255654 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.255513    2563 generic.go:358] "Generic (PLEG): container finished" podID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerID="a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32" exitCode=0
Jun 03 16:47:12.255654 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.255607    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68fcc7b9-cb89-4095-9fe1-e809afd452e8","Type":"ContainerDied","Data":"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32"}
Jun 03 16:47:12.255654 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.255629    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68fcc7b9-cb89-4095-9fe1-e809afd452e8","Type":"ContainerStarted","Data":"6344cb05468786225ba8300554911ddc7389b654421b72a5b1babdbe832453aa"}
Jun 03 16:47:12.259866 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.259848    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-9689v"
Jun 03 16:47:12.260944 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.260925    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"284f44d2-e997-4b6a-b91a-0340ac542491","Type":"ContainerStarted","Data":"92a0669b6d63a141f89d82a72c9e32f497e11687d62d68281d07a5783158c22d"}
Jun 03 16:47:12.261151 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.261134    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"284f44d2-e997-4b6a-b91a-0340ac542491","Type":"ContainerStarted","Data":"1a2c95d699af29915459e5aca224cb548fbc0dd617ec52016a6646d2dbf914e8"}
Jun 03 16:47:12.261262 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.261239    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"284f44d2-e997-4b6a-b91a-0340ac542491","Type":"ContainerStarted","Data":"9025b8e392789f4e53f83cdea292e3285fb092b4afae84f78a0889e1f5aeebe4"}
Jun 03 16:47:12.263708 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.263249    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nvvnn" event={"ID":"fd962829-ced6-4a41-9570-0dc87e34f793","Type":"ContainerStarted","Data":"ffd12c3511fbe22d2c3221df14e931cbec457b10cc1bb7f3dfee2e715997aa66"}
Jun 03 16:47:12.266538 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.266493    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-9brzt" podStartSLOduration=1.468961449 podStartE2EDuration="23.266478135s" podCreationTimestamp="2026-06-03 16:46:49 +0000 UTC" firstStartedPulling="2026-06-03 16:46:50.154287369 +0000 UTC m=+151.875179640" lastFinishedPulling="2026-06-03 16:47:11.951804043 +0000 UTC m=+173.672696326" observedRunningTime="2026-06-03 16:47:12.264314278 +0000 UTC m=+173.985206574" watchObservedRunningTime="2026-06-03 16:47:12.266478135 +0000 UTC m=+173.987370429"
Jun 03 16:47:12.287088 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.287022    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-qd8tz" podStartSLOduration=130.045295433 podStartE2EDuration="2m20.287001737s" podCreationTimestamp="2026-06-03 16:44:52 +0000 UTC" firstStartedPulling="2026-06-03 16:47:01.16690894 +0000 UTC m=+162.887801217" lastFinishedPulling="2026-06-03 16:47:11.408615239 +0000 UTC m=+173.129507521" observedRunningTime="2026-06-03 16:47:12.286259789 +0000 UTC m=+174.007152106" watchObservedRunningTime="2026-06-03 16:47:12.287001737 +0000 UTC m=+174.007894033"
Jun 03 16:47:12.305999 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.305661    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-9689v" podStartSLOduration=1.610420736 podStartE2EDuration="11.305642722s" podCreationTimestamp="2026-06-03 16:47:01 +0000 UTC" firstStartedPulling="2026-06-03 16:47:02.187880585 +0000 UTC m=+163.908772858" lastFinishedPulling="2026-06-03 16:47:11.883102563 +0000 UTC m=+173.603994844" observedRunningTime="2026-06-03 16:47:12.305377536 +0000 UTC m=+174.026269832" watchObservedRunningTime="2026-06-03 16:47:12.305642722 +0000 UTC m=+174.026535016"
Jun 03 16:47:12.355237 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:12.355133    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nvvnn" podStartSLOduration=129.662432823 podStartE2EDuration="2m20.355117026s" podCreationTimestamp="2026-06-03 16:44:52 +0000 UTC" firstStartedPulling="2026-06-03 16:47:01.187468862 +0000 UTC m=+162.908361147" lastFinishedPulling="2026-06-03 16:47:11.880153066 +0000 UTC m=+173.601045350" observedRunningTime="2026-06-03 16:47:12.353991461 +0000 UTC m=+174.074883766" watchObservedRunningTime="2026-06-03 16:47:12.355117026 +0000 UTC m=+174.076009319"
Jun 03 16:47:13.272468 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:13.272219    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx" event={"ID":"2dabe3e8-bbb4-439f-8e33-e6ca218f610d","Type":"ContainerStarted","Data":"f4aa1b8743cd36af40e4d6aafa82264127a0ddb6e4ad880c540ba9aa49b866f4"}
Jun 03 16:47:13.276680 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:13.276287    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"284f44d2-e997-4b6a-b91a-0340ac542491","Type":"ContainerStarted","Data":"224f32e12cc556757fb8ba8338fd84d57a5b94cf34b7fc6c01e9539ef93f33b6"}
Jun 03 16:47:13.276680 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:13.276320    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"284f44d2-e997-4b6a-b91a-0340ac542491","Type":"ContainerStarted","Data":"d56fadb4d7e296d727e0b7c8408ef19339414639d39b3023699a20e678f9b4aa"}
Jun 03 16:47:13.291065 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:13.291004    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-9brzt"
Jun 03 16:47:13.298269 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:13.298193    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c496db4b5-x9crx" podStartSLOduration=2.566312496 podStartE2EDuration="11.298173718s" podCreationTimestamp="2026-06-03 16:47:02 +0000 UTC" firstStartedPulling="2026-06-03 16:47:03.186123963 +0000 UTC m=+164.907016233" lastFinishedPulling="2026-06-03 16:47:11.917985183 +0000 UTC m=+173.638877455" observedRunningTime="2026-06-03 16:47:13.296114575 +0000 UTC m=+175.017006865" watchObservedRunningTime="2026-06-03 16:47:13.298173718 +0000 UTC m=+175.019066012"
Jun 03 16:47:14.284851 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:14.284793    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"284f44d2-e997-4b6a-b91a-0340ac542491","Type":"ContainerStarted","Data":"30e367b325968742ae9fbaf65702700298456e6884cc8a290480f07313a4a6f7"}
Jun 03 16:47:14.316953 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:14.316589    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.9046199230000003 podStartE2EDuration="17.316569188s" podCreationTimestamp="2026-06-03 16:46:57 +0000 UTC" firstStartedPulling="2026-06-03 16:46:59.476141747 +0000 UTC m=+161.197034021" lastFinishedPulling="2026-06-03 16:47:13.888091015 +0000 UTC m=+175.608983286" observedRunningTime="2026-06-03 16:47:14.31589962 +0000 UTC m=+176.036791915" watchObservedRunningTime="2026-06-03 16:47:14.316569188 +0000 UTC m=+176.037461482"
Jun 03 16:47:16.295269 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:16.295199    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68fcc7b9-cb89-4095-9fe1-e809afd452e8","Type":"ContainerStarted","Data":"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca"}
Jun 03 16:47:16.295269 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:16.295245    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68fcc7b9-cb89-4095-9fe1-e809afd452e8","Type":"ContainerStarted","Data":"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29"}
Jun 03 16:47:19.314216 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:19.314187    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68fcc7b9-cb89-4095-9fe1-e809afd452e8","Type":"ContainerStarted","Data":"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730"}
Jun 03 16:47:19.314602 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:19.314228    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68fcc7b9-cb89-4095-9fe1-e809afd452e8","Type":"ContainerStarted","Data":"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d"}
Jun 03 16:47:19.314602 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:19.314242    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68fcc7b9-cb89-4095-9fe1-e809afd452e8","Type":"ContainerStarted","Data":"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172"}
Jun 03 16:47:20.320994 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:20.320952    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68fcc7b9-cb89-4095-9fe1-e809afd452e8","Type":"ContainerStarted","Data":"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270"}
Jun 03 16:47:20.351631 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:20.351578    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=10.731961522 podStartE2EDuration="17.351563249s" podCreationTimestamp="2026-06-03 16:47:03 +0000 UTC" firstStartedPulling="2026-06-03 16:47:12.257294105 +0000 UTC m=+173.978186377" lastFinishedPulling="2026-06-03 16:47:18.876895818 +0000 UTC m=+180.597788104" observedRunningTime="2026-06-03 16:47:20.348608235 +0000 UTC m=+182.069500539" watchObservedRunningTime="2026-06-03 16:47:20.351563249 +0000 UTC m=+182.072455541"
Jun 03 16:47:22.279175 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:22.279140    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qd8tz"
Jun 03 16:47:23.571920 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:23.571889    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:47:34.364482 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:34.364388    2563 generic.go:358] "Generic (PLEG): container finished" podID="58250ca1-fc0c-443c-bc0b-adc42eb0f95e" containerID="898864b4293c4f2d8bc763a157d88f58604f54d60612f9a0a473b6892d9c3231" exitCode=0
Jun 03 16:47:34.364482 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:34.364421    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-57k47" event={"ID":"58250ca1-fc0c-443c-bc0b-adc42eb0f95e","Type":"ContainerDied","Data":"898864b4293c4f2d8bc763a157d88f58604f54d60612f9a0a473b6892d9c3231"}
Jun 03 16:47:34.364918 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:34.364724    2563 scope.go:117] "RemoveContainer" containerID="898864b4293c4f2d8bc763a157d88f58604f54d60612f9a0a473b6892d9c3231"
Jun 03 16:47:35.369075 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:35.369038    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-57k47" event={"ID":"58250ca1-fc0c-443c-bc0b-adc42eb0f95e","Type":"ContainerStarted","Data":"3ce561a762d6c686879742a463f593c889569d268a4c25423841f2dc3c7036ab"}
Jun 03 16:47:35.539129 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:35.539101    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qd8tz_95cf9da9-dd78-4443-95a9-90e29b37c406/dns/0.log"
Jun 03 16:47:35.545617 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:35.545589    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qd8tz_95cf9da9-dd78-4443-95a9-90e29b37c406/kube-rbac-proxy/0.log"
Jun 03 16:47:36.093288 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:36.093261    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lpn2p_ca235535-73f8-4549-bf3c-b7a3491f2b90/dns-node-resolver/0.log"
Jun 03 16:47:37.293445 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:47:37.293418    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k5dwb_794e1bba-9e19-4e85-af4a-d0cf61fba88f/node-ca/0.log"
Jun 03 16:48:03.571216 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:03.571185    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:03.586834 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:03.586809    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:04.476138 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:04.476113    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:17.324400 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:17.324366    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 16:48:17.324832 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:17.324806    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="alertmanager" containerID="cri-o://9025b8e392789f4e53f83cdea292e3285fb092b4afae84f78a0889e1f5aeebe4" gracePeriod=120
Jun 03 16:48:17.324944 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:17.324889    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="kube-rbac-proxy-metric" containerID="cri-o://224f32e12cc556757fb8ba8338fd84d57a5b94cf34b7fc6c01e9539ef93f33b6" gracePeriod=120
Jun 03 16:48:17.325022 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:17.324938    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="prom-label-proxy" containerID="cri-o://30e367b325968742ae9fbaf65702700298456e6884cc8a290480f07313a4a6f7" gracePeriod=120
Jun 03 16:48:17.325022 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:17.324964    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="kube-rbac-proxy" containerID="cri-o://d56fadb4d7e296d727e0b7c8408ef19339414639d39b3023699a20e678f9b4aa" gracePeriod=120
Jun 03 16:48:17.325114 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:17.324895    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="kube-rbac-proxy-web" containerID="cri-o://92a0669b6d63a141f89d82a72c9e32f497e11687d62d68281d07a5783158c22d" gracePeriod=120
Jun 03 16:48:17.325162 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:17.325087    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="config-reloader" containerID="cri-o://1a2c95d699af29915459e5aca224cb548fbc0dd617ec52016a6646d2dbf914e8" gracePeriod=120
Jun 03 16:48:17.501091 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:17.501065    2563 generic.go:358] "Generic (PLEG): container finished" podID="284f44d2-e997-4b6a-b91a-0340ac542491" containerID="30e367b325968742ae9fbaf65702700298456e6884cc8a290480f07313a4a6f7" exitCode=0
Jun 03 16:48:17.501091 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:17.501089    2563 generic.go:358] "Generic (PLEG): container finished" podID="284f44d2-e997-4b6a-b91a-0340ac542491" containerID="d56fadb4d7e296d727e0b7c8408ef19339414639d39b3023699a20e678f9b4aa" exitCode=0
Jun 03 16:48:17.501091 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:17.501096    2563 generic.go:358] "Generic (PLEG): container finished" podID="284f44d2-e997-4b6a-b91a-0340ac542491" containerID="1a2c95d699af29915459e5aca224cb548fbc0dd617ec52016a6646d2dbf914e8" exitCode=0
Jun 03 16:48:17.501091 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:17.501101    2563 generic.go:358] "Generic (PLEG): container finished" podID="284f44d2-e997-4b6a-b91a-0340ac542491" containerID="9025b8e392789f4e53f83cdea292e3285fb092b4afae84f78a0889e1f5aeebe4" exitCode=0
Jun 03 16:48:17.501301 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:17.501137    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"284f44d2-e997-4b6a-b91a-0340ac542491","Type":"ContainerDied","Data":"30e367b325968742ae9fbaf65702700298456e6884cc8a290480f07313a4a6f7"}
Jun 03 16:48:17.501301 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:17.501169    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"284f44d2-e997-4b6a-b91a-0340ac542491","Type":"ContainerDied","Data":"d56fadb4d7e296d727e0b7c8408ef19339414639d39b3023699a20e678f9b4aa"}
Jun 03 16:48:17.501301 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:17.501182    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"284f44d2-e997-4b6a-b91a-0340ac542491","Type":"ContainerDied","Data":"1a2c95d699af29915459e5aca224cb548fbc0dd617ec52016a6646d2dbf914e8"}
Jun 03 16:48:17.501301 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:17.501196    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"284f44d2-e997-4b6a-b91a-0340ac542491","Type":"ContainerDied","Data":"9025b8e392789f4e53f83cdea292e3285fb092b4afae84f78a0889e1f5aeebe4"}
Jun 03 16:48:18.507725 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.507699    2563 generic.go:358] "Generic (PLEG): container finished" podID="284f44d2-e997-4b6a-b91a-0340ac542491" containerID="224f32e12cc556757fb8ba8338fd84d57a5b94cf34b7fc6c01e9539ef93f33b6" exitCode=0
Jun 03 16:48:18.507725 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.507721    2563 generic.go:358] "Generic (PLEG): container finished" podID="284f44d2-e997-4b6a-b91a-0340ac542491" containerID="92a0669b6d63a141f89d82a72c9e32f497e11687d62d68281d07a5783158c22d" exitCode=0
Jun 03 16:48:18.508213 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.507790    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"284f44d2-e997-4b6a-b91a-0340ac542491","Type":"ContainerDied","Data":"224f32e12cc556757fb8ba8338fd84d57a5b94cf34b7fc6c01e9539ef93f33b6"}
Jun 03 16:48:18.508213 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.507823    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"284f44d2-e997-4b6a-b91a-0340ac542491","Type":"ContainerDied","Data":"92a0669b6d63a141f89d82a72c9e32f497e11687d62d68281d07a5783158c22d"}
Jun 03 16:48:18.567263 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.567242    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:18.612085 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.612059    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/284f44d2-e997-4b6a-b91a-0340ac542491-config-out\") pod \"284f44d2-e997-4b6a-b91a-0340ac542491\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") "
Jun 03 16:48:18.612251 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.612093    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy-metric\") pod \"284f44d2-e997-4b6a-b91a-0340ac542491\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") "
Jun 03 16:48:18.612251 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.612109    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-cluster-tls-config\") pod \"284f44d2-e997-4b6a-b91a-0340ac542491\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") "
Jun 03 16:48:18.612251 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.612143    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnkzd\" (UniqueName: \"kubernetes.io/projected/284f44d2-e997-4b6a-b91a-0340ac542491-kube-api-access-cnkzd\") pod \"284f44d2-e997-4b6a-b91a-0340ac542491\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") "
Jun 03 16:48:18.612251 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.612166    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/284f44d2-e997-4b6a-b91a-0340ac542491-tls-assets\") pod \"284f44d2-e997-4b6a-b91a-0340ac542491\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") "
Jun 03 16:48:18.612251 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.612192    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284f44d2-e997-4b6a-b91a-0340ac542491-alertmanager-trusted-ca-bundle\") pod \"284f44d2-e997-4b6a-b91a-0340ac542491\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") "
Jun 03 16:48:18.612939 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.612880    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/284f44d2-e997-4b6a-b91a-0340ac542491-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "284f44d2-e997-4b6a-b91a-0340ac542491" (UID: "284f44d2-e997-4b6a-b91a-0340ac542491"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 16:48:18.612939 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.612903    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/284f44d2-e997-4b6a-b91a-0340ac542491-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "284f44d2-e997-4b6a-b91a-0340ac542491" (UID: "284f44d2-e997-4b6a-b91a-0340ac542491"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 16:48:18.613277 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.612954    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/284f44d2-e997-4b6a-b91a-0340ac542491-alertmanager-main-db\") pod \"284f44d2-e997-4b6a-b91a-0340ac542491\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") "
Jun 03 16:48:18.614566 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.614545    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy-web\") pod \"284f44d2-e997-4b6a-b91a-0340ac542491\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") "
Jun 03 16:48:18.614723 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.614706    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-main-tls\") pod \"284f44d2-e997-4b6a-b91a-0340ac542491\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") "
Jun 03 16:48:18.615252 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.615231    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy\") pod \"284f44d2-e997-4b6a-b91a-0340ac542491\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") "
Jun 03 16:48:18.615402 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.615386    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/284f44d2-e997-4b6a-b91a-0340ac542491-metrics-client-ca\") pod \"284f44d2-e997-4b6a-b91a-0340ac542491\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") "
Jun 03 16:48:18.615563 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.615550    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-web-config\") pod \"284f44d2-e997-4b6a-b91a-0340ac542491\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") "
Jun 03 16:48:18.615677 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.615663    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-config-volume\") pod \"284f44d2-e997-4b6a-b91a-0340ac542491\" (UID: \"284f44d2-e997-4b6a-b91a-0340ac542491\") "
Jun 03 16:48:18.616265 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.615871    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "284f44d2-e997-4b6a-b91a-0340ac542491" (UID: "284f44d2-e997-4b6a-b91a-0340ac542491"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:48:18.616675 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.616654    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284f44d2-e997-4b6a-b91a-0340ac542491-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:18.616807 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.616792    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/284f44d2-e997-4b6a-b91a-0340ac542491-alertmanager-main-db\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:18.616917 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.616904    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:18.617763 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.617611    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "284f44d2-e997-4b6a-b91a-0340ac542491" (UID: "284f44d2-e997-4b6a-b91a-0340ac542491"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:48:18.617763 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.617691    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/284f44d2-e997-4b6a-b91a-0340ac542491-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "284f44d2-e997-4b6a-b91a-0340ac542491" (UID: "284f44d2-e997-4b6a-b91a-0340ac542491"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 16:48:18.617992 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.617965    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/284f44d2-e997-4b6a-b91a-0340ac542491-config-out" (OuterVolumeSpecName: "config-out") pod "284f44d2-e997-4b6a-b91a-0340ac542491" (UID: "284f44d2-e997-4b6a-b91a-0340ac542491"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 16:48:18.619440 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.619390    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/284f44d2-e997-4b6a-b91a-0340ac542491-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "284f44d2-e997-4b6a-b91a-0340ac542491" (UID: "284f44d2-e997-4b6a-b91a-0340ac542491"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 16:48:18.621061 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.620883    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "284f44d2-e997-4b6a-b91a-0340ac542491" (UID: "284f44d2-e997-4b6a-b91a-0340ac542491"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:48:18.621061 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.620954    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-config-volume" (OuterVolumeSpecName: "config-volume") pod "284f44d2-e997-4b6a-b91a-0340ac542491" (UID: "284f44d2-e997-4b6a-b91a-0340ac542491"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:48:18.621061 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.621002    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/284f44d2-e997-4b6a-b91a-0340ac542491-kube-api-access-cnkzd" (OuterVolumeSpecName: "kube-api-access-cnkzd") pod "284f44d2-e997-4b6a-b91a-0340ac542491" (UID: "284f44d2-e997-4b6a-b91a-0340ac542491"). InnerVolumeSpecName "kube-api-access-cnkzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 16:48:18.623899 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.623388    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "284f44d2-e997-4b6a-b91a-0340ac542491" (UID: "284f44d2-e997-4b6a-b91a-0340ac542491"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:48:18.624881 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.624201    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "284f44d2-e997-4b6a-b91a-0340ac542491" (UID: "284f44d2-e997-4b6a-b91a-0340ac542491"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:48:18.635679 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.635658    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-web-config" (OuterVolumeSpecName: "web-config") pod "284f44d2-e997-4b6a-b91a-0340ac542491" (UID: "284f44d2-e997-4b6a-b91a-0340ac542491"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:48:18.717799 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.717709    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:18.717799 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.717755    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-main-tls\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:18.717799 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.717766    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:18.717799 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.717776    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/284f44d2-e997-4b6a-b91a-0340ac542491-metrics-client-ca\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:18.717799 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.717785    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-web-config\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:18.717799 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.717793    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-config-volume\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:18.717799 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.717801    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/284f44d2-e997-4b6a-b91a-0340ac542491-config-out\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:18.718104 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.717809    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/284f44d2-e997-4b6a-b91a-0340ac542491-cluster-tls-config\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:18.718104 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.717817    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnkzd\" (UniqueName: \"kubernetes.io/projected/284f44d2-e997-4b6a-b91a-0340ac542491-kube-api-access-cnkzd\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:18.718104 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:18.717825    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/284f44d2-e997-4b6a-b91a-0340ac542491-tls-assets\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:19.514564 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.514532    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"284f44d2-e997-4b6a-b91a-0340ac542491","Type":"ContainerDied","Data":"3d06f1c04f3e0ea69f25bbdc1904285e0d0bff0d70f09d2a58a600876cd8ca40"}
Jun 03 16:48:19.514564 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.514579    2563 scope.go:117] "RemoveContainer" containerID="30e367b325968742ae9fbaf65702700298456e6884cc8a290480f07313a4a6f7"
Jun 03 16:48:19.515047 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.514601    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.521637 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.521618    2563 scope.go:117] "RemoveContainer" containerID="224f32e12cc556757fb8ba8338fd84d57a5b94cf34b7fc6c01e9539ef93f33b6"
Jun 03 16:48:19.528233 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.528218    2563 scope.go:117] "RemoveContainer" containerID="d56fadb4d7e296d727e0b7c8408ef19339414639d39b3023699a20e678f9b4aa"
Jun 03 16:48:19.534144 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.534105    2563 scope.go:117] "RemoveContainer" containerID="92a0669b6d63a141f89d82a72c9e32f497e11687d62d68281d07a5783158c22d"
Jun 03 16:48:19.537782 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.537763    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 16:48:19.541784 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.541755    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 16:48:19.541856 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.541843    2563 scope.go:117] "RemoveContainer" containerID="1a2c95d699af29915459e5aca224cb548fbc0dd617ec52016a6646d2dbf914e8"
Jun 03 16:48:19.548059 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.548042    2563 scope.go:117] "RemoveContainer" containerID="9025b8e392789f4e53f83cdea292e3285fb092b4afae84f78a0889e1f5aeebe4"
Jun 03 16:48:19.554360 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.554342    2563 scope.go:117] "RemoveContainer" containerID="eaf7f72538711d068f215131902436e28234ffa0ab96b06ff4851b656c48d09c"
Jun 03 16:48:19.605904 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.605874    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 16:48:19.606361 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606343    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="config-reloader"
Jun 03 16:48:19.606422 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606365    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="config-reloader"
Jun 03 16:48:19.606422 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606390    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="prom-label-proxy"
Jun 03 16:48:19.606422 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606398    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="prom-label-proxy"
Jun 03 16:48:19.606422 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606413    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="kube-rbac-proxy-metric"
Jun 03 16:48:19.606422 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606422    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="kube-rbac-proxy-metric"
Jun 03 16:48:19.606629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606436    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="alertmanager"
Jun 03 16:48:19.606629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606444    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="alertmanager"
Jun 03 16:48:19.606629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606454    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="kube-rbac-proxy"
Jun 03 16:48:19.606629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606461    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="kube-rbac-proxy"
Jun 03 16:48:19.606629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606475    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="kube-rbac-proxy-web"
Jun 03 16:48:19.606629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606483    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="kube-rbac-proxy-web"
Jun 03 16:48:19.606629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606496    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="init-config-reloader"
Jun 03 16:48:19.606629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606503    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="init-config-reloader"
Jun 03 16:48:19.606629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606573    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="alertmanager"
Jun 03 16:48:19.606629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606583    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="kube-rbac-proxy-metric"
Jun 03 16:48:19.606629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606594    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="config-reloader"
Jun 03 16:48:19.606629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606604    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="kube-rbac-proxy"
Jun 03 16:48:19.606629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606614    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="prom-label-proxy"
Jun 03 16:48:19.606629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.606623    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" containerName="kube-rbac-proxy-web"
Jun 03 16:48:19.610589 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.610570    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.615925 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.615890    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 03 16:48:19.616600 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.616269    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 03 16:48:19.616600 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.616468    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 03 16:48:19.618845 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.618828    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 03 16:48:19.621967 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.619042    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 03 16:48:19.622213 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.619092    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 03 16:48:19.622826 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.619137    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-z5557\""
Jun 03 16:48:19.623097 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.620189    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 03 16:48:19.623600 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.620247    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 03 16:48:19.632218 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.632197    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 16:48:19.632624 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.632603    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 03 16:48:19.723778 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.723679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-web-config\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.723778 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.723713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-config-volume\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.723778 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.723747    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.723980 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.723831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.723980 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.723867    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96b615bf-4bf8-4f63-9e64-1c59349c9535-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.723980 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.723935    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96b615bf-4bf8-4f63-9e64-1c59349c9535-config-out\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.723980 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.723973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.724102 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.723997    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b615bf-4bf8-4f63-9e64-1c59349c9535-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.724102 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.724045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.724102 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.724076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh8kw\" (UniqueName: \"kubernetes.io/projected/96b615bf-4bf8-4f63-9e64-1c59349c9535-kube-api-access-lh8kw\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.724190 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.724117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96b615bf-4bf8-4f63-9e64-1c59349c9535-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.724190 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.724149    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.724190 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.724173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96b615bf-4bf8-4f63-9e64-1c59349c9535-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.824662 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.824631    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96b615bf-4bf8-4f63-9e64-1c59349c9535-config-out\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.824842 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.824671    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.824842 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.824701    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b615bf-4bf8-4f63-9e64-1c59349c9535-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.824842 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.824768    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.824985 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.824950    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lh8kw\" (UniqueName: \"kubernetes.io/projected/96b615bf-4bf8-4f63-9e64-1c59349c9535-kube-api-access-lh8kw\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.825039 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.825002    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96b615bf-4bf8-4f63-9e64-1c59349c9535-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.825086 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.825054    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.825143 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.825082    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96b615bf-4bf8-4f63-9e64-1c59349c9535-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.825143 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.825117    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-web-config\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.825240 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.825145    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-config-volume\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.825240 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.825172    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.825240 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.825213    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.825382 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.825246    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96b615bf-4bf8-4f63-9e64-1c59349c9535-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.825547 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.825527    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96b615bf-4bf8-4f63-9e64-1c59349c9535-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.825879 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.825852    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b615bf-4bf8-4f63-9e64-1c59349c9535-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.827094 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.827066    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96b615bf-4bf8-4f63-9e64-1c59349c9535-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.827886 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.827821    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.827886 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.827834    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.828201 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.828145    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96b615bf-4bf8-4f63-9e64-1c59349c9535-config-out\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.828314 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.828227    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-config-volume\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.828378 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.828333    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.828769 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.828747    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-web-config\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.828847 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.828755    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.829197 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.829175    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96b615bf-4bf8-4f63-9e64-1c59349c9535-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.829550 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.829529    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96b615bf-4bf8-4f63-9e64-1c59349c9535-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.834208 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.834185    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh8kw\" (UniqueName: \"kubernetes.io/projected/96b615bf-4bf8-4f63-9e64-1c59349c9535-kube-api-access-lh8kw\") pod \"alertmanager-main-0\" (UID: \"96b615bf-4bf8-4f63-9e64-1c59349c9535\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:19.932487 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:19.932459    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 16:48:20.063801 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:20.063762    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 16:48:20.066680 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:48:20.066651    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b615bf_4bf8_4f63_9e64_1c59349c9535.slice/crio-dc165f4d570aed697adfce0f01ff867a52144ff8f005ba4514a7f2486298e189 WatchSource:0}: Error finding container dc165f4d570aed697adfce0f01ff867a52144ff8f005ba4514a7f2486298e189: Status 404 returned error can't find the container with id dc165f4d570aed697adfce0f01ff867a52144ff8f005ba4514a7f2486298e189
Jun 03 16:48:20.519899 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:20.519864    2563 generic.go:358] "Generic (PLEG): container finished" podID="96b615bf-4bf8-4f63-9e64-1c59349c9535" containerID="effb6b830f1e77cca8ec64be0c97822199a871286950224be5e5f7c7eaa729f3" exitCode=0
Jun 03 16:48:20.520239 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:20.519908    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96b615bf-4bf8-4f63-9e64-1c59349c9535","Type":"ContainerDied","Data":"effb6b830f1e77cca8ec64be0c97822199a871286950224be5e5f7c7eaa729f3"}
Jun 03 16:48:20.520239 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:20.519931    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96b615bf-4bf8-4f63-9e64-1c59349c9535","Type":"ContainerStarted","Data":"dc165f4d570aed697adfce0f01ff867a52144ff8f005ba4514a7f2486298e189"}
Jun 03 16:48:20.732551 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:20.732513    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="284f44d2-e997-4b6a-b91a-0340ac542491" path="/var/lib/kubelet/pods/284f44d2-e997-4b6a-b91a-0340ac542491/volumes"
Jun 03 16:48:21.526969 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.526918    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96b615bf-4bf8-4f63-9e64-1c59349c9535","Type":"ContainerStarted","Data":"614db640a7a4f76cba49ae4eab77f0c02fba0b87e5d0104b6b787570e0776648"}
Jun 03 16:48:21.526969 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.526963    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96b615bf-4bf8-4f63-9e64-1c59349c9535","Type":"ContainerStarted","Data":"a27e36243c0de821c597aa55e1a39113c02f62e352b9a909d9bca52047fd3a28"}
Jun 03 16:48:21.526969 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.526977    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96b615bf-4bf8-4f63-9e64-1c59349c9535","Type":"ContainerStarted","Data":"20c27937dc42b964dafa29374601fe688bda89b303894288dea34a279b04fd8b"}
Jun 03 16:48:21.527454 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.526989    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96b615bf-4bf8-4f63-9e64-1c59349c9535","Type":"ContainerStarted","Data":"6b47f82ee14150779b435f0714bab6ef597a7c19c59bd308b5b8a3950654db9a"}
Jun 03 16:48:21.527454 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.526998    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96b615bf-4bf8-4f63-9e64-1c59349c9535","Type":"ContainerStarted","Data":"4d2f76a45038df5e924a2dcbea2a93829bb3a5d2cd2dffca55ce42d735bdf7a8"}
Jun 03 16:48:21.527454 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.527006    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96b615bf-4bf8-4f63-9e64-1c59349c9535","Type":"ContainerStarted","Data":"200139cada5f3b7093b938ebcfc0f30042ef3806700c5875513a9088c71f0465"}
Jun 03 16:48:21.556566 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.556522    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.556506576 podStartE2EDuration="2.556506576s" podCreationTimestamp="2026-06-03 16:48:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:48:21.554418564 +0000 UTC m=+243.275310867" watchObservedRunningTime="2026-06-03 16:48:21.556506576 +0000 UTC m=+243.277398868"
Jun 03 16:48:21.561615 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.561584    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 16:48:21.562117 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.562087    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="prometheus" containerID="cri-o://8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29" gracePeriod=600
Jun 03 16:48:21.562490 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.562460    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="kube-rbac-proxy-thanos" containerID="cri-o://86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270" gracePeriod=600
Jun 03 16:48:21.562614 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.562568    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="kube-rbac-proxy" containerID="cri-o://a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730" gracePeriod=600
Jun 03 16:48:21.562671 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.562623    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="kube-rbac-proxy-web" containerID="cri-o://8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d" gracePeriod=600
Jun 03 16:48:21.563124 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.562680    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="thanos-sidecar" containerID="cri-o://6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172" gracePeriod=600
Jun 03 16:48:21.563124 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.562754    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="config-reloader" containerID="cri-o://216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca" gracePeriod=600
Jun 03 16:48:21.816440 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.816104    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:21.842944 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.842891    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-metrics-client-certs\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843096 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.842977    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843096 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843068    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843105    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-kubelet-serving-ca-bundle\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843138    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68fcc7b9-cb89-4095-9fe1-e809afd452e8-tls-assets\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843179    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-kube-rbac-proxy\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843206    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5chb7\" (UniqueName: \"kubernetes.io/projected/68fcc7b9-cb89-4095-9fe1-e809afd452e8-kube-api-access-5chb7\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843245    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68fcc7b9-cb89-4095-9fe1-e809afd452e8-config-out\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843269    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-k8s-rulefiles-0\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843579 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843300    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-serving-certs-ca-bundle\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843579 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843336    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-metrics-client-ca\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843579 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843368    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-config\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843579 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843393    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-grpc-tls\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843579 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843419    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-trusted-ca-bundle\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843579 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843449    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-tls\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843579 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843495    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-web-config\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843579 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843523    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-thanos-prometheus-http-client-file\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.843579 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843564    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-k8s-db\") pod \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\" (UID: \"68fcc7b9-cb89-4095-9fe1-e809afd452e8\") "
Jun 03 16:48:21.844013 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843722    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 16:48:21.844013 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.843914    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.844392 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.844259    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 16:48:21.844480 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.844411    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 16:48:21.846130 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.846059    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 16:48:21.846236 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.846213    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:48:21.846576 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.846459    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 16:48:21.846960 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.846665    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 16:48:21.848073 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.848018    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68fcc7b9-cb89-4095-9fe1-e809afd452e8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 16:48:21.850211 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.850175    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:48:21.850435 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.850403    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68fcc7b9-cb89-4095-9fe1-e809afd452e8-kube-api-access-5chb7" (OuterVolumeSpecName: "kube-api-access-5chb7") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "kube-api-access-5chb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 16:48:21.850665 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.850630    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:48:21.850919 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.850895    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:48:21.851160 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.851136    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:48:21.851629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.851599    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68fcc7b9-cb89-4095-9fe1-e809afd452e8-config-out" (OuterVolumeSpecName: "config-out") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 16:48:21.852963 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.852935    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:48:21.853151 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.853119    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:48:21.853557 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.853531    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-config" (OuterVolumeSpecName: "config") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:48:21.861166 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.861144    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-web-config" (OuterVolumeSpecName: "web-config") pod "68fcc7b9-cb89-4095-9fe1-e809afd452e8" (UID: "68fcc7b9-cb89-4095-9fe1-e809afd452e8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:48:21.945066 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945034    2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-metrics-client-certs\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.945066 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945065    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.945287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945080    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.945287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945093    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68fcc7b9-cb89-4095-9fe1-e809afd452e8-tls-assets\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.945287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945105    2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-kube-rbac-proxy\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.945287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945116    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5chb7\" (UniqueName: \"kubernetes.io/projected/68fcc7b9-cb89-4095-9fe1-e809afd452e8-kube-api-access-5chb7\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.945287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945128    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68fcc7b9-cb89-4095-9fe1-e809afd452e8-config-out\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.945287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945140    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.945287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945153    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.945287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945167    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-configmap-metrics-client-ca\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.945287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945180    2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-config\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.945287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945193    2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-grpc-tls\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.945287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945205    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.945287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945217    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.945287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945229    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-web-config\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.945287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945242    2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68fcc7b9-cb89-4095-9fe1-e809afd452e8-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:21.945287 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:21.945255    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68fcc7b9-cb89-4095-9fe1-e809afd452e8-prometheus-k8s-db\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:48:22.533421 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.533388    2563 generic.go:358] "Generic (PLEG): container finished" podID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerID="86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270" exitCode=0
Jun 03 16:48:22.533421 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.533415    2563 generic.go:358] "Generic (PLEG): container finished" podID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerID="a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730" exitCode=0
Jun 03 16:48:22.533421 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.533421    2563 generic.go:358] "Generic (PLEG): container finished" podID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerID="8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d" exitCode=0
Jun 03 16:48:22.533421 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.533427    2563 generic.go:358] "Generic (PLEG): container finished" podID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerID="6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172" exitCode=0
Jun 03 16:48:22.533421 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.533432    2563 generic.go:358] "Generic (PLEG): container finished" podID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerID="216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca" exitCode=0
Jun 03 16:48:22.533938 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.533437    2563 generic.go:358] "Generic (PLEG): container finished" podID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerID="8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29" exitCode=0
Jun 03 16:48:22.533938 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.533459    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68fcc7b9-cb89-4095-9fe1-e809afd452e8","Type":"ContainerDied","Data":"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270"}
Jun 03 16:48:22.533938 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.533485    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.533938 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.533499    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68fcc7b9-cb89-4095-9fe1-e809afd452e8","Type":"ContainerDied","Data":"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730"}
Jun 03 16:48:22.533938 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.533511    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68fcc7b9-cb89-4095-9fe1-e809afd452e8","Type":"ContainerDied","Data":"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d"}
Jun 03 16:48:22.533938 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.533521    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68fcc7b9-cb89-4095-9fe1-e809afd452e8","Type":"ContainerDied","Data":"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172"}
Jun 03 16:48:22.533938 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.533530    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68fcc7b9-cb89-4095-9fe1-e809afd452e8","Type":"ContainerDied","Data":"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca"}
Jun 03 16:48:22.533938 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.533540    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68fcc7b9-cb89-4095-9fe1-e809afd452e8","Type":"ContainerDied","Data":"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29"}
Jun 03 16:48:22.533938 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.533552    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68fcc7b9-cb89-4095-9fe1-e809afd452e8","Type":"ContainerDied","Data":"6344cb05468786225ba8300554911ddc7389b654421b72a5b1babdbe832453aa"}
Jun 03 16:48:22.533938 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.533570    2563 scope.go:117] "RemoveContainer" containerID="86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270"
Jun 03 16:48:22.541335 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.541240    2563 scope.go:117] "RemoveContainer" containerID="a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730"
Jun 03 16:48:22.547892 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.547874    2563 scope.go:117] "RemoveContainer" containerID="8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d"
Jun 03 16:48:22.553822 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.553806    2563 scope.go:117] "RemoveContainer" containerID="6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172"
Jun 03 16:48:22.557840 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.557820    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 16:48:22.560881 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.560864    2563 scope.go:117] "RemoveContainer" containerID="216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca"
Jun 03 16:48:22.565950 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.565927    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 16:48:22.567814 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.567649    2563 scope.go:117] "RemoveContainer" containerID="8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29"
Jun 03 16:48:22.576041 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.576018    2563 scope.go:117] "RemoveContainer" containerID="a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32"
Jun 03 16:48:22.582471 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.582456    2563 scope.go:117] "RemoveContainer" containerID="86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270"
Jun 03 16:48:22.582742 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:48:22.582705    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270\": container with ID starting with 86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270 not found: ID does not exist" containerID="86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270"
Jun 03 16:48:22.582831 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.582795    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270"} err="failed to get container status \"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270\": rpc error: code = NotFound desc = could not find container \"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270\": container with ID starting with 86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270 not found: ID does not exist"
Jun 03 16:48:22.582887 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.582834    2563 scope.go:117] "RemoveContainer" containerID="a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730"
Jun 03 16:48:22.583081 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:48:22.583065    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730\": container with ID starting with a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730 not found: ID does not exist" containerID="a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730"
Jun 03 16:48:22.583125 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.583086    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730"} err="failed to get container status \"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730\": rpc error: code = NotFound desc = could not find container \"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730\": container with ID starting with a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730 not found: ID does not exist"
Jun 03 16:48:22.583125 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.583102    2563 scope.go:117] "RemoveContainer" containerID="8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d"
Jun 03 16:48:22.583290 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:48:22.583276    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d\": container with ID starting with 8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d not found: ID does not exist" containerID="8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d"
Jun 03 16:48:22.583324 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.583292    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d"} err="failed to get container status \"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d\": rpc error: code = NotFound desc = could not find container \"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d\": container with ID starting with 8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d not found: ID does not exist"
Jun 03 16:48:22.583324 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.583305    2563 scope.go:117] "RemoveContainer" containerID="6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172"
Jun 03 16:48:22.583510 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:48:22.583493    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172\": container with ID starting with 6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172 not found: ID does not exist" containerID="6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172"
Jun 03 16:48:22.583546 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.583513    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172"} err="failed to get container status \"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172\": rpc error: code = NotFound desc = could not find container \"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172\": container with ID starting with 6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172 not found: ID does not exist"
Jun 03 16:48:22.583546 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.583526    2563 scope.go:117] "RemoveContainer" containerID="216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca"
Jun 03 16:48:22.583761 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:48:22.583743    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca\": container with ID starting with 216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca not found: ID does not exist" containerID="216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca"
Jun 03 16:48:22.583820 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.583764    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca"} err="failed to get container status \"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca\": rpc error: code = NotFound desc = could not find container \"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca\": container with ID starting with 216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca not found: ID does not exist"
Jun 03 16:48:22.583820 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.583777    2563 scope.go:117] "RemoveContainer" containerID="8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29"
Jun 03 16:48:22.583989 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:48:22.583971    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29\": container with ID starting with 8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29 not found: ID does not exist" containerID="8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29"
Jun 03 16:48:22.584029 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.583993    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29"} err="failed to get container status \"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29\": rpc error: code = NotFound desc = could not find container \"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29\": container with ID starting with 8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29 not found: ID does not exist"
Jun 03 16:48:22.584029 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.584006    2563 scope.go:117] "RemoveContainer" containerID="a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32"
Jun 03 16:48:22.584217 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:48:22.584201    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32\": container with ID starting with a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32 not found: ID does not exist" containerID="a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32"
Jun 03 16:48:22.584251 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.584220    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32"} err="failed to get container status \"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32\": rpc error: code = NotFound desc = could not find container \"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32\": container with ID starting with a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32 not found: ID does not exist"
Jun 03 16:48:22.584251 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.584233    2563 scope.go:117] "RemoveContainer" containerID="86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270"
Jun 03 16:48:22.584454 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.584436    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270"} err="failed to get container status \"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270\": rpc error: code = NotFound desc = could not find container \"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270\": container with ID starting with 86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270 not found: ID does not exist"
Jun 03 16:48:22.584503 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.584456    2563 scope.go:117] "RemoveContainer" containerID="a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730"
Jun 03 16:48:22.584649 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.584633    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730"} err="failed to get container status \"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730\": rpc error: code = NotFound desc = could not find container \"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730\": container with ID starting with a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730 not found: ID does not exist"
Jun 03 16:48:22.584694 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.584650    2563 scope.go:117] "RemoveContainer" containerID="8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d"
Jun 03 16:48:22.584887 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.584871    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d"} err="failed to get container status \"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d\": rpc error: code = NotFound desc = could not find container \"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d\": container with ID starting with 8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d not found: ID does not exist"
Jun 03 16:48:22.584887 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.584886    2563 scope.go:117] "RemoveContainer" containerID="6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172"
Jun 03 16:48:22.585084 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.585067    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172"} err="failed to get container status \"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172\": rpc error: code = NotFound desc = could not find container \"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172\": container with ID starting with 6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172 not found: ID does not exist"
Jun 03 16:48:22.585084 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.585083    2563 scope.go:117] "RemoveContainer" containerID="216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca"
Jun 03 16:48:22.585279 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.585260    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca"} err="failed to get container status \"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca\": rpc error: code = NotFound desc = could not find container \"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca\": container with ID starting with 216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca not found: ID does not exist"
Jun 03 16:48:22.585317 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.585279    2563 scope.go:117] "RemoveContainer" containerID="8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29"
Jun 03 16:48:22.585466 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.585450    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29"} err="failed to get container status \"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29\": rpc error: code = NotFound desc = could not find container \"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29\": container with ID starting with 8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29 not found: ID does not exist"
Jun 03 16:48:22.585466 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.585465    2563 scope.go:117] "RemoveContainer" containerID="a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32"
Jun 03 16:48:22.585654 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.585639    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32"} err="failed to get container status \"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32\": rpc error: code = NotFound desc = could not find container \"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32\": container with ID starting with a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32 not found: ID does not exist"
Jun 03 16:48:22.585782 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.585654    2563 scope.go:117] "RemoveContainer" containerID="86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270"
Jun 03 16:48:22.585881 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.585865    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270"} err="failed to get container status \"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270\": rpc error: code = NotFound desc = could not find container \"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270\": container with ID starting with 86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270 not found: ID does not exist"
Jun 03 16:48:22.585925 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.585881    2563 scope.go:117] "RemoveContainer" containerID="a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730"
Jun 03 16:48:22.586079 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.586061    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730"} err="failed to get container status \"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730\": rpc error: code = NotFound desc = could not find container \"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730\": container with ID starting with a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730 not found: ID does not exist"
Jun 03 16:48:22.586116 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.586081    2563 scope.go:117] "RemoveContainer" containerID="8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d"
Jun 03 16:48:22.586275 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.586249    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d"} err="failed to get container status \"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d\": rpc error: code = NotFound desc = could not find container \"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d\": container with ID starting with 8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d not found: ID does not exist"
Jun 03 16:48:22.586275 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.586265    2563 scope.go:117] "RemoveContainer" containerID="6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172"
Jun 03 16:48:22.586432 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.586418    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172"} err="failed to get container status \"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172\": rpc error: code = NotFound desc = could not find container \"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172\": container with ID starting with 6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172 not found: ID does not exist"
Jun 03 16:48:22.586480 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.586433    2563 scope.go:117] "RemoveContainer" containerID="216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca"
Jun 03 16:48:22.586621 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.586606    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca"} err="failed to get container status \"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca\": rpc error: code = NotFound desc = could not find container \"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca\": container with ID starting with 216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca not found: ID does not exist"
Jun 03 16:48:22.586621 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.586620    2563 scope.go:117] "RemoveContainer" containerID="8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29"
Jun 03 16:48:22.586829 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.586813    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29"} err="failed to get container status \"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29\": rpc error: code = NotFound desc = could not find container \"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29\": container with ID starting with 8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29 not found: ID does not exist"
Jun 03 16:48:22.586829 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.586828    2563 scope.go:117] "RemoveContainer" containerID="a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32"
Jun 03 16:48:22.587013 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.586998    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32"} err="failed to get container status \"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32\": rpc error: code = NotFound desc = could not find container \"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32\": container with ID starting with a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32 not found: ID does not exist"
Jun 03 16:48:22.587013 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.587012    2563 scope.go:117] "RemoveContainer" containerID="86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270"
Jun 03 16:48:22.587213 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.587189    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270"} err="failed to get container status \"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270\": rpc error: code = NotFound desc = could not find container \"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270\": container with ID starting with 86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270 not found: ID does not exist"
Jun 03 16:48:22.587213 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.587212    2563 scope.go:117] "RemoveContainer" containerID="a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730"
Jun 03 16:48:22.587391 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.587375    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730"} err="failed to get container status \"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730\": rpc error: code = NotFound desc = could not find container \"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730\": container with ID starting with a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730 not found: ID does not exist"
Jun 03 16:48:22.587391 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.587390    2563 scope.go:117] "RemoveContainer" containerID="8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d"
Jun 03 16:48:22.587600 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.587582    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d"} err="failed to get container status \"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d\": rpc error: code = NotFound desc = could not find container \"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d\": container with ID starting with 8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d not found: ID does not exist"
Jun 03 16:48:22.587649 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.587600    2563 scope.go:117] "RemoveContainer" containerID="6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172"
Jun 03 16:48:22.587877 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.587859    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172"} err="failed to get container status \"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172\": rpc error: code = NotFound desc = could not find container \"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172\": container with ID starting with 6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172 not found: ID does not exist"
Jun 03 16:48:22.587929 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.587879    2563 scope.go:117] "RemoveContainer" containerID="216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca"
Jun 03 16:48:22.588068 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.588052    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca"} err="failed to get container status \"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca\": rpc error: code = NotFound desc = could not find container \"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca\": container with ID starting with 216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca not found: ID does not exist"
Jun 03 16:48:22.588112 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.588068    2563 scope.go:117] "RemoveContainer" containerID="8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29"
Jun 03 16:48:22.588240 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.588222    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29"} err="failed to get container status \"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29\": rpc error: code = NotFound desc = could not find container \"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29\": container with ID starting with 8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29 not found: ID does not exist"
Jun 03 16:48:22.588281 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.588242    2563 scope.go:117] "RemoveContainer" containerID="a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32"
Jun 03 16:48:22.588426 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.588407    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32"} err="failed to get container status \"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32\": rpc error: code = NotFound desc = could not find container \"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32\": container with ID starting with a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32 not found: ID does not exist"
Jun 03 16:48:22.588474 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.588426    2563 scope.go:117] "RemoveContainer" containerID="86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270"
Jun 03 16:48:22.588637 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.588623    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270"} err="failed to get container status \"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270\": rpc error: code = NotFound desc = could not find container \"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270\": container with ID starting with 86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270 not found: ID does not exist"
Jun 03 16:48:22.588637 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.588636    2563 scope.go:117] "RemoveContainer" containerID="a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730"
Jun 03 16:48:22.588816 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.588801    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730"} err="failed to get container status \"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730\": rpc error: code = NotFound desc = could not find container \"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730\": container with ID starting with a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730 not found: ID does not exist"
Jun 03 16:48:22.588872 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.588816    2563 scope.go:117] "RemoveContainer" containerID="8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d"
Jun 03 16:48:22.589010 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.588994    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d"} err="failed to get container status \"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d\": rpc error: code = NotFound desc = could not find container \"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d\": container with ID starting with 8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d not found: ID does not exist"
Jun 03 16:48:22.589061 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.589010    2563 scope.go:117] "RemoveContainer" containerID="6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172"
Jun 03 16:48:22.589210 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.589192    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172"} err="failed to get container status \"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172\": rpc error: code = NotFound desc = could not find container \"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172\": container with ID starting with 6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172 not found: ID does not exist"
Jun 03 16:48:22.589251 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.589210    2563 scope.go:117] "RemoveContainer" containerID="216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca"
Jun 03 16:48:22.589399 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.589384    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca"} err="failed to get container status \"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca\": rpc error: code = NotFound desc = could not find container \"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca\": container with ID starting with 216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca not found: ID does not exist"
Jun 03 16:48:22.589399 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.589399    2563 scope.go:117] "RemoveContainer" containerID="8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29"
Jun 03 16:48:22.589571 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.589554    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29"} err="failed to get container status \"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29\": rpc error: code = NotFound desc = could not find container \"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29\": container with ID starting with 8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29 not found: ID does not exist"
Jun 03 16:48:22.589617 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.589573    2563 scope.go:117] "RemoveContainer" containerID="a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32"
Jun 03 16:48:22.589721 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.589706    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32"} err="failed to get container status \"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32\": rpc error: code = NotFound desc = could not find container \"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32\": container with ID starting with a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32 not found: ID does not exist"
Jun 03 16:48:22.589785 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.589721    2563 scope.go:117] "RemoveContainer" containerID="86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270"
Jun 03 16:48:22.589972 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.589949    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270"} err="failed to get container status \"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270\": rpc error: code = NotFound desc = could not find container \"86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270\": container with ID starting with 86c55424820e9027e3b23cee7d54a062b3fa3a775ba3074439e59940dd2f0270 not found: ID does not exist"
Jun 03 16:48:22.590025 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.589972    2563 scope.go:117] "RemoveContainer" containerID="a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730"
Jun 03 16:48:22.590324 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.590303    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730"} err="failed to get container status \"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730\": rpc error: code = NotFound desc = could not find container \"a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730\": container with ID starting with a0ee51e2f25771f663c480984a8a3283ec3bbc160d86c33a33b25c12888c7730 not found: ID does not exist"
Jun 03 16:48:22.590430 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.590324    2563 scope.go:117] "RemoveContainer" containerID="8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d"
Jun 03 16:48:22.590598 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.590561    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d"} err="failed to get container status \"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d\": rpc error: code = NotFound desc = could not find container \"8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d\": container with ID starting with 8a6e49f974d5acbaae6af73d4463e6fcf75d07ac190bad42bd2555820807b39d not found: ID does not exist"
Jun 03 16:48:22.590598 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.590593    2563 scope.go:117] "RemoveContainer" containerID="6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172"
Jun 03 16:48:22.590885 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.590865    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172"} err="failed to get container status \"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172\": rpc error: code = NotFound desc = could not find container \"6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172\": container with ID starting with 6c92671545a04c7a1ec905890e1ef705fab1a4a93a984bfd47d37a5ef3bdf172 not found: ID does not exist"
Jun 03 16:48:22.590966 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.590885    2563 scope.go:117] "RemoveContainer" containerID="216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca"
Jun 03 16:48:22.591167 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.591144    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca"} err="failed to get container status \"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca\": rpc error: code = NotFound desc = could not find container \"216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca\": container with ID starting with 216d56734a74b959c5614e2aabbf01160ba24fd2345b76d07ad0ee5d0023fcca not found: ID does not exist"
Jun 03 16:48:22.591222 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.591170    2563 scope.go:117] "RemoveContainer" containerID="8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29"
Jun 03 16:48:22.591400 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.591379    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29"} err="failed to get container status \"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29\": rpc error: code = NotFound desc = could not find container \"8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29\": container with ID starting with 8ec9f29b3a85a5345a7b359bdf4f8e19f757e63c636616d8261b231187235a29 not found: ID does not exist"
Jun 03 16:48:22.591444 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.591402    2563 scope.go:117] "RemoveContainer" containerID="a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32"
Jun 03 16:48:22.591610 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.591590    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32"} err="failed to get container status \"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32\": rpc error: code = NotFound desc = could not find container \"a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32\": container with ID starting with a7ddea206b4182f201918ff18031a1af844208cbd9dcd471e6c4e2cbf9049e32 not found: ID does not exist"
Jun 03 16:48:22.592123 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592108    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 16:48:22.592422 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592411    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="init-config-reloader"
Jun 03 16:48:22.592455 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592423    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="init-config-reloader"
Jun 03 16:48:22.592455 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592438    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="kube-rbac-proxy-web"
Jun 03 16:48:22.592455 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592444    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="kube-rbac-proxy-web"
Jun 03 16:48:22.592455 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592451    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="kube-rbac-proxy-thanos"
Jun 03 16:48:22.592455 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592456    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="kube-rbac-proxy-thanos"
Jun 03 16:48:22.592585 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592464    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="config-reloader"
Jun 03 16:48:22.592585 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592469    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="config-reloader"
Jun 03 16:48:22.592585 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592478    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="kube-rbac-proxy"
Jun 03 16:48:22.592585 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592482    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="kube-rbac-proxy"
Jun 03 16:48:22.592585 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592494    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="thanos-sidecar"
Jun 03 16:48:22.592585 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592499    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="thanos-sidecar"
Jun 03 16:48:22.592585 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592505    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="prometheus"
Jun 03 16:48:22.592585 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592510    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="prometheus"
Jun 03 16:48:22.592585 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592554    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="thanos-sidecar"
Jun 03 16:48:22.592585 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592560    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="kube-rbac-proxy-web"
Jun 03 16:48:22.592585 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592567    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="prometheus"
Jun 03 16:48:22.592585 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592574    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="kube-rbac-proxy"
Jun 03 16:48:22.592585 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592582    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="config-reloader"
Jun 03 16:48:22.592585 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.592587    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" containerName="kube-rbac-proxy-thanos"
Jun 03 16:48:22.596077 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.596059    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.598968 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.598944    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 03 16:48:22.599079 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.599061    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 03 16:48:22.599183 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.599169    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 03 16:48:22.599337 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.599323    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 03 16:48:22.599431 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.599414    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 03 16:48:22.599476 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.599464    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 03 16:48:22.599521 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.599511    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fofh78vr1uele\""
Jun 03 16:48:22.599567 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.599557    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 03 16:48:22.599616 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.599580    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 03 16:48:22.600677 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.600576    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 03 16:48:22.600677 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.600631    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 03 16:48:22.600938 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.600802    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rx8rz\""
Jun 03 16:48:22.600989 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.600951    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 03 16:48:22.602923 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.602902    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 03 16:48:22.605081 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.605062    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 03 16:48:22.608834 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.608816    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 16:48:22.650686 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.650622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.650686 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.650675    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc073823-0aff-43d5-8d38-1e81c7d5495f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.650906 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.650882    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-config\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.650964 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.650933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc073823-0aff-43d5-8d38-1e81c7d5495f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.651018 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.650964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.651089 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.651072    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.651131 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.651103    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc073823-0aff-43d5-8d38-1e81c7d5495f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.651216 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.651199    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc073823-0aff-43d5-8d38-1e81c7d5495f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.651255 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.651233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.651323 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.651307    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc073823-0aff-43d5-8d38-1e81c7d5495f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.651408 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.651387    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.651463 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.651433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc073823-0aff-43d5-8d38-1e81c7d5495f-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.651523 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.651466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.651569 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.651530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc073823-0aff-43d5-8d38-1e81c7d5495f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.651569 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.651548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.651641 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.651569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc073823-0aff-43d5-8d38-1e81c7d5495f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.651641 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.651599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt6h6\" (UniqueName: \"kubernetes.io/projected/bc073823-0aff-43d5-8d38-1e81c7d5495f-kube-api-access-dt6h6\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.651641 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.651626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.731646 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.731620    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68fcc7b9-cb89-4095-9fe1-e809afd452e8" path="/var/lib/kubelet/pods/68fcc7b9-cb89-4095-9fe1-e809afd452e8/volumes"
Jun 03 16:48:22.752169 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752151    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752235 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752180    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752235 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752200    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc073823-0aff-43d5-8d38-1e81c7d5495f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752235 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752222    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-config\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752383 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752259    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc073823-0aff-43d5-8d38-1e81c7d5495f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752383 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752291    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752383 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752329    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752383 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752353    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc073823-0aff-43d5-8d38-1e81c7d5495f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752577 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752388    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc073823-0aff-43d5-8d38-1e81c7d5495f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752577 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752416    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752577 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752445    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc073823-0aff-43d5-8d38-1e81c7d5495f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752577 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752477    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752577 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752506    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc073823-0aff-43d5-8d38-1e81c7d5495f-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752577 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752531    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752577 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752568    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc073823-0aff-43d5-8d38-1e81c7d5495f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752922 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752593    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752922 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752632    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc073823-0aff-43d5-8d38-1e81c7d5495f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.752922 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.752666    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dt6h6\" (UniqueName: \"kubernetes.io/projected/bc073823-0aff-43d5-8d38-1e81c7d5495f-kube-api-access-dt6h6\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.753105 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.753089    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc073823-0aff-43d5-8d38-1e81c7d5495f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.753286 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.753262    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc073823-0aff-43d5-8d38-1e81c7d5495f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.753445 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.753422    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc073823-0aff-43d5-8d38-1e81c7d5495f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.755454 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.755425    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-config\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.755541 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.755464    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.755653 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.755632    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.755783 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.755755    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc073823-0aff-43d5-8d38-1e81c7d5495f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.756125 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.756006    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.756125 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.756010    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc073823-0aff-43d5-8d38-1e81c7d5495f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.756274 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.756260    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc073823-0aff-43d5-8d38-1e81c7d5495f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.756600 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.756442    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc073823-0aff-43d5-8d38-1e81c7d5495f-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.756679 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.756599    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.757422 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.757389    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc073823-0aff-43d5-8d38-1e81c7d5495f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.757666 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.757648    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.758000 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.757981    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.758146 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.758130    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.758672 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.758657    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc073823-0aff-43d5-8d38-1e81c7d5495f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.760927 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.760908    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt6h6\" (UniqueName: \"kubernetes.io/projected/bc073823-0aff-43d5-8d38-1e81c7d5495f-kube-api-access-dt6h6\") pod \"prometheus-k8s-0\" (UID: \"bc073823-0aff-43d5-8d38-1e81c7d5495f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:22.907144 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:22.907046    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:23.049177 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:23.049153    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 16:48:23.051578 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:48:23.051549    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc073823_0aff_43d5_8d38_1e81c7d5495f.slice/crio-26b59c5daebde6d063debc48ef16803c4acab240a66e1891ce45f00cf3f3ed38 WatchSource:0}: Error finding container 26b59c5daebde6d063debc48ef16803c4acab240a66e1891ce45f00cf3f3ed38: Status 404 returned error can't find the container with id 26b59c5daebde6d063debc48ef16803c4acab240a66e1891ce45f00cf3f3ed38
Jun 03 16:48:23.537759 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:23.537709    2563 generic.go:358] "Generic (PLEG): container finished" podID="bc073823-0aff-43d5-8d38-1e81c7d5495f" containerID="cd0bf20f6e63ad414ef5255c1a158a4ba8f96d24e74ec0990d2e55368831a753" exitCode=0
Jun 03 16:48:23.538271 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:23.537795    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc073823-0aff-43d5-8d38-1e81c7d5495f","Type":"ContainerDied","Data":"cd0bf20f6e63ad414ef5255c1a158a4ba8f96d24e74ec0990d2e55368831a753"}
Jun 03 16:48:23.538271 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:23.537829    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc073823-0aff-43d5-8d38-1e81c7d5495f","Type":"ContainerStarted","Data":"26b59c5daebde6d063debc48ef16803c4acab240a66e1891ce45f00cf3f3ed38"}
Jun 03 16:48:24.544088 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:24.544052    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc073823-0aff-43d5-8d38-1e81c7d5495f","Type":"ContainerStarted","Data":"efe4499f96761df55dd390c57b3b58b0bca63d633f86d4761a6de7b09ce3de39"}
Jun 03 16:48:24.544088 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:24.544091    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc073823-0aff-43d5-8d38-1e81c7d5495f","Type":"ContainerStarted","Data":"4de40b06c83244a30bc19327d25e2c822713844699d03860e1167717d72f5d99"}
Jun 03 16:48:24.544494 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:24.544104    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc073823-0aff-43d5-8d38-1e81c7d5495f","Type":"ContainerStarted","Data":"730ccd82488a3881ccc060093258ee2342be5e4281c22c29b49c65fca9cbe1f3"}
Jun 03 16:48:24.544494 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:24.544116    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc073823-0aff-43d5-8d38-1e81c7d5495f","Type":"ContainerStarted","Data":"64691a189d7f6215697a045ae2c3c90895471d82ee6307aa29976c7a99484001"}
Jun 03 16:48:24.544494 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:24.544128    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc073823-0aff-43d5-8d38-1e81c7d5495f","Type":"ContainerStarted","Data":"1788c2e93846d53f502132c12c8ca5554a1c44f6fb1faa4cf123e416c31c67e7"}
Jun 03 16:48:24.544494 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:24.544141    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc073823-0aff-43d5-8d38-1e81c7d5495f","Type":"ContainerStarted","Data":"b112e8deb88cb0735df58fda410a3f71a16c9c83a9fcb1bfef4b4298acb369c6"}
Jun 03 16:48:24.571017 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:24.570970    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.570952119 podStartE2EDuration="2.570952119s" podCreationTimestamp="2026-06-03 16:48:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:48:24.568913258 +0000 UTC m=+246.289805550" watchObservedRunningTime="2026-06-03 16:48:24.570952119 +0000 UTC m=+246.291844390"
Jun 03 16:48:27.907612 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:27.907558    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:48:30.621098 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:30.621065    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs\") pod \"network-metrics-daemon-82l8r\" (UID: \"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff\") " pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:48:30.623321 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:30.623294    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff-metrics-certs\") pod \"network-metrics-daemon-82l8r\" (UID: \"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff\") " pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:48:30.730804 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:30.730768    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6fvvv\""
Jun 03 16:48:30.738114 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:30.738091    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82l8r"
Jun 03 16:48:30.863394 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:30.863307    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-82l8r"]
Jun 03 16:48:30.865917 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:48:30.865888    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3505bde7_c7dc_4639_bc8b_1f6df5bbe8ff.slice/crio-7bf75482fe509c670bee0f9216abfc91e534d97f820da2c4b10af3062a765d04 WatchSource:0}: Error finding container 7bf75482fe509c670bee0f9216abfc91e534d97f820da2c4b10af3062a765d04: Status 404 returned error can't find the container with id 7bf75482fe509c670bee0f9216abfc91e534d97f820da2c4b10af3062a765d04
Jun 03 16:48:31.569768 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:31.569721    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82l8r" event={"ID":"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff","Type":"ContainerStarted","Data":"7bf75482fe509c670bee0f9216abfc91e534d97f820da2c4b10af3062a765d04"}
Jun 03 16:48:32.579295 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:32.579261    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82l8r" event={"ID":"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff","Type":"ContainerStarted","Data":"2cc763f525dd631d329f5a7d7b6dc9a9323bf815620c43e32e38328886528768"}
Jun 03 16:48:32.579295 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:32.579298    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82l8r" event={"ID":"3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff","Type":"ContainerStarted","Data":"28268949f8a683d050098b3d5d6cde1cb379557e7c8fb5859753666b2bf90bfb"}
Jun 03 16:48:32.597665 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:48:32.597623    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-82l8r" podStartSLOduration=252.573993108 podStartE2EDuration="4m13.597610743s" podCreationTimestamp="2026-06-03 16:44:19 +0000 UTC" firstStartedPulling="2026-06-03 16:48:30.867763785 +0000 UTC m=+252.588656056" lastFinishedPulling="2026-06-03 16:48:31.891381417 +0000 UTC m=+253.612273691" observedRunningTime="2026-06-03 16:48:32.596293227 +0000 UTC m=+254.317185517" watchObservedRunningTime="2026-06-03 16:48:32.597610743 +0000 UTC m=+254.318503035"
Jun 03 16:49:18.621418 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:49:18.621390    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-phgpp_ccbe3e7a-fea1-419f-af7f-bc26eaa0089e/console-operator/1.log"
Jun 03 16:49:18.622003 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:49:18.621464    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-phgpp_ccbe3e7a-fea1-419f-af7f-bc26eaa0089e/console-operator/1.log"
Jun 03 16:49:18.634065 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:49:18.634041    2563 kubelet.go:1628] "Image garbage collection succeeded"
Jun 03 16:49:22.907994 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:49:22.907960    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:49:22.923222 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:49:22.923197    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:49:23.748251 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:49:23.748225    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 16:51:50.208567 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:50.208489    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9zqj5"]
Jun 03 16:51:50.211840 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:50.211823    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zqj5"
Jun 03 16:51:50.214263 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:50.214245    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 03 16:51:50.225130 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:50.225110    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9zqj5"]
Jun 03 16:51:50.341754 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:50.341704    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f72070fc-cab4-4b99-9c05-bc09f0bfbcb5-kubelet-config\") pod \"global-pull-secret-syncer-9zqj5\" (UID: \"f72070fc-cab4-4b99-9c05-bc09f0bfbcb5\") " pod="kube-system/global-pull-secret-syncer-9zqj5"
Jun 03 16:51:50.341911 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:50.341800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f72070fc-cab4-4b99-9c05-bc09f0bfbcb5-original-pull-secret\") pod \"global-pull-secret-syncer-9zqj5\" (UID: \"f72070fc-cab4-4b99-9c05-bc09f0bfbcb5\") " pod="kube-system/global-pull-secret-syncer-9zqj5"
Jun 03 16:51:50.341911 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:50.341829    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f72070fc-cab4-4b99-9c05-bc09f0bfbcb5-dbus\") pod \"global-pull-secret-syncer-9zqj5\" (UID: \"f72070fc-cab4-4b99-9c05-bc09f0bfbcb5\") " pod="kube-system/global-pull-secret-syncer-9zqj5"
Jun 03 16:51:50.443012 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:50.442983    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f72070fc-cab4-4b99-9c05-bc09f0bfbcb5-original-pull-secret\") pod \"global-pull-secret-syncer-9zqj5\" (UID: \"f72070fc-cab4-4b99-9c05-bc09f0bfbcb5\") " pod="kube-system/global-pull-secret-syncer-9zqj5"
Jun 03 16:51:50.443143 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:50.443019    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f72070fc-cab4-4b99-9c05-bc09f0bfbcb5-dbus\") pod \"global-pull-secret-syncer-9zqj5\" (UID: \"f72070fc-cab4-4b99-9c05-bc09f0bfbcb5\") " pod="kube-system/global-pull-secret-syncer-9zqj5"
Jun 03 16:51:50.443143 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:50.443052    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f72070fc-cab4-4b99-9c05-bc09f0bfbcb5-kubelet-config\") pod \"global-pull-secret-syncer-9zqj5\" (UID: \"f72070fc-cab4-4b99-9c05-bc09f0bfbcb5\") " pod="kube-system/global-pull-secret-syncer-9zqj5"
Jun 03 16:51:50.443143 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:50.443131    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f72070fc-cab4-4b99-9c05-bc09f0bfbcb5-kubelet-config\") pod \"global-pull-secret-syncer-9zqj5\" (UID: \"f72070fc-cab4-4b99-9c05-bc09f0bfbcb5\") " pod="kube-system/global-pull-secret-syncer-9zqj5"
Jun 03 16:51:50.443241 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:50.443215    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f72070fc-cab4-4b99-9c05-bc09f0bfbcb5-dbus\") pod \"global-pull-secret-syncer-9zqj5\" (UID: \"f72070fc-cab4-4b99-9c05-bc09f0bfbcb5\") " pod="kube-system/global-pull-secret-syncer-9zqj5"
Jun 03 16:51:50.445176 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:50.445160    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f72070fc-cab4-4b99-9c05-bc09f0bfbcb5-original-pull-secret\") pod \"global-pull-secret-syncer-9zqj5\" (UID: \"f72070fc-cab4-4b99-9c05-bc09f0bfbcb5\") " pod="kube-system/global-pull-secret-syncer-9zqj5"
Jun 03 16:51:50.520849 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:50.520824    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zqj5"
Jun 03 16:51:50.641133 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:50.641074    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9zqj5"]
Jun 03 16:51:50.643313 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:51:50.643286    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf72070fc_cab4_4b99_9c05_bc09f0bfbcb5.slice/crio-a1121217d11c7fcf604e6a76140a6d809f17df89ec6dedbe4cb6df8749ab3d37 WatchSource:0}: Error finding container a1121217d11c7fcf604e6a76140a6d809f17df89ec6dedbe4cb6df8749ab3d37: Status 404 returned error can't find the container with id a1121217d11c7fcf604e6a76140a6d809f17df89ec6dedbe4cb6df8749ab3d37
Jun 03 16:51:50.644891 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:50.644874    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 16:51:51.152119 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:51.152085    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9zqj5" event={"ID":"f72070fc-cab4-4b99-9c05-bc09f0bfbcb5","Type":"ContainerStarted","Data":"a1121217d11c7fcf604e6a76140a6d809f17df89ec6dedbe4cb6df8749ab3d37"}
Jun 03 16:51:56.167777 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:56.167722    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9zqj5" event={"ID":"f72070fc-cab4-4b99-9c05-bc09f0bfbcb5","Type":"ContainerStarted","Data":"391b058841610a7002926cf4e6d55c0b81b469b479b213bc7b8de476bba1f703"}
Jun 03 16:51:56.183304 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:51:56.183255    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9zqj5" podStartSLOduration=1.620413347 podStartE2EDuration="6.18324263s" podCreationTimestamp="2026-06-03 16:51:50 +0000 UTC" firstStartedPulling="2026-06-03 16:51:50.644997801 +0000 UTC m=+452.365890072" lastFinishedPulling="2026-06-03 16:51:55.207827085 +0000 UTC m=+456.928719355" observedRunningTime="2026-06-03 16:51:56.183027614 +0000 UTC m=+457.903919906" watchObservedRunningTime="2026-06-03 16:51:56.18324263 +0000 UTC m=+457.904134922"
Jun 03 16:52:47.090806 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:47.090773    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-l7cnl"]
Jun 03 16:52:47.094055 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:47.094039    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-l7cnl"
Jun 03 16:52:47.096825 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:47.096802    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 03 16:52:47.097833 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:47.097808    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bvgjk\""
Jun 03 16:52:47.097951 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:47.097808    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 03 16:52:47.101748 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:47.101714    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-l7cnl"]
Jun 03 16:52:47.206821 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:47.206786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ab8a503-e854-4b91-9f5c-98546b7deefd-tmp\") pod \"openshift-lws-operator-bfc7f696d-l7cnl\" (UID: \"9ab8a503-e854-4b91-9f5c-98546b7deefd\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-l7cnl"
Jun 03 16:52:47.207000 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:47.206943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr7m5\" (UniqueName: \"kubernetes.io/projected/9ab8a503-e854-4b91-9f5c-98546b7deefd-kube-api-access-dr7m5\") pod \"openshift-lws-operator-bfc7f696d-l7cnl\" (UID: \"9ab8a503-e854-4b91-9f5c-98546b7deefd\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-l7cnl"
Jun 03 16:52:47.308101 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:47.308062    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dr7m5\" (UniqueName: \"kubernetes.io/projected/9ab8a503-e854-4b91-9f5c-98546b7deefd-kube-api-access-dr7m5\") pod \"openshift-lws-operator-bfc7f696d-l7cnl\" (UID: \"9ab8a503-e854-4b91-9f5c-98546b7deefd\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-l7cnl"
Jun 03 16:52:47.308279 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:47.308123    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ab8a503-e854-4b91-9f5c-98546b7deefd-tmp\") pod \"openshift-lws-operator-bfc7f696d-l7cnl\" (UID: \"9ab8a503-e854-4b91-9f5c-98546b7deefd\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-l7cnl"
Jun 03 16:52:47.308555 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:47.308535    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ab8a503-e854-4b91-9f5c-98546b7deefd-tmp\") pod \"openshift-lws-operator-bfc7f696d-l7cnl\" (UID: \"9ab8a503-e854-4b91-9f5c-98546b7deefd\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-l7cnl"
Jun 03 16:52:47.316587 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:47.316557    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr7m5\" (UniqueName: \"kubernetes.io/projected/9ab8a503-e854-4b91-9f5c-98546b7deefd-kube-api-access-dr7m5\") pod \"openshift-lws-operator-bfc7f696d-l7cnl\" (UID: \"9ab8a503-e854-4b91-9f5c-98546b7deefd\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-l7cnl"
Jun 03 16:52:47.413354 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:47.413276    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-l7cnl"
Jun 03 16:52:47.533499 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:47.533474    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-l7cnl"]
Jun 03 16:52:47.535531 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:52:47.535504    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ab8a503_e854_4b91_9f5c_98546b7deefd.slice/crio-023e176b13df595ccd7590ced246d12b76bd043eedbf9d45a97fceb880e8fa25 WatchSource:0}: Error finding container 023e176b13df595ccd7590ced246d12b76bd043eedbf9d45a97fceb880e8fa25: Status 404 returned error can't find the container with id 023e176b13df595ccd7590ced246d12b76bd043eedbf9d45a97fceb880e8fa25
Jun 03 16:52:48.322154 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:48.322105    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-l7cnl" event={"ID":"9ab8a503-e854-4b91-9f5c-98546b7deefd","Type":"ContainerStarted","Data":"023e176b13df595ccd7590ced246d12b76bd043eedbf9d45a97fceb880e8fa25"}
Jun 03 16:52:50.329404 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:50.329367    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-l7cnl" event={"ID":"9ab8a503-e854-4b91-9f5c-98546b7deefd","Type":"ContainerStarted","Data":"d89a365167117f14cec9268275c7169d28791cdcd2a782830b48580a6fc0414d"}
Jun 03 16:52:50.345708 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:52:50.345664    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-l7cnl" podStartSLOduration=1.037790497 podStartE2EDuration="3.345652106s" podCreationTimestamp="2026-06-03 16:52:47 +0000 UTC" firstStartedPulling="2026-06-03 16:52:47.536968147 +0000 UTC m=+509.257860418" lastFinishedPulling="2026-06-03 16:52:49.844829756 +0000 UTC m=+511.565722027" observedRunningTime="2026-06-03 16:52:50.344355818 +0000 UTC m=+512.065248113" watchObservedRunningTime="2026-06-03 16:52:50.345652106 +0000 UTC m=+512.066544396"
Jun 03 16:53:06.588826 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.588794    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"]
Jun 03 16:53:06.595495 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.595476    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:06.598468 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.598449    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 03 16:53:06.598716 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.598703    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 03 16:53:06.606360 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.606343    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cmn8q\""
Jun 03 16:53:06.606448 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.606372    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 03 16:53:06.607380 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.607363    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 03 16:53:06.612243 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.612210    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"]
Jun 03 16:53:06.676461 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.676431    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/651687c5-fa6d-49ac-a796-4d88b721774f-webhook-cert\") pod \"opendatahub-operator-controller-manager-d99597487-5sph9\" (UID: \"651687c5-fa6d-49ac-a796-4d88b721774f\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:06.676616 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.676477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/651687c5-fa6d-49ac-a796-4d88b721774f-tmp\") pod \"opendatahub-operator-controller-manager-d99597487-5sph9\" (UID: \"651687c5-fa6d-49ac-a796-4d88b721774f\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:06.676616 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.676535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/651687c5-fa6d-49ac-a796-4d88b721774f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d99597487-5sph9\" (UID: \"651687c5-fa6d-49ac-a796-4d88b721774f\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:06.676616 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.676592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snzpz\" (UniqueName: \"kubernetes.io/projected/651687c5-fa6d-49ac-a796-4d88b721774f-kube-api-access-snzpz\") pod \"opendatahub-operator-controller-manager-d99597487-5sph9\" (UID: \"651687c5-fa6d-49ac-a796-4d88b721774f\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:06.676756 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.676635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/651687c5-fa6d-49ac-a796-4d88b721774f-manifests\") pod \"opendatahub-operator-controller-manager-d99597487-5sph9\" (UID: \"651687c5-fa6d-49ac-a796-4d88b721774f\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:06.778029 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.777993    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/651687c5-fa6d-49ac-a796-4d88b721774f-manifests\") pod \"opendatahub-operator-controller-manager-d99597487-5sph9\" (UID: \"651687c5-fa6d-49ac-a796-4d88b721774f\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:06.778201 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.778047    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/651687c5-fa6d-49ac-a796-4d88b721774f-webhook-cert\") pod \"opendatahub-operator-controller-manager-d99597487-5sph9\" (UID: \"651687c5-fa6d-49ac-a796-4d88b721774f\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:06.778201 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.778075    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/651687c5-fa6d-49ac-a796-4d88b721774f-tmp\") pod \"opendatahub-operator-controller-manager-d99597487-5sph9\" (UID: \"651687c5-fa6d-49ac-a796-4d88b721774f\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:06.778201 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.778104    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/651687c5-fa6d-49ac-a796-4d88b721774f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d99597487-5sph9\" (UID: \"651687c5-fa6d-49ac-a796-4d88b721774f\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:06.778201 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.778140    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snzpz\" (UniqueName: \"kubernetes.io/projected/651687c5-fa6d-49ac-a796-4d88b721774f-kube-api-access-snzpz\") pod \"opendatahub-operator-controller-manager-d99597487-5sph9\" (UID: \"651687c5-fa6d-49ac-a796-4d88b721774f\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:06.778441 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.778413    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/651687c5-fa6d-49ac-a796-4d88b721774f-manifests\") pod \"opendatahub-operator-controller-manager-d99597487-5sph9\" (UID: \"651687c5-fa6d-49ac-a796-4d88b721774f\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:06.780526 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.780501    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/651687c5-fa6d-49ac-a796-4d88b721774f-tmp\") pod \"opendatahub-operator-controller-manager-d99597487-5sph9\" (UID: \"651687c5-fa6d-49ac-a796-4d88b721774f\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:06.780708 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.780690    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/651687c5-fa6d-49ac-a796-4d88b721774f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d99597487-5sph9\" (UID: \"651687c5-fa6d-49ac-a796-4d88b721774f\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:06.780779 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.780711    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/651687c5-fa6d-49ac-a796-4d88b721774f-webhook-cert\") pod \"opendatahub-operator-controller-manager-d99597487-5sph9\" (UID: \"651687c5-fa6d-49ac-a796-4d88b721774f\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:06.792228 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.792203    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snzpz\" (UniqueName: \"kubernetes.io/projected/651687c5-fa6d-49ac-a796-4d88b721774f-kube-api-access-snzpz\") pod \"opendatahub-operator-controller-manager-d99597487-5sph9\" (UID: \"651687c5-fa6d-49ac-a796-4d88b721774f\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:06.905699 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:06.905614    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:07.040916 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:07.040855    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"]
Jun 03 16:53:07.044649 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:53:07.044621    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651687c5_fa6d_49ac_a796_4d88b721774f.slice/crio-339065cfc2b16eb3107e8078043b393a35d8143dbee45941055d9916103c6fbe WatchSource:0}: Error finding container 339065cfc2b16eb3107e8078043b393a35d8143dbee45941055d9916103c6fbe: Status 404 returned error can't find the container with id 339065cfc2b16eb3107e8078043b393a35d8143dbee45941055d9916103c6fbe
Jun 03 16:53:07.382067 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:07.382030    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9" event={"ID":"651687c5-fa6d-49ac-a796-4d88b721774f","Type":"ContainerStarted","Data":"339065cfc2b16eb3107e8078043b393a35d8143dbee45941055d9916103c6fbe"}
Jun 03 16:53:10.393495 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:10.393416    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9" event={"ID":"651687c5-fa6d-49ac-a796-4d88b721774f","Type":"ContainerStarted","Data":"cbb32ddea54cd5a09d8411243406052883da4580bf1710585162f00daf7381bc"}
Jun 03 16:53:11.398323 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:11.398286    2563 generic.go:358] "Generic (PLEG): container finished" podID="651687c5-fa6d-49ac-a796-4d88b721774f" containerID="cbb32ddea54cd5a09d8411243406052883da4580bf1710585162f00daf7381bc" exitCode=0
Jun 03 16:53:11.398708 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:11.398369    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9" event={"ID":"651687c5-fa6d-49ac-a796-4d88b721774f","Type":"ContainerDied","Data":"cbb32ddea54cd5a09d8411243406052883da4580bf1710585162f00daf7381bc"}
Jun 03 16:53:12.403976 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:12.403938    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9" event={"ID":"651687c5-fa6d-49ac-a796-4d88b721774f","Type":"ContainerStarted","Data":"4df6bd1c5a2a8a42ca3e9119e37a782b7582faffc3d391535d9702aeb405c9f3"}
Jun 03 16:53:12.404354 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:12.404047    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:12.431390 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:12.431335    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9" podStartSLOduration=1.712898037 podStartE2EDuration="6.431320514s" podCreationTimestamp="2026-06-03 16:53:06 +0000 UTC" firstStartedPulling="2026-06-03 16:53:07.04707588 +0000 UTC m=+528.767968151" lastFinishedPulling="2026-06-03 16:53:11.765498357 +0000 UTC m=+533.486390628" observedRunningTime="2026-06-03 16:53:12.428678074 +0000 UTC m=+534.149570379" watchObservedRunningTime="2026-06-03 16:53:12.431320514 +0000 UTC m=+534.152212875"
Jun 03 16:53:23.409858 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:23.409829    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-5sph9"
Jun 03 16:53:27.019340 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.019304    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm"]
Jun 03 16:53:27.028907 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.028882    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm"
Jun 03 16:53:27.030340 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.030313    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm"]
Jun 03 16:53:27.031439 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.031420    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 03 16:53:27.031629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.031601    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 03 16:53:27.031792 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.031603    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mrll8\""
Jun 03 16:53:27.057140 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.057119    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-nmxdl"]
Jun 03 16:53:27.060618 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.060600    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-nmxdl"
Jun 03 16:53:27.063347 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.063317    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jun 03 16:53:27.063442 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.063321    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-f4pld\""
Jun 03 16:53:27.067078 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.067058    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-nmxdl"]
Jun 03 16:53:27.157512 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.157479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6634b3af-5940-49de-a246-9a225b62688e-tls-certs\") pod \"kube-auth-proxy-8f98dcdbc-v74lm\" (UID: \"6634b3af-5940-49de-a246-9a225b62688e\") " pod="openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm"
Jun 03 16:53:27.157695 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.157536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fpqk\" (UniqueName: \"kubernetes.io/projected/6634b3af-5940-49de-a246-9a225b62688e-kube-api-access-9fpqk\") pod \"kube-auth-proxy-8f98dcdbc-v74lm\" (UID: \"6634b3af-5940-49de-a246-9a225b62688e\") " pod="openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm"
Jun 03 16:53:27.157695 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.157578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6634b3af-5940-49de-a246-9a225b62688e-tmp\") pod \"kube-auth-proxy-8f98dcdbc-v74lm\" (UID: \"6634b3af-5940-49de-a246-9a225b62688e\") " pod="openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm"
Jun 03 16:53:27.157826 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.157691    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pktj6\" (UniqueName: \"kubernetes.io/projected/e35c5294-0427-4667-932e-24f0d19b6c3e-kube-api-access-pktj6\") pod \"odh-model-controller-76588b95-nmxdl\" (UID: \"e35c5294-0427-4667-932e-24f0d19b6c3e\") " pod="opendatahub/odh-model-controller-76588b95-nmxdl"
Jun 03 16:53:27.157887 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.157836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e35c5294-0427-4667-932e-24f0d19b6c3e-cert\") pod \"odh-model-controller-76588b95-nmxdl\" (UID: \"e35c5294-0427-4667-932e-24f0d19b6c3e\") " pod="opendatahub/odh-model-controller-76588b95-nmxdl"
Jun 03 16:53:27.259289 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.259251    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e35c5294-0427-4667-932e-24f0d19b6c3e-cert\") pod \"odh-model-controller-76588b95-nmxdl\" (UID: \"e35c5294-0427-4667-932e-24f0d19b6c3e\") " pod="opendatahub/odh-model-controller-76588b95-nmxdl"
Jun 03 16:53:27.259502 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.259313    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6634b3af-5940-49de-a246-9a225b62688e-tls-certs\") pod \"kube-auth-proxy-8f98dcdbc-v74lm\" (UID: \"6634b3af-5940-49de-a246-9a225b62688e\") " pod="openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm"
Jun 03 16:53:27.259502 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.259345    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fpqk\" (UniqueName: \"kubernetes.io/projected/6634b3af-5940-49de-a246-9a225b62688e-kube-api-access-9fpqk\") pod \"kube-auth-proxy-8f98dcdbc-v74lm\" (UID: \"6634b3af-5940-49de-a246-9a225b62688e\") " pod="openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm"
Jun 03 16:53:27.259502 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.259379    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6634b3af-5940-49de-a246-9a225b62688e-tmp\") pod \"kube-auth-proxy-8f98dcdbc-v74lm\" (UID: \"6634b3af-5940-49de-a246-9a225b62688e\") " pod="openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm"
Jun 03 16:53:27.259502 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.259416    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pktj6\" (UniqueName: \"kubernetes.io/projected/e35c5294-0427-4667-932e-24f0d19b6c3e-kube-api-access-pktj6\") pod \"odh-model-controller-76588b95-nmxdl\" (UID: \"e35c5294-0427-4667-932e-24f0d19b6c3e\") " pod="opendatahub/odh-model-controller-76588b95-nmxdl"
Jun 03 16:53:27.259502 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:53:27.259416    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jun 03 16:53:27.259795 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:53:27.259524    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35c5294-0427-4667-932e-24f0d19b6c3e-cert podName:e35c5294-0427-4667-932e-24f0d19b6c3e nodeName:}" failed. No retries permitted until 2026-06-03 16:53:27.759501643 +0000 UTC m=+549.480393936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e35c5294-0427-4667-932e-24f0d19b6c3e-cert") pod "odh-model-controller-76588b95-nmxdl" (UID: "e35c5294-0427-4667-932e-24f0d19b6c3e") : secret "odh-model-controller-webhook-cert" not found
Jun 03 16:53:27.261742 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.261706    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6634b3af-5940-49de-a246-9a225b62688e-tmp\") pod \"kube-auth-proxy-8f98dcdbc-v74lm\" (UID: \"6634b3af-5940-49de-a246-9a225b62688e\") " pod="openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm"
Jun 03 16:53:27.261885 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.261868    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6634b3af-5940-49de-a246-9a225b62688e-tls-certs\") pod \"kube-auth-proxy-8f98dcdbc-v74lm\" (UID: \"6634b3af-5940-49de-a246-9a225b62688e\") " pod="openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm"
Jun 03 16:53:27.278487 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.278420    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fpqk\" (UniqueName: \"kubernetes.io/projected/6634b3af-5940-49de-a246-9a225b62688e-kube-api-access-9fpqk\") pod \"kube-auth-proxy-8f98dcdbc-v74lm\" (UID: \"6634b3af-5940-49de-a246-9a225b62688e\") " pod="openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm"
Jun 03 16:53:27.278674 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.278585    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pktj6\" (UniqueName: \"kubernetes.io/projected/e35c5294-0427-4667-932e-24f0d19b6c3e-kube-api-access-pktj6\") pod \"odh-model-controller-76588b95-nmxdl\" (UID: \"e35c5294-0427-4667-932e-24f0d19b6c3e\") " pod="opendatahub/odh-model-controller-76588b95-nmxdl"
Jun 03 16:53:27.339596 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.339560    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm"
Jun 03 16:53:27.470334 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.470278    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm"]
Jun 03 16:53:27.473419 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:53:27.473384    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6634b3af_5940_49de_a246_9a225b62688e.slice/crio-82e4e1aa694564dc041a62b47543687c76cb5c20e3678c59d02625a32d45cdc0 WatchSource:0}: Error finding container 82e4e1aa694564dc041a62b47543687c76cb5c20e3678c59d02625a32d45cdc0: Status 404 returned error can't find the container with id 82e4e1aa694564dc041a62b47543687c76cb5c20e3678c59d02625a32d45cdc0
Jun 03 16:53:27.764156 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.764128    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e35c5294-0427-4667-932e-24f0d19b6c3e-cert\") pod \"odh-model-controller-76588b95-nmxdl\" (UID: \"e35c5294-0427-4667-932e-24f0d19b6c3e\") " pod="opendatahub/odh-model-controller-76588b95-nmxdl"
Jun 03 16:53:27.766413 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.766394    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e35c5294-0427-4667-932e-24f0d19b6c3e-cert\") pod \"odh-model-controller-76588b95-nmxdl\" (UID: \"e35c5294-0427-4667-932e-24f0d19b6c3e\") " pod="opendatahub/odh-model-controller-76588b95-nmxdl"
Jun 03 16:53:27.880477 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.880445    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-npkvj"]
Jun 03 16:53:27.885675 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.885652    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-npkvj"
Jun 03 16:53:27.888220 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.888195    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jun 03 16:53:27.888360 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.888201    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-g7cl8\""
Jun 03 16:53:27.892646 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.892621    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-npkvj"]
Jun 03 16:53:27.965863 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.965832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed50f760-5d06-47a0-915a-9d3c61b8c45d-tls-certs\") pod \"model-serving-api-6577596cd5-npkvj\" (UID: \"ed50f760-5d06-47a0-915a-9d3c61b8c45d\") " pod="opendatahub/model-serving-api-6577596cd5-npkvj"
Jun 03 16:53:27.966019 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.965868    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkqjd\" (UniqueName: \"kubernetes.io/projected/ed50f760-5d06-47a0-915a-9d3c61b8c45d-kube-api-access-lkqjd\") pod \"model-serving-api-6577596cd5-npkvj\" (UID: \"ed50f760-5d06-47a0-915a-9d3c61b8c45d\") " pod="opendatahub/model-serving-api-6577596cd5-npkvj"
Jun 03 16:53:27.973900 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:27.973875    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-nmxdl"
Jun 03 16:53:28.067277 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:28.067251    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed50f760-5d06-47a0-915a-9d3c61b8c45d-tls-certs\") pod \"model-serving-api-6577596cd5-npkvj\" (UID: \"ed50f760-5d06-47a0-915a-9d3c61b8c45d\") " pod="opendatahub/model-serving-api-6577596cd5-npkvj"
Jun 03 16:53:28.067693 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:28.067295    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lkqjd\" (UniqueName: \"kubernetes.io/projected/ed50f760-5d06-47a0-915a-9d3c61b8c45d-kube-api-access-lkqjd\") pod \"model-serving-api-6577596cd5-npkvj\" (UID: \"ed50f760-5d06-47a0-915a-9d3c61b8c45d\") " pod="opendatahub/model-serving-api-6577596cd5-npkvj"
Jun 03 16:53:28.070214 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:28.070185    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed50f760-5d06-47a0-915a-9d3c61b8c45d-tls-certs\") pod \"model-serving-api-6577596cd5-npkvj\" (UID: \"ed50f760-5d06-47a0-915a-9d3c61b8c45d\") " pod="opendatahub/model-serving-api-6577596cd5-npkvj"
Jun 03 16:53:28.075970 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:28.075922    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkqjd\" (UniqueName: \"kubernetes.io/projected/ed50f760-5d06-47a0-915a-9d3c61b8c45d-kube-api-access-lkqjd\") pod \"model-serving-api-6577596cd5-npkvj\" (UID: \"ed50f760-5d06-47a0-915a-9d3c61b8c45d\") " pod="opendatahub/model-serving-api-6577596cd5-npkvj"
Jun 03 16:53:28.108873 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:28.108819    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-nmxdl"]
Jun 03 16:53:28.115324 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:53:28.115294    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35c5294_0427_4667_932e_24f0d19b6c3e.slice/crio-aa23d12d090b9ed465f0a61d7b5b8d49f0c1d7999a938aee996176faf0e154cd WatchSource:0}: Error finding container aa23d12d090b9ed465f0a61d7b5b8d49f0c1d7999a938aee996176faf0e154cd: Status 404 returned error can't find the container with id aa23d12d090b9ed465f0a61d7b5b8d49f0c1d7999a938aee996176faf0e154cd
Jun 03 16:53:28.199680 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:28.199646    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-npkvj"
Jun 03 16:53:28.373955 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:28.373917    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-npkvj"]
Jun 03 16:53:28.378908 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:53:28.378862    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded50f760_5d06_47a0_915a_9d3c61b8c45d.slice/crio-81a11b1714a51455cba1b065a4bc45d94df0279c769758bf911369d2e1ace603 WatchSource:0}: Error finding container 81a11b1714a51455cba1b065a4bc45d94df0279c769758bf911369d2e1ace603: Status 404 returned error can't find the container with id 81a11b1714a51455cba1b065a4bc45d94df0279c769758bf911369d2e1ace603
Jun 03 16:53:28.464499 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:28.464443    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-npkvj" event={"ID":"ed50f760-5d06-47a0-915a-9d3c61b8c45d","Type":"ContainerStarted","Data":"81a11b1714a51455cba1b065a4bc45d94df0279c769758bf911369d2e1ace603"}
Jun 03 16:53:28.465920 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:28.465818    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm" event={"ID":"6634b3af-5940-49de-a246-9a225b62688e","Type":"ContainerStarted","Data":"82e4e1aa694564dc041a62b47543687c76cb5c20e3678c59d02625a32d45cdc0"}
Jun 03 16:53:28.467373 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:28.467343    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-nmxdl" event={"ID":"e35c5294-0427-4667-932e-24f0d19b6c3e","Type":"ContainerStarted","Data":"aa23d12d090b9ed465f0a61d7b5b8d49f0c1d7999a938aee996176faf0e154cd"}
Jun 03 16:53:33.505226 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:33.505186    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-npkvj" event={"ID":"ed50f760-5d06-47a0-915a-9d3c61b8c45d","Type":"ContainerStarted","Data":"9c65bd48403630eb9802d6802030add23a8779a784f5507504832ec9b4f9c6fb"}
Jun 03 16:53:33.505701 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:33.505310    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-npkvj"
Jun 03 16:53:33.506715 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:33.506686    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm" event={"ID":"6634b3af-5940-49de-a246-9a225b62688e","Type":"ContainerStarted","Data":"181dbcccf0da182cb9cbdf3cd039a8a4e9fbf07896a7a0c6f884296657cec091"}
Jun 03 16:53:33.508131 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:33.508105    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-nmxdl" event={"ID":"e35c5294-0427-4667-932e-24f0d19b6c3e","Type":"ContainerStarted","Data":"d8b7b1e0281ee97c5795fc550b481397ca230319966e6231233158b0fe9bb5e0"}
Jun 03 16:53:33.508244 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:33.508209    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-nmxdl"
Jun 03 16:53:33.521311 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:33.521048    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-npkvj" podStartSLOduration=2.287746301 podStartE2EDuration="6.521034292s" podCreationTimestamp="2026-06-03 16:53:27 +0000 UTC" firstStartedPulling="2026-06-03 16:53:28.381892212 +0000 UTC m=+550.102784488" lastFinishedPulling="2026-06-03 16:53:32.615180201 +0000 UTC m=+554.336072479" observedRunningTime="2026-06-03 16:53:33.520155991 +0000 UTC m=+555.241048284" watchObservedRunningTime="2026-06-03 16:53:33.521034292 +0000 UTC m=+555.241926586"
Jun 03 16:53:33.535946 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:33.535906    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8f98dcdbc-v74lm" podStartSLOduration=2.403308216 podStartE2EDuration="7.535895732s" podCreationTimestamp="2026-06-03 16:53:26 +0000 UTC" firstStartedPulling="2026-06-03 16:53:27.475240379 +0000 UTC m=+549.196132665" lastFinishedPulling="2026-06-03 16:53:32.607827896 +0000 UTC m=+554.328720181" observedRunningTime="2026-06-03 16:53:33.534455387 +0000 UTC m=+555.255347682" watchObservedRunningTime="2026-06-03 16:53:33.535895732 +0000 UTC m=+555.256788104"
Jun 03 16:53:33.554064 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:33.554020    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-nmxdl" podStartSLOduration=2.011261195 podStartE2EDuration="6.554008898s" podCreationTimestamp="2026-06-03 16:53:27 +0000 UTC" firstStartedPulling="2026-06-03 16:53:28.116511062 +0000 UTC m=+549.837403345" lastFinishedPulling="2026-06-03 16:53:32.659258763 +0000 UTC m=+554.380151048" observedRunningTime="2026-06-03 16:53:33.5524416 +0000 UTC m=+555.273333893" watchObservedRunningTime="2026-06-03 16:53:33.554008898 +0000 UTC m=+555.274901242"
Jun 03 16:53:37.781933 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.781900    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp"]
Jun 03 16:53:37.785465 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.785441    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp"
Jun 03 16:53:37.788540 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.788516    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gq8cj\""
Jun 03 16:53:37.788862 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.788845    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jun 03 16:53:37.808386 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.808359    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp"]
Jun 03 16:53:37.810652 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.810628    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-cncvf"]
Jun 03 16:53:37.814283 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.814262    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-cncvf"
Jun 03 16:53:37.818243 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.818193    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jun 03 16:53:37.818493 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.818478    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-s997g\""
Jun 03 16:53:37.853187 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.853161    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-cncvf"]
Jun 03 16:53:37.873842 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.873811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lwqj\" (UniqueName: \"kubernetes.io/projected/85afd501-f9bc-473f-99f7-86f909c964a7-kube-api-access-2lwqj\") pod \"kserve-controller-manager-7c99ffcdcd-mmblp\" (UID: \"85afd501-f9bc-473f-99f7-86f909c964a7\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp"
Jun 03 16:53:37.873961 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.873856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85afd501-f9bc-473f-99f7-86f909c964a7-cert\") pod \"kserve-controller-manager-7c99ffcdcd-mmblp\" (UID: \"85afd501-f9bc-473f-99f7-86f909c964a7\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp"
Jun 03 16:53:37.976161 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.976114    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb8qp\" (UniqueName: \"kubernetes.io/projected/cb2f4d65-69b1-4ad5-add1-a2c718695855-kube-api-access-hb8qp\") pod \"llmisvc-controller-manager-c6b9847d7-cncvf\" (UID: \"cb2f4d65-69b1-4ad5-add1-a2c718695855\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-cncvf"
Jun 03 16:53:37.976331 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.976237    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2lwqj\" (UniqueName: \"kubernetes.io/projected/85afd501-f9bc-473f-99f7-86f909c964a7-kube-api-access-2lwqj\") pod \"kserve-controller-manager-7c99ffcdcd-mmblp\" (UID: \"85afd501-f9bc-473f-99f7-86f909c964a7\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp"
Jun 03 16:53:37.976331 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.976266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb2f4d65-69b1-4ad5-add1-a2c718695855-cert\") pod \"llmisvc-controller-manager-c6b9847d7-cncvf\" (UID: \"cb2f4d65-69b1-4ad5-add1-a2c718695855\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-cncvf"
Jun 03 16:53:37.976331 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.976323    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85afd501-f9bc-473f-99f7-86f909c964a7-cert\") pod \"kserve-controller-manager-7c99ffcdcd-mmblp\" (UID: \"85afd501-f9bc-473f-99f7-86f909c964a7\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp"
Jun 03 16:53:37.976501 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:53:37.976484    2563 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jun 03 16:53:37.976550 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:53:37.976546    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85afd501-f9bc-473f-99f7-86f909c964a7-cert podName:85afd501-f9bc-473f-99f7-86f909c964a7 nodeName:}" failed. No retries permitted until 2026-06-03 16:53:38.47652411 +0000 UTC m=+560.197416396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/85afd501-f9bc-473f-99f7-86f909c964a7-cert") pod "kserve-controller-manager-7c99ffcdcd-mmblp" (UID: "85afd501-f9bc-473f-99f7-86f909c964a7") : secret "kserve-webhook-server-cert" not found
Jun 03 16:53:37.989334 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:37.989309    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lwqj\" (UniqueName: \"kubernetes.io/projected/85afd501-f9bc-473f-99f7-86f909c964a7-kube-api-access-2lwqj\") pod \"kserve-controller-manager-7c99ffcdcd-mmblp\" (UID: \"85afd501-f9bc-473f-99f7-86f909c964a7\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp"
Jun 03 16:53:38.077167 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:38.077089    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hb8qp\" (UniqueName: \"kubernetes.io/projected/cb2f4d65-69b1-4ad5-add1-a2c718695855-kube-api-access-hb8qp\") pod \"llmisvc-controller-manager-c6b9847d7-cncvf\" (UID: \"cb2f4d65-69b1-4ad5-add1-a2c718695855\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-cncvf"
Jun 03 16:53:38.077303 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:38.077191    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb2f4d65-69b1-4ad5-add1-a2c718695855-cert\") pod \"llmisvc-controller-manager-c6b9847d7-cncvf\" (UID: \"cb2f4d65-69b1-4ad5-add1-a2c718695855\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-cncvf"
Jun 03 16:53:38.079531 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:38.079508    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb2f4d65-69b1-4ad5-add1-a2c718695855-cert\") pod \"llmisvc-controller-manager-c6b9847d7-cncvf\" (UID: \"cb2f4d65-69b1-4ad5-add1-a2c718695855\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-cncvf"
Jun 03 16:53:38.097478 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:38.097445    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb8qp\" (UniqueName: \"kubernetes.io/projected/cb2f4d65-69b1-4ad5-add1-a2c718695855-kube-api-access-hb8qp\") pod \"llmisvc-controller-manager-c6b9847d7-cncvf\" (UID: \"cb2f4d65-69b1-4ad5-add1-a2c718695855\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-cncvf"
Jun 03 16:53:38.124990 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:38.124965    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-cncvf"
Jun 03 16:53:38.269257 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:38.269234    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-cncvf"]
Jun 03 16:53:38.271175 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:53:38.271147    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcb2f4d65_69b1_4ad5_add1_a2c718695855.slice/crio-ac0a43c88179b7e98d29ecb2d764640e40bfc63485e32511df4f5a053ac59098 WatchSource:0}: Error finding container ac0a43c88179b7e98d29ecb2d764640e40bfc63485e32511df4f5a053ac59098: Status 404 returned error can't find the container with id ac0a43c88179b7e98d29ecb2d764640e40bfc63485e32511df4f5a053ac59098
Jun 03 16:53:38.481099 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:38.481068    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85afd501-f9bc-473f-99f7-86f909c964a7-cert\") pod \"kserve-controller-manager-7c99ffcdcd-mmblp\" (UID: \"85afd501-f9bc-473f-99f7-86f909c964a7\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp"
Jun 03 16:53:38.483493 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:38.483466    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85afd501-f9bc-473f-99f7-86f909c964a7-cert\") pod \"kserve-controller-manager-7c99ffcdcd-mmblp\" (UID: \"85afd501-f9bc-473f-99f7-86f909c964a7\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp"
Jun 03 16:53:38.525487 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:38.525460    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-cncvf" event={"ID":"cb2f4d65-69b1-4ad5-add1-a2c718695855","Type":"ContainerStarted","Data":"ac0a43c88179b7e98d29ecb2d764640e40bfc63485e32511df4f5a053ac59098"}
Jun 03 16:53:38.696182 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:38.696149    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp"
Jun 03 16:53:38.837075 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:38.837047    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp"]
Jun 03 16:53:38.853355 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:53:38.853327    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85afd501_f9bc_473f_99f7_86f909c964a7.slice/crio-ed392c68745a279c3baf16ac28230d4b95f161163047935905520b34ee38546f WatchSource:0}: Error finding container ed392c68745a279c3baf16ac28230d4b95f161163047935905520b34ee38546f: Status 404 returned error can't find the container with id ed392c68745a279c3baf16ac28230d4b95f161163047935905520b34ee38546f
Jun 03 16:53:39.530505 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:39.530472    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp" event={"ID":"85afd501-f9bc-473f-99f7-86f909c964a7","Type":"ContainerStarted","Data":"ed392c68745a279c3baf16ac28230d4b95f161163047935905520b34ee38546f"}
Jun 03 16:53:42.546264 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.546226    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp" event={"ID":"85afd501-f9bc-473f-99f7-86f909c964a7","Type":"ContainerStarted","Data":"41dc27c3cddc40ba0122d3133a3de6c3099de8f5703849dc67d7337ff4fb5780"}
Jun 03 16:53:42.546703 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.546419    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp"
Jun 03 16:53:42.547953 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.547925    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-cncvf" event={"ID":"cb2f4d65-69b1-4ad5-add1-a2c718695855","Type":"ContainerStarted","Data":"4b3875f1490a6a5c7848c05a09bad23ba86d3f3853f692d366099ef7c8b9f6cf"}
Jun 03 16:53:42.548050 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.548017    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-cncvf"
Jun 03 16:53:42.573326 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.573264    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp" podStartSLOduration=2.363642219 podStartE2EDuration="5.573250012s" podCreationTimestamp="2026-06-03 16:53:37 +0000 UTC" firstStartedPulling="2026-06-03 16:53:38.854842771 +0000 UTC m=+560.575735042" lastFinishedPulling="2026-06-03 16:53:42.064450554 +0000 UTC m=+563.785342835" observedRunningTime="2026-06-03 16:53:42.572604766 +0000 UTC m=+564.293497151" watchObservedRunningTime="2026-06-03 16:53:42.573250012 +0000 UTC m=+564.294142304"
Jun 03 16:53:42.601007 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.600975    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-78b89f755d-vkffx"]
Jun 03 16:53:42.603489 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.603447    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-cncvf" podStartSLOduration=1.81179644 podStartE2EDuration="5.603434452s" podCreationTimestamp="2026-06-03 16:53:37 +0000 UTC" firstStartedPulling="2026-06-03 16:53:38.272456427 +0000 UTC m=+559.993348698" lastFinishedPulling="2026-06-03 16:53:42.06409443 +0000 UTC m=+563.784986710" observedRunningTime="2026-06-03 16:53:42.601412367 +0000 UTC m=+564.322304661" watchObservedRunningTime="2026-06-03 16:53:42.603434452 +0000 UTC m=+564.324326744"
Jun 03 16:53:42.603978 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.603958    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-78b89f755d-vkffx"
Jun 03 16:53:42.607206 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.607183    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pxxg2\""
Jun 03 16:53:42.607206 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.607203    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 03 16:53:42.613035 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.613012    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-78b89f755d-vkffx"]
Jun 03 16:53:42.724125 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.724095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/069a2daf-b185-4687-a412-2864b36cb3e3-redirect-config\") pod \"dashboard-redirect-78b89f755d-vkffx\" (UID: \"069a2daf-b185-4687-a412-2864b36cb3e3\") " pod="opendatahub/dashboard-redirect-78b89f755d-vkffx"
Jun 03 16:53:42.724302 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.724278    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b84kv\" (UniqueName: \"kubernetes.io/projected/069a2daf-b185-4687-a412-2864b36cb3e3-kube-api-access-b84kv\") pod \"dashboard-redirect-78b89f755d-vkffx\" (UID: \"069a2daf-b185-4687-a412-2864b36cb3e3\") " pod="opendatahub/dashboard-redirect-78b89f755d-vkffx"
Jun 03 16:53:42.825107 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.825027    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b84kv\" (UniqueName: \"kubernetes.io/projected/069a2daf-b185-4687-a412-2864b36cb3e3-kube-api-access-b84kv\") pod \"dashboard-redirect-78b89f755d-vkffx\" (UID: \"069a2daf-b185-4687-a412-2864b36cb3e3\") " pod="opendatahub/dashboard-redirect-78b89f755d-vkffx"
Jun 03 16:53:42.825268 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.825189    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/069a2daf-b185-4687-a412-2864b36cb3e3-redirect-config\") pod \"dashboard-redirect-78b89f755d-vkffx\" (UID: \"069a2daf-b185-4687-a412-2864b36cb3e3\") " pod="opendatahub/dashboard-redirect-78b89f755d-vkffx"
Jun 03 16:53:42.825864 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.825845    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/069a2daf-b185-4687-a412-2864b36cb3e3-redirect-config\") pod \"dashboard-redirect-78b89f755d-vkffx\" (UID: \"069a2daf-b185-4687-a412-2864b36cb3e3\") " pod="opendatahub/dashboard-redirect-78b89f755d-vkffx"
Jun 03 16:53:42.838053 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.838026    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b84kv\" (UniqueName: \"kubernetes.io/projected/069a2daf-b185-4687-a412-2864b36cb3e3-kube-api-access-b84kv\") pod \"dashboard-redirect-78b89f755d-vkffx\" (UID: \"069a2daf-b185-4687-a412-2864b36cb3e3\") " pod="opendatahub/dashboard-redirect-78b89f755d-vkffx"
Jun 03 16:53:42.916715 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:42.916684    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-78b89f755d-vkffx"
Jun 03 16:53:43.057678 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:43.057651    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-78b89f755d-vkffx"]
Jun 03 16:53:43.059063 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:53:43.059035    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod069a2daf_b185_4687_a412_2864b36cb3e3.slice/crio-ce449edc3cdd4a2d927ee2a022cdc28cebca7f4ea574416133142b7a455988d4 WatchSource:0}: Error finding container ce449edc3cdd4a2d927ee2a022cdc28cebca7f4ea574416133142b7a455988d4: Status 404 returned error can't find the container with id ce449edc3cdd4a2d927ee2a022cdc28cebca7f4ea574416133142b7a455988d4
Jun 03 16:53:43.134108 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:43.134023    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-bdblq"]
Jun 03 16:53:43.136767 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:43.136724    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bdblq"
Jun 03 16:53:43.141130 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:43.141108    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
Jun 03 16:53:43.142242 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:43.142223    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-fjd5b\""
Jun 03 16:53:43.142436 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:43.142415    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
Jun 03 16:53:43.155619 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:43.155598    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-bdblq"]
Jun 03 16:53:43.229851 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:43.229816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdnrp\" (UniqueName: \"kubernetes.io/projected/704bcd40-9011-4bd6-830e-bee75192c125-kube-api-access-xdnrp\") pod \"servicemesh-operator3-55f49c5f94-bdblq\" (UID: \"704bcd40-9011-4bd6-830e-bee75192c125\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bdblq"
Jun 03 16:53:43.230036 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:43.229939    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/704bcd40-9011-4bd6-830e-bee75192c125-operator-config\") pod \"servicemesh-operator3-55f49c5f94-bdblq\" (UID: \"704bcd40-9011-4bd6-830e-bee75192c125\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bdblq"
Jun 03 16:53:43.330906 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:43.330862    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/704bcd40-9011-4bd6-830e-bee75192c125-operator-config\") pod \"servicemesh-operator3-55f49c5f94-bdblq\" (UID: \"704bcd40-9011-4bd6-830e-bee75192c125\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bdblq"
Jun 03 16:53:43.331060 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:43.330970    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xdnrp\" (UniqueName: \"kubernetes.io/projected/704bcd40-9011-4bd6-830e-bee75192c125-kube-api-access-xdnrp\") pod \"servicemesh-operator3-55f49c5f94-bdblq\" (UID: \"704bcd40-9011-4bd6-830e-bee75192c125\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bdblq"
Jun 03 16:53:43.333350 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:43.333331    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/704bcd40-9011-4bd6-830e-bee75192c125-operator-config\") pod \"servicemesh-operator3-55f49c5f94-bdblq\" (UID: \"704bcd40-9011-4bd6-830e-bee75192c125\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bdblq"
Jun 03 16:53:43.340655 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:43.340628    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdnrp\" (UniqueName: \"kubernetes.io/projected/704bcd40-9011-4bd6-830e-bee75192c125-kube-api-access-xdnrp\") pod \"servicemesh-operator3-55f49c5f94-bdblq\" (UID: \"704bcd40-9011-4bd6-830e-bee75192c125\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bdblq"
Jun 03 16:53:43.447594 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:43.447494    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bdblq"
Jun 03 16:53:43.552549 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:43.552509    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-78b89f755d-vkffx" event={"ID":"069a2daf-b185-4687-a412-2864b36cb3e3","Type":"ContainerStarted","Data":"ce449edc3cdd4a2d927ee2a022cdc28cebca7f4ea574416133142b7a455988d4"}
Jun 03 16:53:43.603836 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:43.603805    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-bdblq"]
Jun 03 16:53:43.608518 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:53:43.605838    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod704bcd40_9011_4bd6_830e_bee75192c125.slice/crio-aabcf8ff5424510d348dc1b10ce625ecd67602dc413d86c6e114244596d9643a WatchSource:0}: Error finding container aabcf8ff5424510d348dc1b10ce625ecd67602dc413d86c6e114244596d9643a: Status 404 returned error can't find the container with id aabcf8ff5424510d348dc1b10ce625ecd67602dc413d86c6e114244596d9643a
Jun 03 16:53:44.514057 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:44.514018    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-nmxdl"
Jun 03 16:53:44.516911 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:44.516887    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-npkvj"
Jun 03 16:53:44.559408 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:44.559354    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bdblq" event={"ID":"704bcd40-9011-4bd6-830e-bee75192c125","Type":"ContainerStarted","Data":"aabcf8ff5424510d348dc1b10ce625ecd67602dc413d86c6e114244596d9643a"}
Jun 03 16:53:49.584401 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:49.584363    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-78b89f755d-vkffx" event={"ID":"069a2daf-b185-4687-a412-2864b36cb3e3","Type":"ContainerStarted","Data":"44d6fc79500bd5a2a01929de234be88067ef1e16c505ebc32972b4625386790d"}
Jun 03 16:53:49.585983 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:49.585955    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bdblq" event={"ID":"704bcd40-9011-4bd6-830e-bee75192c125","Type":"ContainerStarted","Data":"70712dd1624b4d96ed172961ab84038214a5f3c6c76ef3d55879f1316685a425"}
Jun 03 16:53:49.586127 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:49.586108    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bdblq"
Jun 03 16:53:49.602359 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:49.602301    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-78b89f755d-vkffx" podStartSLOduration=1.801593799 podStartE2EDuration="7.602283733s" podCreationTimestamp="2026-06-03 16:53:42 +0000 UTC" firstStartedPulling="2026-06-03 16:53:43.060663469 +0000 UTC m=+564.781555741" lastFinishedPulling="2026-06-03 16:53:48.8613534 +0000 UTC m=+570.582245675" observedRunningTime="2026-06-03 16:53:49.598951827 +0000 UTC m=+571.319844131" watchObservedRunningTime="2026-06-03 16:53:49.602283733 +0000 UTC m=+571.323176027"
Jun 03 16:53:49.621995 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:49.621936    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bdblq" podStartSLOduration=1.375539609 podStartE2EDuration="6.62191747s" podCreationTimestamp="2026-06-03 16:53:43 +0000 UTC" firstStartedPulling="2026-06-03 16:53:43.610644066 +0000 UTC m=+565.331536337" lastFinishedPulling="2026-06-03 16:53:48.85702192 +0000 UTC m=+570.577914198" observedRunningTime="2026-06-03 16:53:49.618271679 +0000 UTC m=+571.339163973" watchObservedRunningTime="2026-06-03 16:53:49.62191747 +0000 UTC m=+571.342809765"
Jun 03 16:53:59.623921 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.623889    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"]
Jun 03 16:53:59.626925 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.626895    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.629710 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.629688    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jun 03 16:53:59.629710 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.629700    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jun 03 16:53:59.629895 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.629754    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 03 16:53:59.629895 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.629688    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jun 03 16:53:59.629895 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.629795    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9cxqc\""
Jun 03 16:53:59.637641 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.637619    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"]
Jun 03 16:53:59.689167 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.689134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d0dc1df4-577e-44fe-a875-fbc877cbca3e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.689343 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.689171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0dc1df4-577e-44fe-a875-fbc877cbca3e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.689343 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.689191    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0dc1df4-577e-44fe-a875-fbc877cbca3e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.689343 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.689247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d0dc1df4-577e-44fe-a875-fbc877cbca3e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.689343 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.689332    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pdnb\" (UniqueName: \"kubernetes.io/projected/d0dc1df4-577e-44fe-a875-fbc877cbca3e-kube-api-access-4pdnb\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.689524 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.689413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0dc1df4-577e-44fe-a875-fbc877cbca3e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.689524 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.689437    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d0dc1df4-577e-44fe-a875-fbc877cbca3e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.790179 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.790133    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0dc1df4-577e-44fe-a875-fbc877cbca3e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.790366 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.790190    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d0dc1df4-577e-44fe-a875-fbc877cbca3e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.790366 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.790245    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d0dc1df4-577e-44fe-a875-fbc877cbca3e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.790366 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.790282    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0dc1df4-577e-44fe-a875-fbc877cbca3e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.790366 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.790307    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0dc1df4-577e-44fe-a875-fbc877cbca3e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.790366 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.790359    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d0dc1df4-577e-44fe-a875-fbc877cbca3e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.790629 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.790391    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4pdnb\" (UniqueName: \"kubernetes.io/projected/d0dc1df4-577e-44fe-a875-fbc877cbca3e-kube-api-access-4pdnb\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.791014 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.790987    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d0dc1df4-577e-44fe-a875-fbc877cbca3e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.792748 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.792704    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d0dc1df4-577e-44fe-a875-fbc877cbca3e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.792842 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.792788    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0dc1df4-577e-44fe-a875-fbc877cbca3e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.792842 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.792823    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0dc1df4-577e-44fe-a875-fbc877cbca3e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.793118 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.793097    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d0dc1df4-577e-44fe-a875-fbc877cbca3e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.798270 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.798244    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0dc1df4-577e-44fe-a875-fbc877cbca3e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.798547 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.798527    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pdnb\" (UniqueName: \"kubernetes.io/projected/d0dc1df4-577e-44fe-a875-fbc877cbca3e-kube-api-access-4pdnb\") pod \"istiod-openshift-gateway-798958bb55-4fssq\" (UID: \"d0dc1df4-577e-44fe-a875-fbc877cbca3e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:53:59.937783 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:53:59.937677    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:54:00.077590 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:00.077560    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"]
Jun 03 16:54:00.079840 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:54:00.079793    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0dc1df4_577e_44fe_a875_fbc877cbca3e.slice/crio-3024c9d2eaa7f7523b72eb50edfce21113a98d9277006e350176c8767434d8fa WatchSource:0}: Error finding container 3024c9d2eaa7f7523b72eb50edfce21113a98d9277006e350176c8767434d8fa: Status 404 returned error can't find the container with id 3024c9d2eaa7f7523b72eb50edfce21113a98d9277006e350176c8767434d8fa
Jun 03 16:54:00.592231 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:00.592143    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bdblq"
Jun 03 16:54:00.624942 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:00.624910    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq" event={"ID":"d0dc1df4-577e-44fe-a875-fbc877cbca3e","Type":"ContainerStarted","Data":"3024c9d2eaa7f7523b72eb50edfce21113a98d9277006e350176c8767434d8fa"}
Jun 03 16:54:07.550572 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:07.550528    2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 03 16:54:07.550845 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:07.550594    2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 03 16:54:07.651310 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:07.650336    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq" event={"ID":"d0dc1df4-577e-44fe-a875-fbc877cbca3e","Type":"ContainerStarted","Data":"2b7a2bda4122df17741e6b8a359062a935852cce27c51e74f537af873745e5b3"}
Jun 03 16:54:07.651310 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:07.651277    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:54:07.670958 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:07.670913    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq" podStartSLOduration=1.202939077 podStartE2EDuration="8.670891206s" podCreationTimestamp="2026-06-03 16:53:59 +0000 UTC" firstStartedPulling="2026-06-03 16:54:00.08231879 +0000 UTC m=+581.803211061" lastFinishedPulling="2026-06-03 16:54:07.550270917 +0000 UTC m=+589.271163190" observedRunningTime="2026-06-03 16:54:07.669873701 +0000 UTC m=+589.390765993" watchObservedRunningTime="2026-06-03 16:54:07.670891206 +0000 UTC m=+589.391783498"
Jun 03 16:54:08.656854 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:08.656823    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fssq"
Jun 03 16:54:13.555312 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:13.555278    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-cncvf"
Jun 03 16:54:13.558259 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:13.558238    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mmblp"
Jun 03 16:54:18.652487 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:18.652456    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-phgpp_ccbe3e7a-fea1-419f-af7f-bc26eaa0089e/console-operator/1.log"
Jun 03 16:54:18.653077 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:18.653054    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-phgpp_ccbe3e7a-fea1-419f-af7f-bc26eaa0089e/console-operator/1.log"
Jun 03 16:54:58.604037 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:58.603957    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s"]
Jun 03 16:54:58.611788 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:58.611773    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s"
Jun 03 16:54:58.618779 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:58.618757    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 03 16:54:58.619367 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:58.619350    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 03 16:54:58.620051 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:58.620034    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mllkv\""
Jun 03 16:54:58.625669 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:58.625649    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s"]
Jun 03 16:54:58.712185 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:58.712150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgpjw\" (UniqueName: \"kubernetes.io/projected/6830b7dc-2626-4970-b185-577ace6ce195-kube-api-access-tgpjw\") pod \"limitador-operator-controller-manager-85c4996f8c-qq25s\" (UID: \"6830b7dc-2626-4970-b185-577ace6ce195\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s"
Jun 03 16:54:58.813207 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:58.813171    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tgpjw\" (UniqueName: \"kubernetes.io/projected/6830b7dc-2626-4970-b185-577ace6ce195-kube-api-access-tgpjw\") pod \"limitador-operator-controller-manager-85c4996f8c-qq25s\" (UID: \"6830b7dc-2626-4970-b185-577ace6ce195\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s"
Jun 03 16:54:58.831331 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:58.831300    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgpjw\" (UniqueName: \"kubernetes.io/projected/6830b7dc-2626-4970-b185-577ace6ce195-kube-api-access-tgpjw\") pod \"limitador-operator-controller-manager-85c4996f8c-qq25s\" (UID: \"6830b7dc-2626-4970-b185-577ace6ce195\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s"
Jun 03 16:54:58.922041 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:58.921966    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s"
Jun 03 16:54:59.112668 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:59.112641    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s"]
Jun 03 16:54:59.114954 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:54:59.114925    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6830b7dc_2626_4970_b185_577ace6ce195.slice/crio-c83db5a15ae39ec97b38a3b095c9ef0ad4e1b077ba6a93f78d09173f027173c6 WatchSource:0}: Error finding container c83db5a15ae39ec97b38a3b095c9ef0ad4e1b077ba6a93f78d09173f027173c6: Status 404 returned error can't find the container with id c83db5a15ae39ec97b38a3b095c9ef0ad4e1b077ba6a93f78d09173f027173c6
Jun 03 16:54:59.833280 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:54:59.833242    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s" event={"ID":"6830b7dc-2626-4970-b185-577ace6ce195","Type":"ContainerStarted","Data":"c83db5a15ae39ec97b38a3b095c9ef0ad4e1b077ba6a93f78d09173f027173c6"}
Jun 03 16:55:01.842863 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:01.842829    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s" event={"ID":"6830b7dc-2626-4970-b185-577ace6ce195","Type":"ContainerStarted","Data":"f886fc88cf357c6665a19c057c1af1416173b374470b94ca8e4b4026b27efec5"}
Jun 03 16:55:01.842863 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:01.842870    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s"
Jun 03 16:55:12.848613 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:12.848582    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s"
Jun 03 16:55:12.919254 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:12.919203    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s" podStartSLOduration=12.646979975 podStartE2EDuration="14.919187427s" podCreationTimestamp="2026-06-03 16:54:58 +0000 UTC" firstStartedPulling="2026-06-03 16:54:59.116898412 +0000 UTC m=+640.837790684" lastFinishedPulling="2026-06-03 16:55:01.389105863 +0000 UTC m=+643.109998136" observedRunningTime="2026-06-03 16:55:01.912020811 +0000 UTC m=+643.632913117" watchObservedRunningTime="2026-06-03 16:55:12.919187427 +0000 UTC m=+654.640079759"
Jun 03 16:55:25.044483 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.044445    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s"]
Jun 03 16:55:25.044893 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.044679    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s" podUID="6830b7dc-2626-4970-b185-577ace6ce195" containerName="manager" containerID="cri-o://f886fc88cf357c6665a19c057c1af1416173b374470b94ca8e4b4026b27efec5" gracePeriod=2
Jun 03 16:55:25.071419 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.071394    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s"]
Jun 03 16:55:25.126161 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.126131    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6rk7b"]
Jun 03 16:55:25.126621 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.126603    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6830b7dc-2626-4970-b185-577ace6ce195" containerName="manager"
Jun 03 16:55:25.126709 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.126623    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6830b7dc-2626-4970-b185-577ace6ce195" containerName="manager"
Jun 03 16:55:25.126785 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.126709    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="6830b7dc-2626-4970-b185-577ace6ce195" containerName="manager"
Jun 03 16:55:25.130831 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.130811    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6rk7b"
Jun 03 16:55:25.151604 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.151580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dxcl\" (UniqueName: \"kubernetes.io/projected/a1f09a5d-a009-4bbd-b20c-c2352c2457b0-kube-api-access-2dxcl\") pod \"limitador-operator-controller-manager-85c4996f8c-6rk7b\" (UID: \"a1f09a5d-a009-4bbd-b20c-c2352c2457b0\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6rk7b"
Jun 03 16:55:25.251887 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.251859    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6rk7b"]
Jun 03 16:55:25.252262 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.252236    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2dxcl\" (UniqueName: \"kubernetes.io/projected/a1f09a5d-a009-4bbd-b20c-c2352c2457b0-kube-api-access-2dxcl\") pod \"limitador-operator-controller-manager-85c4996f8c-6rk7b\" (UID: \"a1f09a5d-a009-4bbd-b20c-c2352c2457b0\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6rk7b"
Jun 03 16:55:25.281207 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.281187    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s"
Jun 03 16:55:25.287823 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.287799    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dxcl\" (UniqueName: \"kubernetes.io/projected/a1f09a5d-a009-4bbd-b20c-c2352c2457b0-kube-api-access-2dxcl\") pod \"limitador-operator-controller-manager-85c4996f8c-6rk7b\" (UID: \"a1f09a5d-a009-4bbd-b20c-c2352c2457b0\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6rk7b"
Jun 03 16:55:25.339898 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.339812    2563 status_manager.go:895] "Failed to get status for pod" podUID="6830b7dc-2626-4970-b185-577ace6ce195" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s" err="pods \"limitador-operator-controller-manager-85c4996f8c-qq25s\" is forbidden: User \"system:node:ip-10-0-143-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-30.ec2.internal' and this object"
Jun 03 16:55:25.353179 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.353156    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgpjw\" (UniqueName: \"kubernetes.io/projected/6830b7dc-2626-4970-b185-577ace6ce195-kube-api-access-tgpjw\") pod \"6830b7dc-2626-4970-b185-577ace6ce195\" (UID: \"6830b7dc-2626-4970-b185-577ace6ce195\") "
Jun 03 16:55:25.355222 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.355194    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6830b7dc-2626-4970-b185-577ace6ce195-kube-api-access-tgpjw" (OuterVolumeSpecName: "kube-api-access-tgpjw") pod "6830b7dc-2626-4970-b185-577ace6ce195" (UID: "6830b7dc-2626-4970-b185-577ace6ce195"). InnerVolumeSpecName "kube-api-access-tgpjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 16:55:25.442588 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.442555    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6rk7b"
Jun 03 16:55:25.454651 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.454627    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgpjw\" (UniqueName: \"kubernetes.io/projected/6830b7dc-2626-4970-b185-577ace6ce195-kube-api-access-tgpjw\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:55:25.624790 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:55:25.624758    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f09a5d_a009_4bbd_b20c_c2352c2457b0.slice/crio-0ded0d75b97361802689496703b2413c09c81ee803ec358cb0e8d5bbbe16a6c9 WatchSource:0}: Error finding container 0ded0d75b97361802689496703b2413c09c81ee803ec358cb0e8d5bbbe16a6c9: Status 404 returned error can't find the container with id 0ded0d75b97361802689496703b2413c09c81ee803ec358cb0e8d5bbbe16a6c9
Jun 03 16:55:25.627081 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.627057    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6rk7b"]
Jun 03 16:55:25.925713 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.925621    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6rk7b" event={"ID":"a1f09a5d-a009-4bbd-b20c-c2352c2457b0","Type":"ContainerStarted","Data":"86b906dfdee3b9be5b52801ccf4d5fa8b792f928d702df6c5116e053a8fff0d0"}
Jun 03 16:55:25.925713 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.925665    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6rk7b" event={"ID":"a1f09a5d-a009-4bbd-b20c-c2352c2457b0","Type":"ContainerStarted","Data":"0ded0d75b97361802689496703b2413c09c81ee803ec358cb0e8d5bbbe16a6c9"}
Jun 03 16:55:25.925713 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.925709    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6rk7b"
Jun 03 16:55:25.926799 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.926775    2563 generic.go:358] "Generic (PLEG): container finished" podID="6830b7dc-2626-4970-b185-577ace6ce195" containerID="f886fc88cf357c6665a19c057c1af1416173b374470b94ca8e4b4026b27efec5" exitCode=0
Jun 03 16:55:25.926918 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.926811    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s"
Jun 03 16:55:25.926918 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.926879    2563 scope.go:117] "RemoveContainer" containerID="f886fc88cf357c6665a19c057c1af1416173b374470b94ca8e4b4026b27efec5"
Jun 03 16:55:25.935654 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.935637    2563 scope.go:117] "RemoveContainer" containerID="f886fc88cf357c6665a19c057c1af1416173b374470b94ca8e4b4026b27efec5"
Jun 03 16:55:25.935922 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:55:25.935905    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f886fc88cf357c6665a19c057c1af1416173b374470b94ca8e4b4026b27efec5\": container with ID starting with f886fc88cf357c6665a19c057c1af1416173b374470b94ca8e4b4026b27efec5 not found: ID does not exist" containerID="f886fc88cf357c6665a19c057c1af1416173b374470b94ca8e4b4026b27efec5"
Jun 03 16:55:25.935984 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:25.935933    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f886fc88cf357c6665a19c057c1af1416173b374470b94ca8e4b4026b27efec5"} err="failed to get container status \"f886fc88cf357c6665a19c057c1af1416173b374470b94ca8e4b4026b27efec5\": rpc error: code = NotFound desc = could not find container \"f886fc88cf357c6665a19c057c1af1416173b374470b94ca8e4b4026b27efec5\": container with ID starting with f886fc88cf357c6665a19c057c1af1416173b374470b94ca8e4b4026b27efec5 not found: ID does not exist"
Jun 03 16:55:26.015665 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:26.015617    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6rk7b" podStartSLOduration=1.015603243 podStartE2EDuration="1.015603243s" podCreationTimestamp="2026-06-03 16:55:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:55:26.014785647 +0000 UTC m=+667.735677939" watchObservedRunningTime="2026-06-03 16:55:26.015603243 +0000 UTC m=+667.736495536"
Jun 03 16:55:26.024868 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:26.024840    2563 status_manager.go:895] "Failed to get status for pod" podUID="6830b7dc-2626-4970-b185-577ace6ce195" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s" err="pods \"limitador-operator-controller-manager-85c4996f8c-qq25s\" is forbidden: User \"system:node:ip-10-0-143-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-30.ec2.internal' and this object"
Jun 03 16:55:26.029279 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:26.029257    2563 status_manager.go:895] "Failed to get status for pod" podUID="6830b7dc-2626-4970-b185-577ace6ce195" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq25s" err="pods \"limitador-operator-controller-manager-85c4996f8c-qq25s\" is forbidden: User \"system:node:ip-10-0-143-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-30.ec2.internal' and this object"
Jun 03 16:55:26.732490 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:26.732456    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6830b7dc-2626-4970-b185-577ace6ce195" path="/var/lib/kubelet/pods/6830b7dc-2626-4970-b185-577ace6ce195/volumes"
Jun 03 16:55:36.933118 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:55:36.933088    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6rk7b"
Jun 03 16:56:04.466276 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:04.466184    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-bqnz9"]
Jun 03 16:56:04.470072 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:04.470049    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9"
Jun 03 16:56:04.475128 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:04.475106    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jun 03 16:56:04.475272 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:04.475146    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lz6p5\""
Jun 03 16:56:04.480134 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:04.480109    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-bqnz9"]
Jun 03 16:56:04.507804 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:04.507771    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j22m7\" (UniqueName: \"kubernetes.io/projected/c2be7410-76d2-44b3-9c25-24abf8af2f50-kube-api-access-j22m7\") pod \"limitador-limitador-7d549b5b-bqnz9\" (UID: \"c2be7410-76d2-44b3-9c25-24abf8af2f50\") " pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9"
Jun 03 16:56:04.508103 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:04.508079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c2be7410-76d2-44b3-9c25-24abf8af2f50-config-file\") pod \"limitador-limitador-7d549b5b-bqnz9\" (UID: \"c2be7410-76d2-44b3-9c25-24abf8af2f50\") " pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9"
Jun 03 16:56:04.556496 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:04.556461    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-bqnz9"]
Jun 03 16:56:04.608875 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:04.608846    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c2be7410-76d2-44b3-9c25-24abf8af2f50-config-file\") pod \"limitador-limitador-7d549b5b-bqnz9\" (UID: \"c2be7410-76d2-44b3-9c25-24abf8af2f50\") " pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9"
Jun 03 16:56:04.609055 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:04.608906    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j22m7\" (UniqueName: \"kubernetes.io/projected/c2be7410-76d2-44b3-9c25-24abf8af2f50-kube-api-access-j22m7\") pod \"limitador-limitador-7d549b5b-bqnz9\" (UID: \"c2be7410-76d2-44b3-9c25-24abf8af2f50\") " pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9"
Jun 03 16:56:04.609462 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:04.609439    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c2be7410-76d2-44b3-9c25-24abf8af2f50-config-file\") pod \"limitador-limitador-7d549b5b-bqnz9\" (UID: \"c2be7410-76d2-44b3-9c25-24abf8af2f50\") " pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9"
Jun 03 16:56:04.622374 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:04.622348    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j22m7\" (UniqueName: \"kubernetes.io/projected/c2be7410-76d2-44b3-9c25-24abf8af2f50-kube-api-access-j22m7\") pod \"limitador-limitador-7d549b5b-bqnz9\" (UID: \"c2be7410-76d2-44b3-9c25-24abf8af2f50\") " pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9"
Jun 03 16:56:04.781867 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:04.781828    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9"
Jun 03 16:56:04.938213 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:04.938186    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-bqnz9"]
Jun 03 16:56:04.940871 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:56:04.940841    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2be7410_76d2_44b3_9c25_24abf8af2f50.slice/crio-7eff8093cd1e5db9774749e6cd3f1838d3a58d40b240ce36110bf4ed496bb586 WatchSource:0}: Error finding container 7eff8093cd1e5db9774749e6cd3f1838d3a58d40b240ce36110bf4ed496bb586: Status 404 returned error can't find the container with id 7eff8093cd1e5db9774749e6cd3f1838d3a58d40b240ce36110bf4ed496bb586
Jun 03 16:56:05.079792 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:05.079688    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9" event={"ID":"c2be7410-76d2-44b3-9c25-24abf8af2f50","Type":"ContainerStarted","Data":"7eff8093cd1e5db9774749e6cd3f1838d3a58d40b240ce36110bf4ed496bb586"}
Jun 03 16:56:08.094146 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:08.094069    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9" event={"ID":"c2be7410-76d2-44b3-9c25-24abf8af2f50","Type":"ContainerStarted","Data":"07e807b9adf693c022c6916caf069a021c341917d18ab0820a51700bad92c3f3"}
Jun 03 16:56:08.094554 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:08.094185    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9"
Jun 03 16:56:08.115438 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:08.115392    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9" podStartSLOduration=1.525351808 podStartE2EDuration="4.115377604s" podCreationTimestamp="2026-06-03 16:56:04 +0000 UTC" firstStartedPulling="2026-06-03 16:56:04.943043314 +0000 UTC m=+706.663935585" lastFinishedPulling="2026-06-03 16:56:07.533069093 +0000 UTC m=+709.253961381" observedRunningTime="2026-06-03 16:56:08.113627043 +0000 UTC m=+709.834519336" watchObservedRunningTime="2026-06-03 16:56:08.115377604 +0000 UTC m=+709.836269949"
Jun 03 16:56:19.098433 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:19.098399    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9"
Jun 03 16:56:20.511088 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:20.511055    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-bqnz9"]
Jun 03 16:56:20.511508 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:20.511286    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9" podUID="c2be7410-76d2-44b3-9c25-24abf8af2f50" containerName="limitador" containerID="cri-o://07e807b9adf693c022c6916caf069a021c341917d18ab0820a51700bad92c3f3" gracePeriod=30
Jun 03 16:56:21.059106 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:21.059080    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9"
Jun 03 16:56:21.139229 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:21.139141    2563 generic.go:358] "Generic (PLEG): container finished" podID="c2be7410-76d2-44b3-9c25-24abf8af2f50" containerID="07e807b9adf693c022c6916caf069a021c341917d18ab0820a51700bad92c3f3" exitCode=0
Jun 03 16:56:21.139229 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:21.139201    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9"
Jun 03 16:56:21.139420 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:21.139233    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9" event={"ID":"c2be7410-76d2-44b3-9c25-24abf8af2f50","Type":"ContainerDied","Data":"07e807b9adf693c022c6916caf069a021c341917d18ab0820a51700bad92c3f3"}
Jun 03 16:56:21.139420 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:21.139271    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-bqnz9" event={"ID":"c2be7410-76d2-44b3-9c25-24abf8af2f50","Type":"ContainerDied","Data":"7eff8093cd1e5db9774749e6cd3f1838d3a58d40b240ce36110bf4ed496bb586"}
Jun 03 16:56:21.139420 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:21.139287    2563 scope.go:117] "RemoveContainer" containerID="07e807b9adf693c022c6916caf069a021c341917d18ab0820a51700bad92c3f3"
Jun 03 16:56:21.147392 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:21.147370    2563 scope.go:117] "RemoveContainer" containerID="07e807b9adf693c022c6916caf069a021c341917d18ab0820a51700bad92c3f3"
Jun 03 16:56:21.147636 ip-10-0-143-30 kubenswrapper[2563]: E0603 16:56:21.147620    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07e807b9adf693c022c6916caf069a021c341917d18ab0820a51700bad92c3f3\": container with ID starting with 07e807b9adf693c022c6916caf069a021c341917d18ab0820a51700bad92c3f3 not found: ID does not exist" containerID="07e807b9adf693c022c6916caf069a021c341917d18ab0820a51700bad92c3f3"
Jun 03 16:56:21.147680 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:21.147645    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07e807b9adf693c022c6916caf069a021c341917d18ab0820a51700bad92c3f3"} err="failed to get container status \"07e807b9adf693c022c6916caf069a021c341917d18ab0820a51700bad92c3f3\": rpc error: code = NotFound desc = could not find container \"07e807b9adf693c022c6916caf069a021c341917d18ab0820a51700bad92c3f3\": container with ID starting with 07e807b9adf693c022c6916caf069a021c341917d18ab0820a51700bad92c3f3 not found: ID does not exist"
Jun 03 16:56:21.159447 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:21.159426    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c2be7410-76d2-44b3-9c25-24abf8af2f50-config-file\") pod \"c2be7410-76d2-44b3-9c25-24abf8af2f50\" (UID: \"c2be7410-76d2-44b3-9c25-24abf8af2f50\") "
Jun 03 16:56:21.159557 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:21.159543    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j22m7\" (UniqueName: \"kubernetes.io/projected/c2be7410-76d2-44b3-9c25-24abf8af2f50-kube-api-access-j22m7\") pod \"c2be7410-76d2-44b3-9c25-24abf8af2f50\" (UID: \"c2be7410-76d2-44b3-9c25-24abf8af2f50\") "
Jun 03 16:56:21.159775 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:21.159755    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2be7410-76d2-44b3-9c25-24abf8af2f50-config-file" (OuterVolumeSpecName: "config-file") pod "c2be7410-76d2-44b3-9c25-24abf8af2f50" (UID: "c2be7410-76d2-44b3-9c25-24abf8af2f50"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 16:56:21.161530 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:21.161502    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2be7410-76d2-44b3-9c25-24abf8af2f50-kube-api-access-j22m7" (OuterVolumeSpecName: "kube-api-access-j22m7") pod "c2be7410-76d2-44b3-9c25-24abf8af2f50" (UID: "c2be7410-76d2-44b3-9c25-24abf8af2f50"). InnerVolumeSpecName "kube-api-access-j22m7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 16:56:21.260879 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:21.260840    2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c2be7410-76d2-44b3-9c25-24abf8af2f50-config-file\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:56:21.260879 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:21.260873    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j22m7\" (UniqueName: \"kubernetes.io/projected/c2be7410-76d2-44b3-9c25-24abf8af2f50-kube-api-access-j22m7\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\""
Jun 03 16:56:21.467484 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:21.467450    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-bqnz9"]
Jun 03 16:56:21.473033 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:21.473008    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-bqnz9"]
Jun 03 16:56:22.733313 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:22.733279    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2be7410-76d2-44b3-9c25-24abf8af2f50" path="/var/lib/kubelet/pods/c2be7410-76d2-44b3-9c25-24abf8af2f50/volumes"
Jun 03 16:56:25.690491 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:25.690455    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-wsdhm"]
Jun 03 16:56:25.690941 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:25.690913    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2be7410-76d2-44b3-9c25-24abf8af2f50" containerName="limitador"
Jun 03 16:56:25.690941 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:25.690935    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2be7410-76d2-44b3-9c25-24abf8af2f50" containerName="limitador"
Jun 03 16:56:25.691142 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:25.691044    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2be7410-76d2-44b3-9c25-24abf8af2f50" containerName="limitador"
Jun 03 16:56:25.695611 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:25.695590    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-wsdhm"
Jun 03 16:56:25.698626 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:25.698603    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jun 03 16:56:25.704388 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:25.704367    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-wsdhm"]
Jun 03 16:56:25.803027 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:25.802992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s7bq\" (UniqueName: \"kubernetes.io/projected/f986c7ce-816d-4ddf-a500-b8773ee4aaa6-kube-api-access-5s7bq\") pod \"postgres-68c4fbbd6f-wsdhm\" (UID: \"f986c7ce-816d-4ddf-a500-b8773ee4aaa6\") " pod="opendatahub/postgres-68c4fbbd6f-wsdhm"
Jun 03 16:56:25.803027 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:25.803032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f986c7ce-816d-4ddf-a500-b8773ee4aaa6-data\") pod \"postgres-68c4fbbd6f-wsdhm\" (UID: \"f986c7ce-816d-4ddf-a500-b8773ee4aaa6\") " pod="opendatahub/postgres-68c4fbbd6f-wsdhm"
Jun 03 16:56:25.904291 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:25.904257    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5s7bq\" (UniqueName: \"kubernetes.io/projected/f986c7ce-816d-4ddf-a500-b8773ee4aaa6-kube-api-access-5s7bq\") pod \"postgres-68c4fbbd6f-wsdhm\" (UID: \"f986c7ce-816d-4ddf-a500-b8773ee4aaa6\") " pod="opendatahub/postgres-68c4fbbd6f-wsdhm"
Jun 03 16:56:25.904291 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:25.904291    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f986c7ce-816d-4ddf-a500-b8773ee4aaa6-data\") pod \"postgres-68c4fbbd6f-wsdhm\" (UID: \"f986c7ce-816d-4ddf-a500-b8773ee4aaa6\") " pod="opendatahub/postgres-68c4fbbd6f-wsdhm"
Jun 03 16:56:25.904611 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:25.904593    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f986c7ce-816d-4ddf-a500-b8773ee4aaa6-data\") pod \"postgres-68c4fbbd6f-wsdhm\" (UID: \"f986c7ce-816d-4ddf-a500-b8773ee4aaa6\") " pod="opendatahub/postgres-68c4fbbd6f-wsdhm"
Jun 03 16:56:25.914634 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:25.914603    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s7bq\" (UniqueName: \"kubernetes.io/projected/f986c7ce-816d-4ddf-a500-b8773ee4aaa6-kube-api-access-5s7bq\") pod \"postgres-68c4fbbd6f-wsdhm\" (UID: \"f986c7ce-816d-4ddf-a500-b8773ee4aaa6\") " pod="opendatahub/postgres-68c4fbbd6f-wsdhm"
Jun 03 16:56:26.007461 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:26.007433    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-wsdhm"
Jun 03 16:56:26.136451 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:56:26.136410    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf986c7ce_816d_4ddf_a500_b8773ee4aaa6.slice/crio-8ce65e29fa2df3ffb308f3a9961feac010fb4dda8fdedda5fa849ee8408f235d WatchSource:0}: Error finding container 8ce65e29fa2df3ffb308f3a9961feac010fb4dda8fdedda5fa849ee8408f235d: Status 404 returned error can't find the container with id 8ce65e29fa2df3ffb308f3a9961feac010fb4dda8fdedda5fa849ee8408f235d
Jun 03 16:56:26.137286 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:26.137262    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-wsdhm"]
Jun 03 16:56:26.164058 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:26.164028    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-wsdhm" event={"ID":"f986c7ce-816d-4ddf-a500-b8773ee4aaa6","Type":"ContainerStarted","Data":"8ce65e29fa2df3ffb308f3a9961feac010fb4dda8fdedda5fa849ee8408f235d"}
Jun 03 16:56:30.181723 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:30.181685    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-wsdhm" event={"ID":"f986c7ce-816d-4ddf-a500-b8773ee4aaa6","Type":"ContainerStarted","Data":"bf0aa14b38438d8e151574fab64c32c6d7efcf532f177b5a44aa2f2a7bec97ae"}
Jun 03 16:56:30.182102 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:30.181777    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-wsdhm"
Jun 03 16:56:30.203639 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:30.203595    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-wsdhm" podStartSLOduration=1.9285241850000001 podStartE2EDuration="5.203580337s" podCreationTimestamp="2026-06-03 16:56:25 +0000 UTC" firstStartedPulling="2026-06-03 16:56:26.137621501 +0000 UTC m=+727.858513772" lastFinishedPulling="2026-06-03 16:56:29.412677651 +0000 UTC m=+731.133569924" observedRunningTime="2026-06-03 16:56:30.202221102 +0000 UTC m=+731.923113410" watchObservedRunningTime="2026-06-03 16:56:30.203580337 +0000 UTC m=+731.924472672"
Jun 03 16:56:36.215158 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:36.215128    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-wsdhm"
Jun 03 16:56:46.252412 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:46.252377    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-cr6j9"]
Jun 03 16:56:46.259673 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:46.259653    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-cr6j9"
Jun 03 16:56:46.262495 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:46.262476    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 03 16:56:46.263578 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:46.263562    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-x76fh\""
Jun 03 16:56:46.263673 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:46.263588    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 03 16:56:46.267181 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:46.266958    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-cr6j9"]
Jun 03 16:56:46.287952 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:46.287917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74l2h\" (UniqueName: \"kubernetes.io/projected/3afe80b9-51d4-4d7e-b523-05d188d5623b-kube-api-access-74l2h\") pod \"keycloak-operator-7864d68cbd-cr6j9\" (UID: \"3afe80b9-51d4-4d7e-b523-05d188d5623b\") " pod="keycloak-system/keycloak-operator-7864d68cbd-cr6j9"
Jun 03 16:56:46.388407 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:46.388375    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-74l2h\" (UniqueName: \"kubernetes.io/projected/3afe80b9-51d4-4d7e-b523-05d188d5623b-kube-api-access-74l2h\") pod \"keycloak-operator-7864d68cbd-cr6j9\" (UID: \"3afe80b9-51d4-4d7e-b523-05d188d5623b\") " pod="keycloak-system/keycloak-operator-7864d68cbd-cr6j9"
Jun 03 16:56:46.402438 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:46.402414    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74l2h\" (UniqueName: \"kubernetes.io/projected/3afe80b9-51d4-4d7e-b523-05d188d5623b-kube-api-access-74l2h\") pod \"keycloak-operator-7864d68cbd-cr6j9\" (UID: \"3afe80b9-51d4-4d7e-b523-05d188d5623b\") " pod="keycloak-system/keycloak-operator-7864d68cbd-cr6j9"
Jun 03 16:56:46.571131 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:46.571052    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-cr6j9"
Jun 03 16:56:46.699216 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:46.699189    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-cr6j9"]
Jun 03 16:56:46.701586 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:56:46.701552    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3afe80b9_51d4_4d7e_b523_05d188d5623b.slice/crio-b6f47810267970e30783843e5990397fc34a133bf903c18289c63a133343f76e WatchSource:0}: Error finding container b6f47810267970e30783843e5990397fc34a133bf903c18289c63a133343f76e: Status 404 returned error can't find the container with id b6f47810267970e30783843e5990397fc34a133bf903c18289c63a133343f76e
Jun 03 16:56:47.243903 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:47.243866    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-cr6j9" event={"ID":"3afe80b9-51d4-4d7e-b523-05d188d5623b","Type":"ContainerStarted","Data":"b6f47810267970e30783843e5990397fc34a133bf903c18289c63a133343f76e"}
Jun 03 16:56:53.269560 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:53.269523    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-cr6j9" event={"ID":"3afe80b9-51d4-4d7e-b523-05d188d5623b","Type":"ContainerStarted","Data":"1237e220b91099f7381a21a75503926ed63584d919096a9cec246c55b3f5a031"}
Jun 03 16:56:53.288862 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:56:53.288814    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-cr6j9" podStartSLOduration=0.845235912 podStartE2EDuration="7.288800779s" podCreationTimestamp="2026-06-03 16:56:46 +0000 UTC" firstStartedPulling="2026-06-03 16:56:46.703107322 +0000 UTC m=+748.423999592" lastFinishedPulling="2026-06-03 16:56:53.146672183 +0000 UTC m=+754.867564459" observedRunningTime="2026-06-03 16:56:53.286449866 +0000 UTC m=+755.007342189" watchObservedRunningTime="2026-06-03 16:56:53.288800779 +0000 UTC m=+755.009693071"
Jun 03 16:59:14.548385 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.548297    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"]
Jun 03 16:59:14.551929 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.551910    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.555970 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.555949    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n6zvg\""
Jun 03 16:59:14.556093 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.556007    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 03 16:59:14.556093 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.556054    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 03 16:59:14.556212 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.556117    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jun 03 16:59:14.564301 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.564276    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"]
Jun 03 16:59:14.610771 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.610717    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a94434f-5bc7-467f-b293-c2372761dd0c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.610917 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.610769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7a94434f-5bc7-467f-b293-c2372761dd0c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.610917 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.610878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a94434f-5bc7-467f-b293-c2372761dd0c-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.611014 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.610919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a94434f-5bc7-467f-b293-c2372761dd0c-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.611058 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.611031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r77z\" (UniqueName: \"kubernetes.io/projected/7a94434f-5bc7-467f-b293-c2372761dd0c-kube-api-access-4r77z\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.611094 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.611082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a94434f-5bc7-467f-b293-c2372761dd0c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.712582 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.712548    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a94434f-5bc7-467f-b293-c2372761dd0c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.712759 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.712591    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7a94434f-5bc7-467f-b293-c2372761dd0c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.712805 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.712722    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a94434f-5bc7-467f-b293-c2372761dd0c-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.712805 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.712793    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a94434f-5bc7-467f-b293-c2372761dd0c-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.713054 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.712880    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4r77z\" (UniqueName: \"kubernetes.io/projected/7a94434f-5bc7-467f-b293-c2372761dd0c-kube-api-access-4r77z\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.713054 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.712936    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a94434f-5bc7-467f-b293-c2372761dd0c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.713054 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.712961    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7a94434f-5bc7-467f-b293-c2372761dd0c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.713054 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.713024    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a94434f-5bc7-467f-b293-c2372761dd0c-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.713269 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.713251    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a94434f-5bc7-467f-b293-c2372761dd0c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.714965 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.714945    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a94434f-5bc7-467f-b293-c2372761dd0c-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.715240 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.715221    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a94434f-5bc7-467f-b293-c2372761dd0c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.721271 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.721248    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r77z\" (UniqueName: \"kubernetes.io/projected/7a94434f-5bc7-467f-b293-c2372761dd0c-kube-api-access-4r77z\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst\" (UID: \"7a94434f-5bc7-467f-b293-c2372761dd0c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:14.880139 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:14.880047    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"
Jun 03 16:59:15.014566 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:15.014542    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst"]
Jun 03 16:59:15.016514 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:59:15.016476    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a94434f_5bc7_467f_b293_c2372761dd0c.slice/crio-629ccc9ac8b92f9576e0124c85626c967c7f2358a0b03216dca630ce3c734308 WatchSource:0}: Error finding container 629ccc9ac8b92f9576e0124c85626c967c7f2358a0b03216dca630ce3c734308: Status 404 returned error can't find the container with id 629ccc9ac8b92f9576e0124c85626c967c7f2358a0b03216dca630ce3c734308
Jun 03 16:59:15.018297 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:15.018281    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 16:59:15.781132 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:15.781081    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst" event={"ID":"7a94434f-5bc7-467f-b293-c2372761dd0c","Type":"ContainerStarted","Data":"629ccc9ac8b92f9576e0124c85626c967c7f2358a0b03216dca630ce3c734308"}
Jun 03 16:59:18.687063 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:18.687034    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-phgpp_ccbe3e7a-fea1-419f-af7f-bc26eaa0089e/console-operator/1.log"
Jun 03 16:59:18.687502 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:18.687034    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-phgpp_ccbe3e7a-fea1-419f-af7f-bc26eaa0089e/console-operator/1.log"
Jun 03 16:59:18.795461 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:18.795376    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst" event={"ID":"7a94434f-5bc7-467f-b293-c2372761dd0c","Type":"ContainerStarted","Data":"27262b20c47de01ccb5fe5341d59b5e282f914a3f15ff0bb98a978bebfe529cf"}
Jun 03 16:59:25.244290 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.244258    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"]
Jun 03 16:59:25.249065 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.249049    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.252092 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.252073    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jun 03 16:59:25.260792 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.260768    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"]
Jun 03 16:59:25.310635 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.310612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.310783 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.310639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tchz2\" (UniqueName: \"kubernetes.io/projected/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-kube-api-access-tchz2\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.310783 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.310666    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.310783 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.310720    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.310895 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.310814    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.310895 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.310840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.411691 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.411655    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.411691 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.411691    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tchz2\" (UniqueName: \"kubernetes.io/projected/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-kube-api-access-tchz2\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.411940 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.411712    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.411940 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.411773    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.411940 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.411823    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.411940 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.411847    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.412232 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.412200    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.412353 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.412231    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.412353 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.412270    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.413924 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.413901    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.414109 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.414090    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.425891 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.425867    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tchz2\" (UniqueName: \"kubernetes.io/projected/eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2-kube-api-access-tchz2\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m\" (UID: \"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.560133 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.560057    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 16:59:25.697504 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.697479    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"]
Jun 03 16:59:25.699724 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:59:25.699687    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeacc5aa3_613d_4fd8_9df1_3ce2e32d94a2.slice/crio-787888de100b010c8e428ce83cf8857160aca5b7a7da536eca19bf254c250e83 WatchSource:0}: Error finding container 787888de100b010c8e428ce83cf8857160aca5b7a7da536eca19bf254c250e83: Status 404 returned error can't find the container with id 787888de100b010c8e428ce83cf8857160aca5b7a7da536eca19bf254c250e83
Jun 03 16:59:25.821976 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.821889    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m" event={"ID":"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2","Type":"ContainerStarted","Data":"14fe6e717ade8cdb96abb27f017a5d9329d6f6bf4ee97a674b2d7605df1711c4"}
Jun 03 16:59:25.821976 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:25.821928    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m" event={"ID":"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2","Type":"ContainerStarted","Data":"787888de100b010c8e428ce83cf8857160aca5b7a7da536eca19bf254c250e83"}
Jun 03 16:59:34.128984 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.128951    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"]
Jun 03 16:59:34.135574 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.135553    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.138493 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.138470    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jun 03 16:59:34.143822 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.143797    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"]
Jun 03 16:59:34.294804 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.294773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.294804 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.294807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.295017 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.294842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6lpn\" (UniqueName: \"kubernetes.io/projected/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-kube-api-access-z6lpn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.295017 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.294971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.295086 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.295031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.295086 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.295071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.396221 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.396141    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.396221 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.396177    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.396221 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.396210    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6lpn\" (UniqueName: \"kubernetes.io/projected/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-kube-api-access-z6lpn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.396497 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.396240    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.396497 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.396267    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.396497 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.396290    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.396656 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.396590    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.396707 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.396650    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.396707 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.396677    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.398630 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.398596    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.398823 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.398808    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.405884 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.405859    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6lpn\" (UniqueName: \"kubernetes.io/projected/e9875d30-ac9c-4aa3-b54b-38bbcfa334cb-kube-api-access-z6lpn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8\" (UID: \"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.449016 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.448993    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 16:59:34.584663 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.584632    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"]
Jun 03 16:59:34.587358 ip-10-0-143-30 kubenswrapper[2563]: W0603 16:59:34.587325    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9875d30_ac9c_4aa3_b54b_38bbcfa334cb.slice/crio-14440c50c7e3edd2874ae8407475011133deaa799c519f2c6ae4cd4115045de5 WatchSource:0}: Error finding container 14440c50c7e3edd2874ae8407475011133deaa799c519f2c6ae4cd4115045de5: Status 404 returned error can't find the container with id 14440c50c7e3edd2874ae8407475011133deaa799c519f2c6ae4cd4115045de5
Jun 03 16:59:34.855035 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.854999    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8" event={"ID":"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb","Type":"ContainerStarted","Data":"9abd86b725f3688e445e4d49c40691ef0f7d261edeb750d54cfa678aca5f3946"}
Jun 03 16:59:34.855035 ip-10-0-143-30 kubenswrapper[2563]: I0603 16:59:34.855039    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8" event={"ID":"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb","Type":"ContainerStarted","Data":"14440c50c7e3edd2874ae8407475011133deaa799c519f2c6ae4cd4115045de5"}
Jun 03 17:00:23.027913 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:00:23.027884    2563 generic.go:358] "Generic (PLEG): container finished" podID="eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2" containerID="14fe6e717ade8cdb96abb27f017a5d9329d6f6bf4ee97a674b2d7605df1711c4" exitCode=0
Jun 03 17:00:23.028297 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:00:23.027964    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m" event={"ID":"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2","Type":"ContainerDied","Data":"14fe6e717ade8cdb96abb27f017a5d9329d6f6bf4ee97a674b2d7605df1711c4"}
Jun 03 17:00:34.067896 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:00:34.067863    2563 generic.go:358] "Generic (PLEG): container finished" podID="e9875d30-ac9c-4aa3-b54b-38bbcfa334cb" containerID="9abd86b725f3688e445e4d49c40691ef0f7d261edeb750d54cfa678aca5f3946" exitCode=0
Jun 03 17:00:34.068306 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:00:34.067939    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8" event={"ID":"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb","Type":"ContainerDied","Data":"9abd86b725f3688e445e4d49c40691ef0f7d261edeb750d54cfa678aca5f3946"}
Jun 03 17:00:40.095985 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:00:40.095943    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m" event={"ID":"eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2","Type":"ContainerStarted","Data":"8b56391bbe554fdf9d0111c8ce9c0556b577b206e7b0d015b963580873755cc3"}
Jun 03 17:00:45.561028 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:00:45.560989    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 17:00:45.561028 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:00:45.561030    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 17:00:45.573969 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:00:45.573948    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 17:00:45.597774 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:00:45.597714    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m" podStartSLOduration=63.994057911 podStartE2EDuration="1m20.597701582s" podCreationTimestamp="2026-06-03 16:59:25 +0000 UTC" firstStartedPulling="2026-06-03 17:00:23.028620528 +0000 UTC m=+964.749512799" lastFinishedPulling="2026-06-03 17:00:39.632264199 +0000 UTC m=+981.353156470" observedRunningTime="2026-06-03 17:00:40.127076695 +0000 UTC m=+981.847968988" watchObservedRunningTime="2026-06-03 17:00:45.597701582 +0000 UTC m=+987.318593875"
Jun 03 17:00:46.129725 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:00:46.129699    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m"
Jun 03 17:01:11.217198 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:01:11.217159    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8" event={"ID":"e9875d30-ac9c-4aa3-b54b-38bbcfa334cb","Type":"ContainerStarted","Data":"4ea3d170a34d3d36ecaefae0c7688f82501a598a2e8afa9d737c5d00c96de4d5"}
Jun 03 17:01:11.237680 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:01:11.237640    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8" podStartSLOduration=60.928036634 podStartE2EDuration="1m37.23762761s" podCreationTimestamp="2026-06-03 16:59:34 +0000 UTC" firstStartedPulling="2026-06-03 17:00:34.068561712 +0000 UTC m=+975.789453984" lastFinishedPulling="2026-06-03 17:01:10.378152686 +0000 UTC m=+1012.099044960" observedRunningTime="2026-06-03 17:01:11.236097735 +0000 UTC m=+1012.956990029" watchObservedRunningTime="2026-06-03 17:01:11.23762761 +0000 UTC m=+1012.958519902"
Jun 03 17:01:14.449497 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:01:14.449454    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 17:01:14.450005 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:01:14.449603    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 17:01:14.462404 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:01:14.462379    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 17:01:15.242107 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:01:15.242077    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8"
Jun 03 17:04:18.716375 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:04:18.716347    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-phgpp_ccbe3e7a-fea1-419f-af7f-bc26eaa0089e/console-operator/1.log"
Jun 03 17:04:18.718959 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:04:18.718926    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-phgpp_ccbe3e7a-fea1-419f-af7f-bc26eaa0089e/console-operator/1.log"
Jun 03 17:06:12.260067 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:12.260039    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-78b89f755d-vkffx_069a2daf-b185-4687-a412-2864b36cb3e3/nginx/0.log"
Jun 03 17:06:12.367684 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:12.367652    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-mmblp_85afd501-f9bc-473f-99f7-86f909c964a7/manager/0.log"
Jun 03 17:06:12.488031 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:12.488002    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-cncvf_cb2f4d65-69b1-4ad5-add1-a2c718695855/manager/0.log"
Jun 03 17:06:12.929927 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:12.929904    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-npkvj_ed50f760-5d06-47a0-915a-9d3c61b8c45d/server/0.log"
Jun 03 17:06:13.051058 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:13.051027    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-nmxdl_e35c5294-0427-4667-932e-24f0d19b6c3e/manager/0.log"
Jun 03 17:06:13.299307 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:13.299281    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d99597487-5sph9_651687c5-fa6d-49ac-a796-4d88b721774f/manager/0.log"
Jun 03 17:06:13.308739 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:13.308703    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d99597487-5sph9_651687c5-fa6d-49ac-a796-4d88b721774f/copy-manifests/0.log"
Jun 03 17:06:13.543878 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:13.543850    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-wsdhm_f986c7ce-816d-4ddf-a500-b8773ee4aaa6/postgres/0.log"
Jun 03 17:06:15.586821 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:15.586787    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-6rk7b_a1f09a5d-a009-4bbd-b20c-c2352c2457b0/manager/0.log"
Jun 03 17:06:16.034568 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:16.034537    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-4fssq_d0dc1df4-577e-44fe-a875-fbc877cbca3e/discovery/0.log"
Jun 03 17:06:16.136772 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:16.136693    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8f98dcdbc-v74lm_6634b3af-5940-49de-a246-9a225b62688e/kube-auth-proxy/0.log"
Jun 03 17:06:16.560951 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:16.560923    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7dc7c5c64f-c4q48_9400fa0a-0dbe-4f6b-8e3b-09502bee5575/router/0.log"
Jun 03 17:06:16.909766 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:16.909670    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-fdxst_7a94434f-5bc7-467f-b293-c2372761dd0c/storage-initializer/0.log"
Jun 03 17:06:17.143970 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:17.143941    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m_eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2/storage-initializer/0.log"
Jun 03 17:06:17.150867 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:17.150841    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-lqk9m_eacc5aa3-613d-4fd8-9df1-3ce2e32d94a2/main/0.log"
Jun 03 17:06:17.256003 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:17.255961    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8_e9875d30-ac9c-4aa3-b54b-38bbcfa334cb/storage-initializer/0.log"
Jun 03 17:06:17.261715 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:17.261692    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrbs8_e9875d30-ac9c-4aa3-b54b-38bbcfa334cb/main/0.log"
Jun 03 17:06:24.349074 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:24.349041    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9zqj5_f72070fc-cab4-4b99-9c05-bc09f0bfbcb5/global-pull-secret-syncer/0.log"
Jun 03 17:06:24.486747 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:24.486708    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ccwjz_8f3a7bc8-0c54-454a-a8fd-bb8060f466ae/konnectivity-agent/0.log"
Jun 03 17:06:24.614919 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:24.614845    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-30.ec2.internal_ac4c8c9bbafe1b4ee435b19e9ed813ee/haproxy/0.log"
Jun 03 17:06:29.025724 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:29.025646    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-6rk7b_a1f09a5d-a009-4bbd-b20c-c2352c2457b0/manager/0.log"
Jun 03 17:06:30.555973 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:30.555950    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96b615bf-4bf8-4f63-9e64-1c59349c9535/alertmanager/0.log"
Jun 03 17:06:30.577744 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:30.577709    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96b615bf-4bf8-4f63-9e64-1c59349c9535/config-reloader/0.log"
Jun 03 17:06:30.607664 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:30.607645    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96b615bf-4bf8-4f63-9e64-1c59349c9535/kube-rbac-proxy-web/0.log"
Jun 03 17:06:30.630071 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:30.630052    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96b615bf-4bf8-4f63-9e64-1c59349c9535/kube-rbac-proxy/0.log"
Jun 03 17:06:30.652907 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:30.652880    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96b615bf-4bf8-4f63-9e64-1c59349c9535/kube-rbac-proxy-metric/0.log"
Jun 03 17:06:30.674475 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:30.674456    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96b615bf-4bf8-4f63-9e64-1c59349c9535/prom-label-proxy/0.log"
Jun 03 17:06:30.697949 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:30.697934    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96b615bf-4bf8-4f63-9e64-1c59349c9535/init-config-reloader/0.log"
Jun 03 17:06:30.866702 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:30.866679    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-9689v_ed2a871e-c9cb-4e1e-bde0-6a527cd1e828/monitoring-plugin/0.log"
Jun 03 17:06:30.900765 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:30.900720    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-88zg4_b940afbe-dad6-4602-a1d7-288633b3990b/node-exporter/0.log"
Jun 03 17:06:30.921801 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:30.921782    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-88zg4_b940afbe-dad6-4602-a1d7-288633b3990b/kube-rbac-proxy/0.log"
Jun 03 17:06:30.943300 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:30.943282    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-88zg4_b940afbe-dad6-4602-a1d7-288633b3990b/init-textfile/0.log"
Jun 03 17:06:31.149907 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:31.149831    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-jxbpj_98072612-04e8-4e0f-8eb7-679ccd36fca6/kube-rbac-proxy-main/0.log"
Jun 03 17:06:31.169247 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:31.169221    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-jxbpj_98072612-04e8-4e0f-8eb7-679ccd36fca6/kube-rbac-proxy-self/0.log"
Jun 03 17:06:31.192705 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:31.192684    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-jxbpj_98072612-04e8-4e0f-8eb7-679ccd36fca6/openshift-state-metrics/0.log"
Jun 03 17:06:31.235047 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:31.235025    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc073823-0aff-43d5-8d38-1e81c7d5495f/prometheus/0.log"
Jun 03 17:06:31.256657 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:31.256636    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc073823-0aff-43d5-8d38-1e81c7d5495f/config-reloader/0.log"
Jun 03 17:06:31.278559 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:31.278530    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc073823-0aff-43d5-8d38-1e81c7d5495f/thanos-sidecar/0.log"
Jun 03 17:06:31.304319 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:31.304297    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc073823-0aff-43d5-8d38-1e81c7d5495f/kube-rbac-proxy-web/0.log"
Jun 03 17:06:31.329568 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:31.329551    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc073823-0aff-43d5-8d38-1e81c7d5495f/kube-rbac-proxy/0.log"
Jun 03 17:06:31.350901 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:31.350884    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc073823-0aff-43d5-8d38-1e81c7d5495f/kube-rbac-proxy-thanos/0.log"
Jun 03 17:06:31.371087 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:31.371069    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc073823-0aff-43d5-8d38-1e81c7d5495f/init-config-reloader/0.log"
Jun 03 17:06:31.398513 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:31.398493    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-ghm9n_ae636824-66fd-4ece-aa9e-03b3f1ac4b48/prometheus-operator/0.log"
Jun 03 17:06:31.420266 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:31.420215    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-ghm9n_ae636824-66fd-4ece-aa9e-03b3f1ac4b48/kube-rbac-proxy/0.log"
Jun 03 17:06:31.444385 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:31.444365    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-jrw2h_e9a08578-6583-4bfc-b50c-1608905e8f39/prometheus-operator-admission-webhook/0.log"
Jun 03 17:06:31.470251 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:31.470232    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c496db4b5-x9crx_2dabe3e8-bbb4-439f-8e33-e6ca218f610d/telemeter-client/0.log"
Jun 03 17:06:31.491645 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:31.491623    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c496db4b5-x9crx_2dabe3e8-bbb4-439f-8e33-e6ca218f610d/reload/0.log"
Jun 03 17:06:31.520615 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:31.520595    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c496db4b5-x9crx_2dabe3e8-bbb4-439f-8e33-e6ca218f610d/kube-rbac-proxy/0.log"
Jun 03 17:06:33.441836 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.441803    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-phgpp_ccbe3e7a-fea1-419f-af7f-bc26eaa0089e/console-operator/1.log"
Jun 03 17:06:33.446607 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.446585    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-phgpp_ccbe3e7a-fea1-419f-af7f-bc26eaa0089e/console-operator/2.log"
Jun 03 17:06:33.624694 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.624664    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"]
Jun 03 17:06:33.628601 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.628586    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:33.631503 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.631481    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6jxqt\"/\"openshift-service-ca.crt\""
Jun 03 17:06:33.631633 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.631525    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6jxqt\"/\"kube-root-ca.crt\""
Jun 03 17:06:33.633261 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.633243    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6jxqt\"/\"default-dockercfg-t9nhb\""
Jun 03 17:06:33.641622 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.641601    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"]
Jun 03 17:06:33.707818 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.707754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zds79\" (UniqueName: \"kubernetes.io/projected/c544374a-9675-46c6-b26c-a94f01f3307e-kube-api-access-zds79\") pod \"perf-node-gather-daemonset-8s8hv\" (UID: \"c544374a-9675-46c6-b26c-a94f01f3307e\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:33.707818 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.707791    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c544374a-9675-46c6-b26c-a94f01f3307e-lib-modules\") pod \"perf-node-gather-daemonset-8s8hv\" (UID: \"c544374a-9675-46c6-b26c-a94f01f3307e\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:33.707818 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.707812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c544374a-9675-46c6-b26c-a94f01f3307e-sys\") pod \"perf-node-gather-daemonset-8s8hv\" (UID: \"c544374a-9675-46c6-b26c-a94f01f3307e\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:33.708033 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.707914    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c544374a-9675-46c6-b26c-a94f01f3307e-podres\") pod \"perf-node-gather-daemonset-8s8hv\" (UID: \"c544374a-9675-46c6-b26c-a94f01f3307e\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:33.708033 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.708017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c544374a-9675-46c6-b26c-a94f01f3307e-proc\") pod \"perf-node-gather-daemonset-8s8hv\" (UID: \"c544374a-9675-46c6-b26c-a94f01f3307e\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:33.808596 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.808568    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c544374a-9675-46c6-b26c-a94f01f3307e-proc\") pod \"perf-node-gather-daemonset-8s8hv\" (UID: \"c544374a-9675-46c6-b26c-a94f01f3307e\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:33.808760 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.808622    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zds79\" (UniqueName: \"kubernetes.io/projected/c544374a-9675-46c6-b26c-a94f01f3307e-kube-api-access-zds79\") pod \"perf-node-gather-daemonset-8s8hv\" (UID: \"c544374a-9675-46c6-b26c-a94f01f3307e\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:33.808760 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.808646    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c544374a-9675-46c6-b26c-a94f01f3307e-lib-modules\") pod \"perf-node-gather-daemonset-8s8hv\" (UID: \"c544374a-9675-46c6-b26c-a94f01f3307e\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:33.808760 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.808676    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c544374a-9675-46c6-b26c-a94f01f3307e-sys\") pod \"perf-node-gather-daemonset-8s8hv\" (UID: \"c544374a-9675-46c6-b26c-a94f01f3307e\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:33.808760 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.808697    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c544374a-9675-46c6-b26c-a94f01f3307e-proc\") pod \"perf-node-gather-daemonset-8s8hv\" (UID: \"c544374a-9675-46c6-b26c-a94f01f3307e\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:33.808760 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.808705    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c544374a-9675-46c6-b26c-a94f01f3307e-podres\") pod \"perf-node-gather-daemonset-8s8hv\" (UID: \"c544374a-9675-46c6-b26c-a94f01f3307e\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:33.809035 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.808777    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c544374a-9675-46c6-b26c-a94f01f3307e-sys\") pod \"perf-node-gather-daemonset-8s8hv\" (UID: \"c544374a-9675-46c6-b26c-a94f01f3307e\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:33.809035 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.808854    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c544374a-9675-46c6-b26c-a94f01f3307e-lib-modules\") pod \"perf-node-gather-daemonset-8s8hv\" (UID: \"c544374a-9675-46c6-b26c-a94f01f3307e\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:33.809035 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.808916    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c544374a-9675-46c6-b26c-a94f01f3307e-podres\") pod \"perf-node-gather-daemonset-8s8hv\" (UID: \"c544374a-9675-46c6-b26c-a94f01f3307e\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:33.816938 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.816918    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zds79\" (UniqueName: \"kubernetes.io/projected/c544374a-9675-46c6-b26c-a94f01f3307e-kube-api-access-zds79\") pod \"perf-node-gather-daemonset-8s8hv\" (UID: \"c544374a-9675-46c6-b26c-a94f01f3307e\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:33.939387 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:33.939361    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:34.040440 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:34.040415    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-9brzt_d88b2bfd-2f3c-4a8b-a72e-3a4a54fa4459/download-server/0.log"
Jun 03 17:06:34.075129 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:34.075107    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"]
Jun 03 17:06:34.078040 ip-10-0-143-30 kubenswrapper[2563]: W0603 17:06:34.078008    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc544374a_9675_46c6_b26c_a94f01f3307e.slice/crio-7df29e4ba5c3009b093de056ec5eb4bd14ad73695526d9bcd03306454efd5c6a WatchSource:0}: Error finding container 7df29e4ba5c3009b093de056ec5eb4bd14ad73695526d9bcd03306454efd5c6a: Status 404 returned error can't find the container with id 7df29e4ba5c3009b093de056ec5eb4bd14ad73695526d9bcd03306454efd5c6a
Jun 03 17:06:34.079835 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:34.079817    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 17:06:34.414535 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:34.414441    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv" event={"ID":"c544374a-9675-46c6-b26c-a94f01f3307e","Type":"ContainerStarted","Data":"864a562164dcfd2e14cadbc2be097f1b9b779971e84488f8a7a6415a173d5f41"}
Jun 03 17:06:34.414535 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:34.414480    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv" event={"ID":"c544374a-9675-46c6-b26c-a94f01f3307e","Type":"ContainerStarted","Data":"7df29e4ba5c3009b093de056ec5eb4bd14ad73695526d9bcd03306454efd5c6a"}
Jun 03 17:06:34.414796 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:34.414545    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:34.433008 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:34.432953    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv" podStartSLOduration=1.43293934 podStartE2EDuration="1.43293934s" podCreationTimestamp="2026-06-03 17:06:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 17:06:34.430323323 +0000 UTC m=+1336.151215628" watchObservedRunningTime="2026-06-03 17:06:34.43293934 +0000 UTC m=+1336.153831633"
Jun 03 17:06:34.603112 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:34.603081    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-886d6_f4b0a205-48a4-43d3-886a-f2a0c1a4a88b/volume-data-source-validator/0.log"
Jun 03 17:06:35.451976 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:35.451949    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qd8tz_95cf9da9-dd78-4443-95a9-90e29b37c406/dns/0.log"
Jun 03 17:06:35.477878 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:35.477848    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qd8tz_95cf9da9-dd78-4443-95a9-90e29b37c406/kube-rbac-proxy/0.log"
Jun 03 17:06:35.542584 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:35.542561    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lpn2p_ca235535-73f8-4549-bf3c-b7a3491f2b90/dns-node-resolver/0.log"
Jun 03 17:06:36.152571 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:36.152539    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k5dwb_794e1bba-9e19-4e85-af4a-d0cf61fba88f/node-ca/0.log"
Jun 03 17:06:37.125054 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:37.125022    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-4fssq_d0dc1df4-577e-44fe-a875-fbc877cbca3e/discovery/0.log"
Jun 03 17:06:37.145721 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:37.145695    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8f98dcdbc-v74lm_6634b3af-5940-49de-a246-9a225b62688e/kube-auth-proxy/0.log"
Jun 03 17:06:37.243744 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:37.243708    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7dc7c5c64f-c4q48_9400fa0a-0dbe-4f6b-8e3b-09502bee5575/router/0.log"
Jun 03 17:06:37.790055 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:37.790025    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nvvnn_fd962829-ced6-4a41-9570-0dc87e34f793/serve-healthcheck-canary/0.log"
Jun 03 17:06:38.421379 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:38.421349    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9tlxs_5862791a-7fc1-49e2-bced-38ee4d3a9f70/kube-rbac-proxy/0.log"
Jun 03 17:06:38.444346 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:38.444318    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9tlxs_5862791a-7fc1-49e2-bced-38ee4d3a9f70/exporter/0.log"
Jun 03 17:06:38.469639 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:38.469612    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9tlxs_5862791a-7fc1-49e2-bced-38ee4d3a9f70/extractor/0.log"
Jun 03 17:06:40.429078 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:40.429045    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-8s8hv"
Jun 03 17:06:40.719145 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:40.719059    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-78b89f755d-vkffx_069a2daf-b185-4687-a412-2864b36cb3e3/nginx/0.log"
Jun 03 17:06:40.753714 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:40.753686    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-mmblp_85afd501-f9bc-473f-99f7-86f909c964a7/manager/0.log"
Jun 03 17:06:40.788261 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:40.788230    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-cncvf_cb2f4d65-69b1-4ad5-add1-a2c718695855/manager/0.log"
Jun 03 17:06:40.886897 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:40.886866    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-npkvj_ed50f760-5d06-47a0-915a-9d3c61b8c45d/server/0.log"
Jun 03 17:06:40.931588 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:40.931559    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-nmxdl_e35c5294-0427-4667-932e-24f0d19b6c3e/manager/0.log"
Jun 03 17:06:41.050181 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:41.050154    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d99597487-5sph9_651687c5-fa6d-49ac-a796-4d88b721774f/manager/0.log"
Jun 03 17:06:41.071100 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:41.071079    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d99597487-5sph9_651687c5-fa6d-49ac-a796-4d88b721774f/copy-manifests/0.log"
Jun 03 17:06:41.146933 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:41.146896    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-wsdhm_f986c7ce-816d-4ddf-a500-b8773ee4aaa6/postgres/0.log"
Jun 03 17:06:42.729280 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:42.729252    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-l7cnl_9ab8a503-e854-4b91-9f5c-98546b7deefd/openshift-lws-operator/0.log"
Jun 03 17:06:47.895427 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:47.895395    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-g2p4g_ea4d81a9-e648-4078-8f68-4a46b4fad8df/migrator/0.log"
Jun 03 17:06:47.927670 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:47.927645    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-g2p4g_ea4d81a9-e648-4078-8f68-4a46b4fad8df/graceful-termination/0.log"
Jun 03 17:06:49.680745 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:49.680709    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjspd_d19049a5-6916-4d4f-8a64-2f9968f534b3/kube-multus-additional-cni-plugins/0.log"
Jun 03 17:06:49.704621 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:49.704588    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjspd_d19049a5-6916-4d4f-8a64-2f9968f534b3/egress-router-binary-copy/0.log"
Jun 03 17:06:49.725484 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:49.725459    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjspd_d19049a5-6916-4d4f-8a64-2f9968f534b3/cni-plugins/0.log"
Jun 03 17:06:49.745295 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:49.745266    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjspd_d19049a5-6916-4d4f-8a64-2f9968f534b3/bond-cni-plugin/0.log"
Jun 03 17:06:49.777535 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:49.777471    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjspd_d19049a5-6916-4d4f-8a64-2f9968f534b3/routeoverride-cni/0.log"
Jun 03 17:06:49.800469 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:49.800440    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjspd_d19049a5-6916-4d4f-8a64-2f9968f534b3/whereabouts-cni-bincopy/0.log"
Jun 03 17:06:49.821538 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:49.821513    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjspd_d19049a5-6916-4d4f-8a64-2f9968f534b3/whereabouts-cni/0.log"
Jun 03 17:06:50.026855 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:50.026825    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k2bzr_79b323cd-77ab-489a-b0d2-8e2857600a35/kube-multus/0.log"
Jun 03 17:06:50.049543 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:50.049479    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-82l8r_3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff/network-metrics-daemon/0.log"
Jun 03 17:06:50.070781 ip-10-0-143-30 kubenswrapper[2563]: I0603 17:06:50.070760    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-82l8r_3505bde7-c7dc-4639-bc8b-1f6df5bbe8ff/kube-rbac-proxy/0.log"