Jun 15 05:47:27.419750 ip-10-0-132-4 systemd[1]: Starting Kubernetes Kubelet... Jun 15 05:47:27.875824 ip-10-0-132-4 kubenswrapper[2586]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 05:47:27.875824 ip-10-0-132-4 kubenswrapper[2586]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 15 05:47:27.875824 ip-10-0-132-4 kubenswrapper[2586]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 05:47:27.875824 ip-10-0-132-4 kubenswrapper[2586]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 15 05:47:27.875824 ip-10-0-132-4 kubenswrapper[2586]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 05:47:27.876866 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.876775 2586 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 15 05:47:27.882242 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882224 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 05:47:27.882242 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882241 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882246 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882250 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882254 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882257 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882260 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882263 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882265 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882268 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882271 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882273 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882276 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882278 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882281 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882283 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882292 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882295 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882297 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882300 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882302 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 05:47:27.882326 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882305 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882307 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882310 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882312 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882315 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882317 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882320 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882322 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882325 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882327 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882330 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882333 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882336 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882339 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882342 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882344 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882347 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882350 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882353 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 05:47:27.882816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882355 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882357 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882360 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882363 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882365 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882369 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882371 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882373 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882376 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882378 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882380 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882383 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882385 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882387 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882390 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882394 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882397 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882400 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882402 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882405 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 05:47:27.883315 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882407 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882410 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882413 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882430 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882435 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882440 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882443 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882446 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882448 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882452 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882454 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882457 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882460 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882463 2586 feature_gate.go:328] unrecognized feature gate: Example Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882468 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882471 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882474 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882477 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882480 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882483 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 05:47:27.883816 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882485 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882488 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882491 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882494 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882496 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882501 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882504 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882508 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882511 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882514 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882516 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882519 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882522 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882524 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882527 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882529 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882532 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882534 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.882537 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 05:47:27.884292 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883270 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883277 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883280 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883283 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883286 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883290 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883293 2586 feature_gate.go:328] unrecognized feature gate: Example Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883295 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883298 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883301 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883303 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883306 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883308 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883312 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883316 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883319 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883322 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883324 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883327 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883330 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 05:47:27.884808 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883334 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883336 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883339 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883341 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883344 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883346 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883349 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883351 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883354 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883356 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883359 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883361 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883364 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883366 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883368 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883371 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883373 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883376 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883379 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883381 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 05:47:27.885301 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883383 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883386 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883389 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883391 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883394 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883396 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883399 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883401 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883403 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883406 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883409 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883412 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883431 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883434 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883437 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883440 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883443 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883446 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883449 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 05:47:27.885805 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883453 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883456 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883459 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883465 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883468 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883470 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883473 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883475 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883478 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883482 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883484 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883487 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883490 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883492 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883495 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883498 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883502 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883505 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883508 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 05:47:27.886258 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883511 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883513 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883516 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883519 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883521 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883524 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883527 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883529 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883532 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883535 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883538 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883540 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883543 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883545 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883548 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883550 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883553 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883555 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883558 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 05:47:27.886743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883560 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883563 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883947 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883952 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883955 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883958 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883961 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883965 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883967 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883970 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883972 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883975 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883977 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883983 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883985 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883988 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883990 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883993 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883995 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.883998 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 05:47:27.887203 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884001 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884004 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884006 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884009 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884012 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884014 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884017 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884019 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884022 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884024 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884027 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884029 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884032 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884034 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884036 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884039 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884041 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884044 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884046 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884049 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 05:47:27.887703 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884051 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884054 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884057 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884060 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884062 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884066 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884068 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884071 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884074 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884076 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884079 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884082 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884084 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884088 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884091 2586 feature_gate.go:328] unrecognized feature gate: Example Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884094 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884097 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884100 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884103 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 05:47:27.888168 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884107 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884110 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884112 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884115 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884117 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884120 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884122 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884124 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884127 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884129 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884132 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884134 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884136 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884139 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884141 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884144 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884146 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884149 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884153 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884155 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 05:47:27.888649 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884158 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884161 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884165 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884168 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884172 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884175 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884178 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884181 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884183 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884186 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884189 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884192 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884194 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884196 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884199 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884201 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884204 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884206 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884209 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 05:47:27.889128 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884211 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884214 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884216 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884289 2586 flags.go:64] FLAG: --address="0.0.0.0" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884300 2586 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884310 2586 flags.go:64] FLAG: --anonymous-auth="true" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884317 2586 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884324 2586 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884328 2586 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884333 2586 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884338 2586 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884342 2586 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884345 2586 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884348 2586 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884352 2586 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884355 2586 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884358 2586 flags.go:64] FLAG: --cgroup-root="" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884362 2586 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884365 2586 flags.go:64] FLAG: --client-ca-file="" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884368 2586 flags.go:64] FLAG: --cloud-provider="external" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884370 2586 flags.go:64] FLAG: --cluster-dns="[]" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884374 2586 flags.go:64] FLAG: --cluster-domain="" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884377 2586 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884380 2586 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 15 05:47:27.889638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884383 2586 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884386 2586 flags.go:64] FLAG: --container-log-max-files="5" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884390 2586 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884393 2586 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884396 2586 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884399 2586 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884402 2586 flags.go:64] FLAG: --contention-profiling="false" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884405 2586 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884408 2586 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884411 2586 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884414 2586 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884438 2586 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884441 2586 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884444 2586 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884446 2586 flags.go:64] FLAG: --enable-load-reader="false" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884449 2586 flags.go:64] FLAG: --enable-server="true" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884453 2586 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884458 2586 flags.go:64] FLAG: --event-burst="100" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884461 2586 flags.go:64] FLAG: --event-qps="50" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884466 2586 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884469 2586 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884471 2586 flags.go:64] FLAG: --eviction-hard="" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884475 2586 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884478 2586 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884481 2586 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 15 05:47:27.890198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884486 2586 flags.go:64] FLAG: --eviction-soft="" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884489 2586 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884492 2586 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884494 2586 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884497 2586 flags.go:64] FLAG: --experimental-mounter-path="" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884500 2586 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884503 2586 flags.go:64] FLAG: --fail-swap-on="true" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884506 2586 flags.go:64] FLAG: --feature-gates="" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884509 2586 flags.go:64] FLAG: --file-check-frequency="20s" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884512 2586 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884515 2586 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884518 2586 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884521 2586 flags.go:64] FLAG: --healthz-port="10248" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884524 2586 flags.go:64] FLAG: --help="false" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884527 2586 flags.go:64] FLAG: --hostname-override="ip-10-0-132-4.ec2.internal" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884529 2586 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884532 2586 flags.go:64] FLAG: --http-check-frequency="20s" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884535 2586 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884538 2586 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884541 2586 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884543 2586 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884546 2586 flags.go:64] FLAG: --image-service-endpoint="" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884549 2586 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 15 05:47:27.890815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884552 2586 flags.go:64] FLAG: --kube-api-burst="100" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884555 2586 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884559 2586 flags.go:64] FLAG: --kube-api-qps="50" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884563 2586 flags.go:64] FLAG: --kube-reserved="" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884566 2586 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884569 2586 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884572 2586 flags.go:64] FLAG: --kubelet-cgroups="" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884575 2586 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884578 2586 flags.go:64] FLAG: --lock-file="" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884582 2586 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884585 2586 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884588 2586 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884593 2586 flags.go:64] FLAG: --log-json-split-stream="false" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884595 2586 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884598 2586 flags.go:64] FLAG: --log-text-split-stream="false" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884601 2586 flags.go:64] FLAG: --logging-format="text" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884603 2586 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884606 2586 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884609 2586 flags.go:64] FLAG: --manifest-url="" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884612 2586 flags.go:64] FLAG: --manifest-url-header="" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884616 2586 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884619 2586 flags.go:64] FLAG: --max-open-files="1000000" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884623 2586 flags.go:64] FLAG: --max-pods="110" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884626 2586 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884629 2586 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 15 05:47:27.891713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884631 2586 flags.go:64] FLAG: --memory-manager-policy="None" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884634 2586 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884637 2586 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884640 2586 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884642 2586 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884649 2586 flags.go:64] FLAG: --node-status-max-images="50" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884652 2586 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884655 2586 flags.go:64] FLAG: --oom-score-adj="-999" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884658 2586 flags.go:64] FLAG: --pod-cidr="" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884661 2586 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884668 2586 flags.go:64] FLAG: --pod-manifest-path="" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884671 2586 flags.go:64] FLAG: --pod-max-pids="-1" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884674 2586 flags.go:64] FLAG: --pods-per-core="0" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884676 2586 flags.go:64] FLAG: --port="10250" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884679 2586 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884682 2586 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-024afe85fda31b41a" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884685 2586 flags.go:64] FLAG: --qos-reserved="" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884689 2586 flags.go:64] FLAG: --read-only-port="10255" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884692 2586 flags.go:64] FLAG: --register-node="true" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884695 2586 flags.go:64] FLAG: --register-with-taints="" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884698 2586 flags.go:64] FLAG: --registry-burst="10" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884701 2586 flags.go:64] FLAG: --registry-qps="5" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884703 2586 flags.go:64] FLAG: --reserved-cpus="" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884706 2586 flags.go:64] FLAG: --reserved-memory="" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884709 2586 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 15 05:47:27.892800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884712 2586 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884715 2586 flags.go:64] FLAG: --rotate-certificates="false" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884718 2586 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884721 2586 flags.go:64] FLAG: --runonce="false" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884723 2586 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884726 2586 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884729 2586 flags.go:64] FLAG: --seccomp-default="false" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884732 2586 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884735 2586 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884737 2586 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884740 2586 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884743 2586 flags.go:64] FLAG: --storage-driver-password="root" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884746 2586 flags.go:64] FLAG: --storage-driver-secure="false" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884748 2586 flags.go:64] FLAG: --storage-driver-table="stats" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884751 2586 flags.go:64] FLAG: --storage-driver-user="root" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884754 2586 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884757 2586 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884761 2586 flags.go:64] FLAG: --system-cgroups="" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884764 2586 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884769 2586 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884771 2586 flags.go:64] FLAG: --tls-cert-file="" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884774 2586 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884778 2586 flags.go:64] FLAG: --tls-min-version="" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884781 2586 flags.go:64] FLAG: --tls-private-key-file="" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884785 2586 flags.go:64] FLAG: --topology-manager-policy="none" Jun 15 05:47:27.893937 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884788 2586 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884791 2586 flags.go:64] FLAG: --topology-manager-scope="container" Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884793 2586 flags.go:64] FLAG: --v="2" Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884801 2586 flags.go:64] FLAG: --version="false" Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884805 2586 flags.go:64] FLAG: --vmodule="" Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884808 2586 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.884812 2586 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884926 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884929 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884932 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884935 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884938 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884941 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884943 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884946 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884948 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884950 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884953 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884956 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884958 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884961 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 05:47:27.894976 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884963 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884967 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884971 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884974 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884977 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884980 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884982 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884985 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884987 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884990 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884993 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884995 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.884998 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885000 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885003 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885005 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885008 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885010 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885012 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885015 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 05:47:27.895594 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885017 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885020 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885022 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885025 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885027 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885029 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885032 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885035 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885037 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885039 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885041 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885044 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885046 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885048 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885051 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885054 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885056 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885059 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885062 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 05:47:27.896399 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885065 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885067 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885071 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885074 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885077 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885080 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885083 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885086 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885088 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885092 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885095 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885098 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885100 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885103 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885106 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885108 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885111 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885114 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885117 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 05:47:27.897096 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885119 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885122 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885124 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885127 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885129 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885131 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885134 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885136 2586 feature_gate.go:328] unrecognized feature gate: Example Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885139 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885141 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885144 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885146 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885149 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885152 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885154 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885157 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885160 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885162 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885164 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885167 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885169 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 05:47:27.897587 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885171 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 05:47:27.898102 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885174 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 05:47:27.898102 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885176 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 05:47:27.898102 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885179 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 05:47:27.898102 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885181 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 05:47:27.898102 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.885184 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 05:47:27.898102 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.885189 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 05:47:27.898102 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.893220 2586 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 15 05:47:27.898102 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.893240 2586 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 15 05:47:27.898102 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.893267 2586 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 15 05:47:27.898102 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.893276 2586 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 15 05:47:27.898102 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893358 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 05:47:27.898102 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893366 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 05:47:27.898102 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893371 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 05:47:27.898102 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893376 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 05:47:27.898102 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893381 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893386 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893391 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893395 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893399 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893404 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893408 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893412 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893437 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893441 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893445 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893449 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893453 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893456 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893460 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893464 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893468 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893471 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893475 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 05:47:27.898627 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893479 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893483 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893486 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893492 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893497 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893502 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893509 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893515 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893520 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893524 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893528 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893532 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893536 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893540 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893545 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893549 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893553 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893557 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893561 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893565 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 05:47:27.899201 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893570 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893573 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893577 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893581 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893586 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893590 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893594 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893598 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893602 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893606 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893610 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893614 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893619 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893623 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893627 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893631 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893638 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893644 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893651 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 05:47:27.899743 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893656 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893660 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893665 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893669 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893673 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893677 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893681 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893685 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893690 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893694 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893698 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893702 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893707 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893711 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893715 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893719 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893723 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893727 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893732 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893736 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 05:47:27.900223 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893739 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 05:47:27.900793 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893744 2586 feature_gate.go:328] unrecognized feature gate: Example Jun 15 05:47:27.900793 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893748 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 05:47:27.900793 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893752 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 05:47:27.900793 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893756 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 05:47:27.900793 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893760 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 05:47:27.900793 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893766 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 05:47:27.900793 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893771 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 05:47:27.900793 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893775 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 05:47:27.900793 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893779 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 05:47:27.900793 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893784 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 05:47:27.900793 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893789 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 05:47:27.900793 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893793 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 05:47:27.900793 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893798 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 05:47:27.900793 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893802 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 05:47:27.900793 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893807 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 05:47:27.900793 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.893811 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 05:47:27.901188 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.893819 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 05:47:27.901188 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894024 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 05:47:27.901188 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894033 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 05:47:27.901188 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894038 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 05:47:27.901188 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894043 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 05:47:27.901188 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894047 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 05:47:27.901188 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894053 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 05:47:27.901188 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894057 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 05:47:27.901188 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894061 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 05:47:27.901188 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894065 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 05:47:27.901188 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894069 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 05:47:27.901188 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894073 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 05:47:27.901188 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894078 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 05:47:27.901188 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894082 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 05:47:27.901188 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894085 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894090 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894093 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894097 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894102 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894106 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894111 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894115 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894119 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894123 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894127 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894132 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894136 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894141 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894145 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894150 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894154 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894158 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894162 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894166 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 05:47:27.901605 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894171 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894175 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894179 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894185 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894192 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894197 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894201 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894205 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894210 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894214 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894218 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894222 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894226 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894230 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894235 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894239 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894243 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894247 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894251 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894255 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 05:47:27.902077 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894259 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894263 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894267 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894271 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894276 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894280 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894284 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894289 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894304 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894310 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894314 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894318 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894323 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894327 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894332 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894336 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894340 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894344 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894348 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894352 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 05:47:27.902565 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894356 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894359 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894364 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894368 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894372 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894376 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894381 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894387 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894392 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894396 2586 feature_gate.go:328] unrecognized feature gate: Example Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894401 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894405 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894409 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894414 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894443 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894447 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894452 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894457 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894461 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 05:47:27.903171 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894465 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 05:47:27.903960 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894469 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 05:47:27.903960 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894474 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 05:47:27.903960 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894480 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 05:47:27.903960 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894484 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 05:47:27.903960 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894488 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 05:47:27.903960 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:27.894492 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 05:47:27.903960 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.894501 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 05:47:27.903960 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.894661 2586 server.go:962] "Client rotation is on, will bootstrap in background" Jun 15 05:47:27.903960 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.898982 2586 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 15 05:47:27.903960 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.900496 2586 server.go:1019] "Starting client certificate rotation" Jun 15 05:47:27.903960 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.900973 2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 05:47:27.903960 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.901022 2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 05:47:27.906303 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.906288 2586 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 05:47:27.908331 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.908316 2586 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 05:47:27.918608 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.918590 2586 log.go:25] "Validated CRI v1 runtime API" Jun 15 05:47:27.922100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.922081 2586 log.go:25] "Validated CRI v1 image API" Jun 15 05:47:27.923616 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.923602 2586 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 15 05:47:27.926414 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.926389 2586 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9fce35d1-ec82-4bfe-97ee-3e38d938524a:/dev/nvme0n1p4 b7857c8f-65c7-480e-aee6-106fb45499f1:/dev/nvme0n1p3] Jun 15 05:47:27.926513 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.926431 2586 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 15 05:47:27.931761 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.931646 2586 manager.go:216] Machine: {Timestamp:2026-06-15 05:47:27.931066712 +0000 UTC m=+0.375432510 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109731 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21c179e502d74e8a038c808a3345bb SystemUUID:ec21c179-e502-d74e-8a03-8c808a3345bb BootID:ede5ea08-f62d-4f09-9526-7b88ac09d7ae Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:60:c9:ee:93:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:60:c9:ee:93:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:21:8b:d3:59:55 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 15 05:47:27.931761 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.931747 2586 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 15 05:47:27.931921 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.931905 2586 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 15 05:47:27.933079 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.933056 2586 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 15 05:47:27.933222 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.933083 2586 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-4.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 15 05:47:27.933612 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.933596 2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 05:47:27.933874 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.933863 2586 topology_manager.go:138] "Creating topology manager with none policy" Jun 15 05:47:27.933911 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.933877 2586 container_manager_linux.go:309] "Creating device plugin manager" Jun 15 05:47:27.933911 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.933884 2586 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 05:47:27.933911 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.933895 2586 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 05:47:27.935606 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.935593 2586 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 15 05:47:27.939091 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.939080 2586 state_mem.go:36] "Initialized new in-memory state store" Jun 15 05:47:27.939207 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.939198 2586 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 15 05:47:27.939236 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.939231 2586 kubelet.go:486] "Attempting to sync node with API server" Jun 15 05:47:27.939294 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.939245 2586 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 15 05:47:27.939294 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.939264 2586 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 15 05:47:27.939294 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.939277 2586 kubelet.go:398] "Adding apiserver pod source" Jun 15 05:47:27.939294 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.939291 2586 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 15 05:47:27.939999 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.939983 2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 05:47:27.940061 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.940011 2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 05:47:27.942744 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.942727 2586 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 15 05:47:27.945000 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.944986 2586 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 15 05:47:27.945046 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.945016 2586 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 15 05:47:27.945745 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.945733 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 15 05:47:27.945777 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.945752 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 15 05:47:27.945777 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.945759 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 15 05:47:27.945777 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.945765 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 15 05:47:27.945777 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.945773 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 15 05:47:27.945898 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.945780 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 15 05:47:27.945898 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.945807 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 15 05:47:27.945898 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.945816 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 15 05:47:27.945898 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.945823 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 15 05:47:27.945898 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.945828 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 15 05:47:27.948878 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.948865 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 15 05:47:27.948878 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.948878 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 15 05:47:27.948982 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.948902 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 15 05:47:27.948982 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.948907 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 15 05:47:27.953106 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.953077 2586 server.go:1268] "Started kubelet" Jun 15 05:47:27.953214 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:27.953192 2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 15 05:47:27.953301 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:27.953195 2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 15 05:47:27.953550 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.953494 2586 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 15 05:47:27.953630 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.953576 2586 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 15 05:47:27.953729 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.953188 2586 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-4.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 15 05:47:27.953823 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.953770 2586 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 15 05:47:27.954187 ip-10-0-132-4 systemd[1]: Started Kubernetes Kubelet. Jun 15 05:47:27.955954 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.955771 2586 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 15 05:47:27.956044 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.955999 2586 server.go:310] "Adding debug handlers to kubelet server" Jun 15 05:47:27.961909 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:27.961870 2586 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 15 05:47:27.963800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.963768 2586 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 15 05:47:27.963909 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.963797 2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 15 05:47:27.963909 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:27.963875 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Jun 15 05:47:27.964467 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.964447 2586 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 15 05:47:27.964644 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.964626 2586 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 15 05:47:27.964644 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.964642 2586 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 15 05:47:27.964777 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.964751 2586 reconstruct.go:97] "Volume reconstruction finished" Jun 15 05:47:27.964777 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.964762 2586 reconciler.go:29] "Reconciler: start to sync state" Jun 15 05:47:27.964875 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.964752 2586 factory.go:55] Registering systemd factory Jun 15 05:47:27.964875 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.964795 2586 factory.go:223] Registration of the systemd container factory successfully Jun 15 05:47:27.965078 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.965066 2586 factory.go:153] Registering CRI-O factory Jun 15 05:47:27.965078 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.965080 2586 factory.go:223] Registration of the crio container factory successfully Jun 15 05:47:27.965182 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.965155 2586 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 15 05:47:27.965182 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.965174 2586 factory.go:103] Registering Raw factory Jun 15 05:47:27.965283 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.965185 2586 manager.go:1196] Started watching for new ooms in manager Jun 15 05:47:27.965559 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.965544 2586 manager.go:349] Starting recovery of all containers Jun 15 05:47:27.973222 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:27.973191 2586 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 15 05:47:27.973380 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:27.973349 2586 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 15 05:47:27.974048 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:27.972781 2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-4.ec2.internal.18b92b09a0bacc87 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-4.ec2.internal,UID:ip-10-0-132-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-4.ec2.internal,},FirstTimestamp:2026-06-15 05:47:27.953038471 +0000 UTC m=+0.397404285,LastTimestamp:2026-06-15 05:47:27.953038471 +0000 UTC m=+0.397404285,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-4.ec2.internal,}" Jun 15 05:47:27.977118 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.977102 2586 manager.go:354] Recovery completed Jun 15 05:47:27.981596 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.981584 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 05:47:27.983564 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.983531 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory" Jun 15 05:47:27.983637 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.983585 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 05:47:27.983637 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.983600 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID" Jun 15 05:47:27.984099 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.984087 2586 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 15 05:47:27.984099 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.984098 2586 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 15 05:47:27.984175 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.984113 2586 state_mem.go:36] "Initialized new in-memory state store" Jun 15 05:47:27.984175 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.984149 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 05:47:27.984903 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.984888 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory" Jun 15 05:47:27.984961 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.984915 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 05:47:27.984961 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.984927 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID" Jun 15 05:47:27.985291 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.985279 2586 policy_none.go:49] "None policy: Start" Jun 15 05:47:27.985332 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.985296 2586 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 15 05:47:27.985332 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.985306 2586 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 15 05:47:27.985679 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:27.985606 2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-4.ec2.internal.18b92b09a28c9831 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-4.ec2.internal,UID:ip-10-0-132-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-4.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-4.ec2.internal,},FirstTimestamp:2026-06-15 05:47:27.983564849 +0000 UTC m=+0.427930651,LastTimestamp:2026-06-15 05:47:27.983564849 +0000 UTC m=+0.427930651,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-4.ec2.internal,}" Jun 15 05:47:27.986044 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.986027 2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nxfpj" Jun 15 05:47:27.986294 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.986284 2586 policy_none.go:47] "Start" Jun 15 05:47:27.994055 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:27.994028 2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nxfpj" Jun 15 05:47:27.995131 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:27.995064 2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-4.ec2.internal.18b92b09a28d0a3f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-4.ec2.internal,UID:ip-10-0-132-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-4.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-4.ec2.internal,},FirstTimestamp:2026-06-15 05:47:27.983594047 +0000 UTC m=+0.427959844,LastTimestamp:2026-06-15 05:47:27.983594047 +0000 UTC m=+0.427959844,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-4.ec2.internal,}" Jun 15 05:47:28.022085 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.022055 2586 manager.go:337] "Starting Device Plugin manager" Jun 15 05:47:28.022237 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:28.022196 2586 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 15 05:47:28.022237 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.022210 2586 server.go:87] "Starting device plugin registration server" Jun 15 05:47:28.022620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.022479 2586 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 15 05:47:28.022620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.022493 2586 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 15 05:47:28.022811 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.022735 2586 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 15 05:47:28.022811 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.022810 2586 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 15 05:47:28.022884 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.022818 2586 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 15 05:47:28.023532 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:28.023507 2586 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 15 05:47:28.023599 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:28.023559 2586 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-4.ec2.internal\" not found" Jun 15 05:47:28.037226 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.037197 2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 15 05:47:28.038532 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.038517 2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 15 05:47:28.038613 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.038551 2586 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 15 05:47:28.038613 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.038573 2586 kubelet.go:2448] "Starting kubelet main sync loop" Jun 15 05:47:28.038613 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:28.038608 2586 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 15 05:47:28.040607 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.040591 2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 05:47:28.122964 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.122858 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 05:47:28.124044 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.124029 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory" Jun 15 05:47:28.124096 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.124065 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 05:47:28.124096 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.124076 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID" Jun 15 05:47:28.124174 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.124099 2586 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.133090 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.133069 2586 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.133153 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:28.133094 2586 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-4.ec2.internal\": node \"ip-10-0-132-4.ec2.internal\" not found" Jun 15 05:47:28.139358 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.139327 2586 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal"] Jun 15 05:47:28.139490 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.139396 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 05:47:28.141487 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.141471 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory" Jun 15 05:47:28.141592 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.141497 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 05:47:28.141592 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.141506 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID" Jun 15 05:47:28.142768 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.142756 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 05:47:28.142891 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.142875 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.142950 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.142914 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 05:47:28.143470 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.143454 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory" Jun 15 05:47:28.143470 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.143468 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory" Jun 15 05:47:28.143625 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.143479 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 05:47:28.143625 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.143489 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID" Jun 15 05:47:28.143625 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.143495 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 05:47:28.143625 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.143509 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID" Jun 15 05:47:28.144686 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.144673 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.144756 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.144695 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 05:47:28.145435 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.145404 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory" Jun 15 05:47:28.145502 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.145451 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 05:47:28.145502 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.145464 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID" Jun 15 05:47:28.164451 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:28.164413 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Jun 15 05:47:28.166516 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.166500 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e5a6d474b71b6fc751f82cbcd5d9988f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"e5a6d474b71b6fc751f82cbcd5d9988f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.166589 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.166530 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5a6d474b71b6fc751f82cbcd5d9988f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"e5a6d474b71b6fc751f82cbcd5d9988f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.166589 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.166555 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d9e068ea74451873cf30d8effd17b743-config\") pod \"kube-apiserver-proxy-ip-10-0-132-4.ec2.internal\" (UID: \"d9e068ea74451873cf30d8effd17b743\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.170148 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:28.170134 2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-4.ec2.internal\" not found" node="ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.174544 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:28.174528 2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-4.ec2.internal\" not found" node="ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.265039 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:28.265005 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Jun 15 05:47:28.267209 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.267190 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e5a6d474b71b6fc751f82cbcd5d9988f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"e5a6d474b71b6fc751f82cbcd5d9988f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.267286 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.267220 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5a6d474b71b6fc751f82cbcd5d9988f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"e5a6d474b71b6fc751f82cbcd5d9988f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.267286 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.267239 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d9e068ea74451873cf30d8effd17b743-config\") pod \"kube-apiserver-proxy-ip-10-0-132-4.ec2.internal\" (UID: \"d9e068ea74451873cf30d8effd17b743\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.267286 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.267280 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d9e068ea74451873cf30d8effd17b743-config\") pod \"kube-apiserver-proxy-ip-10-0-132-4.ec2.internal\" (UID: \"d9e068ea74451873cf30d8effd17b743\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.267378 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.267292 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e5a6d474b71b6fc751f82cbcd5d9988f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"e5a6d474b71b6fc751f82cbcd5d9988f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.267378 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.267294 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5a6d474b71b6fc751f82cbcd5d9988f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"e5a6d474b71b6fc751f82cbcd5d9988f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.365540 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:28.365491 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Jun 15 05:47:28.466379 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:28.466301 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Jun 15 05:47:28.474618 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.474602 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.478477 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.478277 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" Jun 15 05:47:28.567467 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:28.567414 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Jun 15 05:47:28.667859 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:28.667825 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Jun 15 05:47:28.768454 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:28.768346 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Jun 15 05:47:28.854634 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.854604 2586 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 05:47:28.869109 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:28.869080 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Jun 15 05:47:28.900355 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.900325 2586 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 15 05:47:28.901035 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.900503 2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 05:47:28.901035 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.900502 2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 05:47:28.969199 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:28.969164 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Jun 15 05:47:28.998663 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.998615 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 05:42:27 +0000 UTC" deadline="2028-01-09 22:08:33.173816826 +0000 UTC" Jun 15 05:47:28.998663 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:28.998652 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13768h21m4.175167741s" Jun 15 05:47:29.069741 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:29.069667 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Jun 15 05:47:29.073901 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.073884 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 05:47:29.074896 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.074877 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory" Jun 15 05:47:29.074992 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.074910 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 05:47:29.074992 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.074924 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID" Jun 15 05:47:29.138764 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:29.138732 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a6d474b71b6fc751f82cbcd5d9988f.slice/crio-2b2f3b27368934ea699cfba121762a1d3c7ab4dc3328ba76d682e756a5aff9d6 WatchSource:0}: Error finding container 2b2f3b27368934ea699cfba121762a1d3c7ab4dc3328ba76d682e756a5aff9d6: Status 404 returned error can't find the container with id 2b2f3b27368934ea699cfba121762a1d3c7ab4dc3328ba76d682e756a5aff9d6 Jun 15 05:47:29.139328 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:29.139293 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e068ea74451873cf30d8effd17b743.slice/crio-dd1acc5090a112c7d2b2d3cf0fd551a69863863216e022eec7e41fe57736a799 WatchSource:0}: Error finding container dd1acc5090a112c7d2b2d3cf0fd551a69863863216e022eec7e41fe57736a799: Status 404 returned error can't find the container with id dd1acc5090a112c7d2b2d3cf0fd551a69863863216e022eec7e41fe57736a799 Jun 15 05:47:29.145190 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.145174 2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 05:47:29.170012 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:29.169974 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Jun 15 05:47:29.270525 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:29.270489 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Jun 15 05:47:29.370941 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:29.370875 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Jun 15 05:47:29.391707 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.391683 2586 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 05:47:29.395263 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.395246 2586 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 05:47:29.464955 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.464922 2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Jun 15 05:47:29.478769 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.478746 2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 05:47:29.479886 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.479872 2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" Jun 15 05:47:29.487925 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.487911 2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 05:47:29.940355 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.940102 2586 apiserver.go:52] "Watching apiserver" Jun 15 05:47:29.950739 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.950710 2586 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 15 05:47:29.951200 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.951160 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-kwpd4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal","openshift-multus/multus-hbff2","openshift-ovn-kubernetes/ovnkube-node-h6dj8","kube-system/global-pull-secret-syncer-gq488","kube-system/konnectivity-agent-5cfkb","kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz","openshift-multus/multus-additional-cni-plugins-224th","openshift-multus/network-metrics-daemon-hx8xj","openshift-network-diagnostics/network-check-target-twc9d","openshift-network-operator/iptables-alerter-kspwz","openshift-cluster-node-tuning-operator/tuned-84c6n","openshift-dns/node-resolver-vkl6p"] Jun 15 05:47:29.953844 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.953819 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:29.953947 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:29.953903 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:47:29.956046 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.956023 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:29.959004 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.958256 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.959004 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.958676 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9ldl5\"" Jun 15 05:47:29.959004 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.958868 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 15 05:47:29.959004 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.958867 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 15 05:47:29.960480 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.960456 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 15 05:47:29.961126 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.961104 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 15 05:47:29.961325 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.961306 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 15 05:47:29.961530 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.961514 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mhbb8\"" Jun 15 05:47:29.961904 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.961887 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 15 05:47:29.962148 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.962132 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.963166 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.963146 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:29.963257 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:29.963230 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:47:29.965271 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.964261 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 15 05:47:29.965271 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.964298 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8vkgw\"" Jun 15 05:47:29.965271 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.964479 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 15 05:47:29.965271 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.964555 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 15 05:47:29.965271 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.964714 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 15 05:47:29.965271 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.964853 2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 15 05:47:29.965592 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.965490 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5cfkb" Jun 15 05:47:29.965973 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.965956 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 15 05:47:29.966047 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.966031 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 15 05:47:29.968346 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.968323 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:29.971343 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.970904 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vkl6p" Jun 15 05:47:29.971343 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.970915 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 15 05:47:29.971343 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.970925 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 15 05:47:29.971343 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.971024 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xvb9s\"" Jun 15 05:47:29.971343 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.971098 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 15 05:47:29.971343 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.971172 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hxqxt\"" Jun 15 05:47:29.971703 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.971348 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 15 05:47:29.973388 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.973364 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 15 05:47:29.973504 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.973494 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 15 05:47:29.973851 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.973829 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r6vbs\"" Jun 15 05:47:29.974078 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974063 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:29.974554 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974532 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-log-socket\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.974632 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974567 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6667edff-458f-44e4-b82b-a434ede9a795-ovnkube-script-lib\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.974632 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974584 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-sysctl-conf\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:29.974632 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974599 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-lib-modules\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:29.974632 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974614 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhvkn\" (UniqueName: \"kubernetes.io/projected/b881a9c5-0572-4255-b8f8-63cb06d5c107-kube-api-access-fhvkn\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:29.974632 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974628 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-run-openvswitch\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.974797 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974643 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-cni-bin\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.974797 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974664 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/451d8df0-b161-46b5-9ffb-0a0d3f608881-dbus\") pod \"global-pull-secret-syncer-gq488\" (UID: \"451d8df0-b161-46b5-9ffb-0a0d3f608881\") " pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:29.974797 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974685 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.974797 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974708 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-sysctl-d\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:29.974797 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974730 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-run\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:29.974797 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974752 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-multus-socket-dir-parent\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.974797 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974775 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-multus-conf-dir\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.974797 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974796 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-run-systemd\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.975032 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974819 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6667edff-458f-44e4-b82b-a434ede9a795-ovn-node-metrics-cert\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.975032 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974854 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5x2k\" (UniqueName: \"kubernetes.io/projected/e08f6162-b5b3-4beb-af7c-0b23b0635346-kube-api-access-n5x2k\") pod \"network-metrics-daemon-hx8xj\" (UID: \"e08f6162-b5b3-4beb-af7c-0b23b0635346\") " pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:29.975032 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974878 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-var-lib-kubelet\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.975032 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974901 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b673936d-2921-478e-b86b-0b5d848874b4-multus-daemon-config\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.975032 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974923 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-kubelet\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.975032 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974947 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-run-netns\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.975032 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974969 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-sysconfig\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:29.975032 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.974989 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-sys\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:29.975032 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975021 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-cnibin\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.975322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975045 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b673936d-2921-478e-b86b-0b5d848874b4-cni-binary-copy\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.975322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975076 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret\") pod \"global-pull-secret-syncer-gq488\" (UID: \"451d8df0-b161-46b5-9ffb-0a0d3f608881\") " pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:29.975322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975109 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5723186-ee58-4ca9-937f-60a78d5a4d04-agent-certs\") pod \"konnectivity-agent-5cfkb\" (UID: \"d5723186-ee58-4ca9-937f-60a78d5a4d04\") " pod="kube-system/konnectivity-agent-5cfkb" Jun 15 05:47:29.975322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975133 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-systemd\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:29.975322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975201 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-var-lib-openvswitch\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.975322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975226 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/451d8df0-b161-46b5-9ffb-0a0d3f608881-kubelet-config\") pod \"global-pull-secret-syncer-gq488\" (UID: \"451d8df0-b161-46b5-9ffb-0a0d3f608881\") " pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:29.975322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975247 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-var-lib-kubelet\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:29.975322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975274 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-host\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:29.975578 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975340 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-slash\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.975578 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975369 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5723186-ee58-4ca9-937f-60a78d5a4d04-konnectivity-ca\") pod \"konnectivity-agent-5cfkb\" (UID: \"d5723186-ee58-4ca9-937f-60a78d5a4d04\") " pod="kube-system/konnectivity-agent-5cfkb" Jun 15 05:47:29.975578 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975404 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-node-log\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.975578 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975454 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs\") pod \"network-metrics-daemon-hx8xj\" (UID: \"e08f6162-b5b3-4beb-af7c-0b23b0635346\") " pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:29.975578 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975481 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-hostroot\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.975578 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975504 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-run-multus-certs\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.975578 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975526 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-etc-openvswitch\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.975578 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975563 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b881a9c5-0572-4255-b8f8-63cb06d5c107-tmp\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975589 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-systemd-units\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975612 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-run-ovn\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975642 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6667edff-458f-44e4-b82b-a434ede9a795-ovnkube-config\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975664 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-multus-cni-dir\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975687 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-var-lib-cni-bin\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975707 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-etc-kubernetes\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975756 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-os-release\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975815 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-run-k8s-cni-cncf-io\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975839 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-cni-netd\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975868 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6667edff-458f-44e4-b82b-a434ede9a795-env-overrides\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975893 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-modprobe-d\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975915 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-run-netns\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975936 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96zpd\" (UniqueName: \"kubernetes.io/projected/b673936d-2921-478e-b86b-0b5d848874b4-kube-api-access-96zpd\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975967 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-kubernetes\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.975989 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-system-cni-dir\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.976010 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-run-ovn-kubernetes\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.976031 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.976031 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgj2v\" (UniqueName: \"kubernetes.io/projected/6667edff-458f-44e4-b82b-a434ede9a795-kube-api-access-lgj2v\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:29.976810 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.976090 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-tuned\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:29.976810 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.976117 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-var-lib-cni-multus\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:29.976810 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.976318 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kwpd4" Jun 15 05:47:29.978801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.978783 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:29.978907 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:29.978857 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:47:29.979771 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.979562 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 15 05:47:29.979895 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.979786 2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 05:47:29.979895 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.979804 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nqxck\"" Jun 15 05:47:29.980050 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.980034 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 15 05:47:29.980150 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.980133 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j44n5\"" Jun 15 05:47:29.980774 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.980743 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 15 05:47:29.980886 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.980857 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 15 05:47:29.981275 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.981058 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 15 05:47:29.981275 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.981140 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kspwz" Jun 15 05:47:29.981275 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.980747 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 15 05:47:29.983971 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.983952 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 15 05:47:29.984158 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.984056 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 15 05:47:29.984158 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.984146 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 15 05:47:29.984283 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.984269 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lq6jc\"" Jun 15 05:47:30.000010 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:29.999989 2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v6hpz" Jun 15 05:47:30.005948 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.005923 2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v6hpz" Jun 15 05:47:30.046454 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.046349 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" event={"ID":"e5a6d474b71b6fc751f82cbcd5d9988f","Type":"ContainerStarted","Data":"2b2f3b27368934ea699cfba121762a1d3c7ab4dc3328ba76d682e756a5aff9d6"} Jun 15 05:47:30.047574 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.047546 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" event={"ID":"d9e068ea74451873cf30d8effd17b743","Type":"ContainerStarted","Data":"dd1acc5090a112c7d2b2d3cf0fd551a69863863216e022eec7e41fe57736a799"} Jun 15 05:47:30.066808 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.066771 2586 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 15 05:47:30.076960 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.076930 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-var-lib-openvswitch\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.076960 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.076964 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/451d8df0-b161-46b5-9ffb-0a0d3f608881-kubelet-config\") pod \"global-pull-secret-syncer-gq488\" (UID: \"451d8df0-b161-46b5-9ffb-0a0d3f608881\") " pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:30.077195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.076983 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-var-lib-kubelet\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.077195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077040 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/451d8df0-b161-46b5-9ffb-0a0d3f608881-kubelet-config\") pod \"global-pull-secret-syncer-gq488\" (UID: \"451d8df0-b161-46b5-9ffb-0a0d3f608881\") " pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:30.077195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077043 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-var-lib-openvswitch\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.077195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077065 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-host\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.077195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077094 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-slash\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.077195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077111 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5723186-ee58-4ca9-937f-60a78d5a4d04-konnectivity-ca\") pod \"konnectivity-agent-5cfkb\" (UID: \"d5723186-ee58-4ca9-937f-60a78d5a4d04\") " pod="kube-system/konnectivity-agent-5cfkb" Jun 15 05:47:30.077195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077132 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0871a8a-1c3b-473f-8845-dcc783210854-os-release\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.077195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077132 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-var-lib-kubelet\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.077195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077159 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0871a8a-1c3b-473f-8845-dcc783210854-tuning-conf-dir\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.077195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077159 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-slash\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.077195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077193 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-sys-fs\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077223 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-node-log\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077194 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-host\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077246 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs\") pod \"network-metrics-daemon-hx8xj\" (UID: \"e08f6162-b5b3-4beb-af7c-0b23b0635346\") " pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077276 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-hostroot\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077299 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-node-log\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:30.077333 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077350 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-hostroot\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077369 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-run-multus-certs\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077301 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-run-multus-certs\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:30.077403 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs podName:e08f6162-b5b3-4beb-af7c-0b23b0635346 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:30.577380069 +0000 UTC m=+3.021745852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs") pod "network-metrics-daemon-hx8xj" (UID: "e08f6162-b5b3-4beb-af7c-0b23b0635346") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077449 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0871a8a-1c3b-473f-8845-dcc783210854-cnibin\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077475 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0871a8a-1c3b-473f-8845-dcc783210854-cni-binary-copy\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077500 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-device-dir\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077530 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-etc-selinux\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077571 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-etc-openvswitch\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077603 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-etc-openvswitch\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.077620 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077607 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b881a9c5-0572-4255-b8f8-63cb06d5c107-tmp\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077631 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-systemd-units\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077653 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-run-ovn\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077677 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6667edff-458f-44e4-b82b-a434ede9a795-ovnkube-config\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077698 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-systemd-units\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077714 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-run-ovn\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077718 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-multus-cni-dir\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077747 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-var-lib-cni-bin\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077772 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-etc-kubernetes\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077786 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5723186-ee58-4ca9-937f-60a78d5a4d04-konnectivity-ca\") pod \"konnectivity-agent-5cfkb\" (UID: \"d5723186-ee58-4ca9-937f-60a78d5a4d04\") " pod="kube-system/konnectivity-agent-5cfkb" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077802 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0871a8a-1c3b-473f-8845-dcc783210854-system-cni-dir\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077829 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-var-lib-cni-bin\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077832 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-registration-dir\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077858 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-etc-kubernetes\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077893 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-multus-cni-dir\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077896 2586 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077912 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-os-release\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077940 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-run-k8s-cni-cncf-io\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.078320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077966 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/607f39f7-4e69-48b8-9127-b5d6fa14681c-hosts-file\") pod \"node-resolver-vkl6p\" (UID: \"607f39f7-4e69-48b8-9127-b5d6fa14681c\") " pod="openshift-dns/node-resolver-vkl6p" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.077993 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/607f39f7-4e69-48b8-9127-b5d6fa14681c-tmp-dir\") pod \"node-resolver-vkl6p\" (UID: \"607f39f7-4e69-48b8-9127-b5d6fa14681c\") " pod="openshift-dns/node-resolver-vkl6p" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078014 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-run-k8s-cni-cncf-io\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078023 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-os-release\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078019 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-cni-netd\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078055 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-cni-netd\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078069 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6667edff-458f-44e4-b82b-a434ede9a795-env-overrides\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078095 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-modprobe-d\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078118 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-run-netns\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078160 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-run-netns\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078161 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96zpd\" (UniqueName: \"kubernetes.io/projected/b673936d-2921-478e-b86b-0b5d848874b4-kube-api-access-96zpd\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078196 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm8lb\" (UniqueName: \"kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb\") pod \"network-check-target-twc9d\" (UID: \"7087d934-a825-4c23-9848-4742b1151be7\") " pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078225 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-modprobe-d\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078244 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvh84\" (UniqueName: \"kubernetes.io/projected/385e0bfa-0d96-489b-a1f3-c83f3ac0066f-kube-api-access-kvh84\") pod \"node-ca-kwpd4\" (UID: \"385e0bfa-0d96-489b-a1f3-c83f3ac0066f\") " pod="openshift-image-registry/node-ca-kwpd4" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078273 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-kubernetes\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078276 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6667edff-458f-44e4-b82b-a434ede9a795-ovnkube-config\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078298 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-system-cni-dir\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078321 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-run-ovn-kubernetes\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.079146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078335 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-kubernetes\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078345 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgj2v\" (UniqueName: \"kubernetes.io/projected/6667edff-458f-44e4-b82b-a434ede9a795-kube-api-access-lgj2v\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078366 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-tuned\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078380 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-system-cni-dir\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078388 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-var-lib-cni-multus\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078394 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-run-ovn-kubernetes\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078435 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/09340711-a3a9-4ef3-b0fb-e57e83099d88-iptables-alerter-script\") pod \"iptables-alerter-kspwz\" (UID: \"09340711-a3a9-4ef3-b0fb-e57e83099d88\") " pod="openshift-network-operator/iptables-alerter-kspwz" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078464 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/385e0bfa-0d96-489b-a1f3-c83f3ac0066f-serviceca\") pod \"node-ca-kwpd4\" (UID: \"385e0bfa-0d96-489b-a1f3-c83f3ac0066f\") " pod="openshift-image-registry/node-ca-kwpd4" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078469 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-var-lib-cni-multus\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078487 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-log-socket\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078505 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6667edff-458f-44e4-b82b-a434ede9a795-env-overrides\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078529 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-log-socket\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078511 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6667edff-458f-44e4-b82b-a434ede9a795-ovnkube-script-lib\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078572 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-sysctl-conf\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078600 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-lib-modules\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078624 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhvkn\" (UniqueName: \"kubernetes.io/projected/b881a9c5-0572-4255-b8f8-63cb06d5c107-kube-api-access-fhvkn\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078661 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d0871a8a-1c3b-473f-8845-dcc783210854-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.079997 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078696 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-run-openvswitch\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078721 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-cni-bin\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078735 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-sysctl-conf\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078747 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/451d8df0-b161-46b5-9ffb-0a0d3f608881-dbus\") pod \"global-pull-secret-syncer-gq488\" (UID: \"451d8df0-b161-46b5-9ffb-0a0d3f608881\") " pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078776 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5dqd\" (UniqueName: \"kubernetes.io/projected/d0871a8a-1c3b-473f-8845-dcc783210854-kube-api-access-d5dqd\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078782 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-run-openvswitch\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078800 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-socket-dir\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078829 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078854 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-sysctl-d\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078878 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-run\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078904 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-multus-socket-dir-parent\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078928 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-multus-conf-dir\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078937 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-cni-bin\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078953 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-lib-modules\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078953 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078983 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6667edff-458f-44e4-b82b-a434ede9a795-ovnkube-script-lib\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.078905 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/451d8df0-b161-46b5-9ffb-0a0d3f608881-dbus\") pod \"global-pull-secret-syncer-gq488\" (UID: \"451d8df0-b161-46b5-9ffb-0a0d3f608881\") " pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:30.080801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079010 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-run\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079015 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-run-systemd\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079026 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-multus-conf-dir\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079028 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079060 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6667edff-458f-44e4-b82b-a434ede9a795-ovn-node-metrics-cert\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079064 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-run-systemd\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079072 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-multus-socket-dir-parent\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079092 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5x2k\" (UniqueName: \"kubernetes.io/projected/e08f6162-b5b3-4beb-af7c-0b23b0635346-kube-api-access-n5x2k\") pod \"network-metrics-daemon-hx8xj\" (UID: \"e08f6162-b5b3-4beb-af7c-0b23b0635346\") " pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079090 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-sysctl-d\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079109 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-var-lib-kubelet\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079125 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b673936d-2921-478e-b86b-0b5d848874b4-multus-daemon-config\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079147 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09340711-a3a9-4ef3-b0fb-e57e83099d88-host-slash\") pod \"iptables-alerter-kspwz\" (UID: \"09340711-a3a9-4ef3-b0fb-e57e83099d88\") " pod="openshift-network-operator/iptables-alerter-kspwz" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079185 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-host-var-lib-kubelet\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079212 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f97p\" (UniqueName: \"kubernetes.io/projected/09340711-a3a9-4ef3-b0fb-e57e83099d88-kube-api-access-6f97p\") pod \"iptables-alerter-kspwz\" (UID: \"09340711-a3a9-4ef3-b0fb-e57e83099d88\") " pod="openshift-network-operator/iptables-alerter-kspwz" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079236 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/385e0bfa-0d96-489b-a1f3-c83f3ac0066f-host\") pod \"node-ca-kwpd4\" (UID: \"385e0bfa-0d96-489b-a1f3-c83f3ac0066f\") " pod="openshift-image-registry/node-ca-kwpd4" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079260 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-kubelet\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079302 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-kubelet\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.081633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079327 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-run-netns\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079352 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-sysconfig\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079374 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6667edff-458f-44e4-b82b-a434ede9a795-host-run-netns\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079376 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-sys\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079412 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-sys\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079439 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-cnibin\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079466 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b673936d-2921-478e-b86b-0b5d848874b4-cni-binary-copy\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079470 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-sysconfig\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079493 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sv6j\" (UniqueName: \"kubernetes.io/projected/bfbd9b06-f7ea-4191-a985-92c518bef82e-kube-api-access-8sv6j\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079519 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b673936d-2921-478e-b86b-0b5d848874b4-cnibin\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079531 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q4dg\" (UniqueName: \"kubernetes.io/projected/607f39f7-4e69-48b8-9127-b5d6fa14681c-kube-api-access-7q4dg\") pod \"node-resolver-vkl6p\" (UID: \"607f39f7-4e69-48b8-9127-b5d6fa14681c\") " pod="openshift-dns/node-resolver-vkl6p" Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079564 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret\") pod \"global-pull-secret-syncer-gq488\" (UID: \"451d8df0-b161-46b5-9ffb-0a0d3f608881\") " pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079629 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5723186-ee58-4ca9-937f-60a78d5a4d04-agent-certs\") pod \"konnectivity-agent-5cfkb\" (UID: \"d5723186-ee58-4ca9-937f-60a78d5a4d04\") " pod="kube-system/konnectivity-agent-5cfkb" Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:30.079634 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079654 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-systemd\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:30.079685 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret podName:451d8df0-b161-46b5-9ffb-0a0d3f608881 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:30.579667347 +0000 UTC m=+3.024033138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret") pod "global-pull-secret-syncer-gq488" (UID: "451d8df0-b161-46b5-9ffb-0a0d3f608881") : object "kube-system"/"original-pull-secret" not registered Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079702 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d0871a8a-1c3b-473f-8845-dcc783210854-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.082100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079708 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b673936d-2921-478e-b86b-0b5d848874b4-multus-daemon-config\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.082922 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.079706 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-systemd\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.082922 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.080012 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b673936d-2921-478e-b86b-0b5d848874b4-cni-binary-copy\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.082922 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.081461 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b881a9c5-0572-4255-b8f8-63cb06d5c107-etc-tuned\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.082922 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.081481 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b881a9c5-0572-4255-b8f8-63cb06d5c107-tmp\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.082922 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.082648 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6667edff-458f-44e4-b82b-a434ede9a795-ovn-node-metrics-cert\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.083156 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.083110 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5723186-ee58-4ca9-937f-60a78d5a4d04-agent-certs\") pod \"konnectivity-agent-5cfkb\" (UID: \"d5723186-ee58-4ca9-937f-60a78d5a4d04\") " pod="kube-system/konnectivity-agent-5cfkb" Jun 15 05:47:30.087010 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.086985 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5x2k\" (UniqueName: \"kubernetes.io/projected/e08f6162-b5b3-4beb-af7c-0b23b0635346-kube-api-access-n5x2k\") pod \"network-metrics-daemon-hx8xj\" (UID: \"e08f6162-b5b3-4beb-af7c-0b23b0635346\") " pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:30.087563 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.087541 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96zpd\" (UniqueName: \"kubernetes.io/projected/b673936d-2921-478e-b86b-0b5d848874b4-kube-api-access-96zpd\") pod \"multus-hbff2\" (UID: \"b673936d-2921-478e-b86b-0b5d848874b4\") " pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.087638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.087541 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhvkn\" (UniqueName: \"kubernetes.io/projected/b881a9c5-0572-4255-b8f8-63cb06d5c107-kube-api-access-fhvkn\") pod \"tuned-84c6n\" (UID: \"b881a9c5-0572-4255-b8f8-63cb06d5c107\") " pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.088247 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.088224 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgj2v\" (UniqueName: \"kubernetes.io/projected/6667edff-458f-44e4-b82b-a434ede9a795-kube-api-access-lgj2v\") pod \"ovnkube-node-h6dj8\" (UID: \"6667edff-458f-44e4-b82b-a434ede9a795\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.180138 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180099 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d0871a8a-1c3b-473f-8845-dcc783210854-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.180322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180148 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0871a8a-1c3b-473f-8845-dcc783210854-os-release\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.180322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180171 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0871a8a-1c3b-473f-8845-dcc783210854-tuning-conf-dir\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.180322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180193 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-sys-fs\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.180322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180226 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0871a8a-1c3b-473f-8845-dcc783210854-cnibin\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.180322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180245 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0871a8a-1c3b-473f-8845-dcc783210854-cni-binary-copy\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.180322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180263 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0871a8a-1c3b-473f-8845-dcc783210854-os-release\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.180322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180268 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-device-dir\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.180322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180312 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-device-dir\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.180322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180316 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-sys-fs\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180327 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-etc-selinux\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180384 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-etc-selinux\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180397 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0871a8a-1c3b-473f-8845-dcc783210854-system-cni-dir\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180449 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-registration-dir\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180478 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/607f39f7-4e69-48b8-9127-b5d6fa14681c-hosts-file\") pod \"node-resolver-vkl6p\" (UID: \"607f39f7-4e69-48b8-9127-b5d6fa14681c\") " pod="openshift-dns/node-resolver-vkl6p" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180502 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/607f39f7-4e69-48b8-9127-b5d6fa14681c-tmp-dir\") pod \"node-resolver-vkl6p\" (UID: \"607f39f7-4e69-48b8-9127-b5d6fa14681c\") " pod="openshift-dns/node-resolver-vkl6p" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180528 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm8lb\" (UniqueName: \"kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb\") pod \"network-check-target-twc9d\" (UID: \"7087d934-a825-4c23-9848-4742b1151be7\") " pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180555 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvh84\" (UniqueName: \"kubernetes.io/projected/385e0bfa-0d96-489b-a1f3-c83f3ac0066f-kube-api-access-kvh84\") pod \"node-ca-kwpd4\" (UID: \"385e0bfa-0d96-489b-a1f3-c83f3ac0066f\") " pod="openshift-image-registry/node-ca-kwpd4" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180563 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0871a8a-1c3b-473f-8845-dcc783210854-system-cni-dir\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180587 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/09340711-a3a9-4ef3-b0fb-e57e83099d88-iptables-alerter-script\") pod \"iptables-alerter-kspwz\" (UID: \"09340711-a3a9-4ef3-b0fb-e57e83099d88\") " pod="openshift-network-operator/iptables-alerter-kspwz" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180611 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/385e0bfa-0d96-489b-a1f3-c83f3ac0066f-serviceca\") pod \"node-ca-kwpd4\" (UID: \"385e0bfa-0d96-489b-a1f3-c83f3ac0066f\") " pod="openshift-image-registry/node-ca-kwpd4" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180641 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d0871a8a-1c3b-473f-8845-dcc783210854-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180673 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5dqd\" (UniqueName: \"kubernetes.io/projected/d0871a8a-1c3b-473f-8845-dcc783210854-kube-api-access-d5dqd\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180697 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-socket-dir\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180726 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180755 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09340711-a3a9-4ef3-b0fb-e57e83099d88-host-slash\") pod \"iptables-alerter-kspwz\" (UID: \"09340711-a3a9-4ef3-b0fb-e57e83099d88\") " pod="openshift-network-operator/iptables-alerter-kspwz" Jun 15 05:47:30.180790 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180779 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f97p\" (UniqueName: \"kubernetes.io/projected/09340711-a3a9-4ef3-b0fb-e57e83099d88-kube-api-access-6f97p\") pod \"iptables-alerter-kspwz\" (UID: \"09340711-a3a9-4ef3-b0fb-e57e83099d88\") " pod="openshift-network-operator/iptables-alerter-kspwz" Jun 15 05:47:30.181539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180801 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/385e0bfa-0d96-489b-a1f3-c83f3ac0066f-host\") pod \"node-ca-kwpd4\" (UID: \"385e0bfa-0d96-489b-a1f3-c83f3ac0066f\") " pod="openshift-image-registry/node-ca-kwpd4" Jun 15 05:47:30.181539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180527 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-registration-dir\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.181539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180844 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/607f39f7-4e69-48b8-9127-b5d6fa14681c-tmp-dir\") pod \"node-resolver-vkl6p\" (UID: \"607f39f7-4e69-48b8-9127-b5d6fa14681c\") " pod="openshift-dns/node-resolver-vkl6p" Jun 15 05:47:30.181539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180855 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sv6j\" (UniqueName: \"kubernetes.io/projected/bfbd9b06-f7ea-4191-a985-92c518bef82e-kube-api-access-8sv6j\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.181539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180450 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0871a8a-1c3b-473f-8845-dcc783210854-cnibin\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.181539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180882 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q4dg\" (UniqueName: \"kubernetes.io/projected/607f39f7-4e69-48b8-9127-b5d6fa14681c-kube-api-access-7q4dg\") pod \"node-resolver-vkl6p\" (UID: \"607f39f7-4e69-48b8-9127-b5d6fa14681c\") " pod="openshift-dns/node-resolver-vkl6p" Jun 15 05:47:30.181539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180924 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d0871a8a-1c3b-473f-8845-dcc783210854-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.181539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180933 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0871a8a-1c3b-473f-8845-dcc783210854-cni-binary-copy\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.181539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.181019 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09340711-a3a9-4ef3-b0fb-e57e83099d88-host-slash\") pod \"iptables-alerter-kspwz\" (UID: \"09340711-a3a9-4ef3-b0fb-e57e83099d88\") " pod="openshift-network-operator/iptables-alerter-kspwz" Jun 15 05:47:30.181539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.181065 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-socket-dir\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.181539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.181080 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bfbd9b06-f7ea-4191-a985-92c518bef82e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.181539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.181127 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/385e0bfa-0d96-489b-a1f3-c83f3ac0066f-host\") pod \"node-ca-kwpd4\" (UID: \"385e0bfa-0d96-489b-a1f3-c83f3ac0066f\") " pod="openshift-image-registry/node-ca-kwpd4" Jun 15 05:47:30.181539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180586 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0871a8a-1c3b-473f-8845-dcc783210854-tuning-conf-dir\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.181539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.180911 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/607f39f7-4e69-48b8-9127-b5d6fa14681c-hosts-file\") pod \"node-resolver-vkl6p\" (UID: \"607f39f7-4e69-48b8-9127-b5d6fa14681c\") " pod="openshift-dns/node-resolver-vkl6p" Jun 15 05:47:30.181951 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.181656 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/09340711-a3a9-4ef3-b0fb-e57e83099d88-iptables-alerter-script\") pod \"iptables-alerter-kspwz\" (UID: \"09340711-a3a9-4ef3-b0fb-e57e83099d88\") " pod="openshift-network-operator/iptables-alerter-kspwz" Jun 15 05:47:30.181951 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.181700 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d0871a8a-1c3b-473f-8845-dcc783210854-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.181951 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.181727 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/385e0bfa-0d96-489b-a1f3-c83f3ac0066f-serviceca\") pod \"node-ca-kwpd4\" (UID: \"385e0bfa-0d96-489b-a1f3-c83f3ac0066f\") " pod="openshift-image-registry/node-ca-kwpd4" Jun 15 05:47:30.187034 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:30.186937 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 05:47:30.187034 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:30.186982 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 05:47:30.187034 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:30.187005 2586 projected.go:196] Error preparing data for projected volume kube-api-access-pm8lb for pod openshift-network-diagnostics/network-check-target-twc9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 05:47:30.187227 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:30.187125 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb podName:7087d934-a825-4c23-9848-4742b1151be7 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:30.687102516 +0000 UTC m=+3.131468300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pm8lb" (UniqueName: "kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb") pod "network-check-target-twc9d" (UID: "7087d934-a825-4c23-9848-4742b1151be7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 05:47:30.190172 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.190134 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5dqd\" (UniqueName: \"kubernetes.io/projected/d0871a8a-1c3b-473f-8845-dcc783210854-kube-api-access-d5dqd\") pod \"multus-additional-cni-plugins-224th\" (UID: \"d0871a8a-1c3b-473f-8845-dcc783210854\") " pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.190308 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.190224 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvh84\" (UniqueName: \"kubernetes.io/projected/385e0bfa-0d96-489b-a1f3-c83f3ac0066f-kube-api-access-kvh84\") pod \"node-ca-kwpd4\" (UID: \"385e0bfa-0d96-489b-a1f3-c83f3ac0066f\") " pod="openshift-image-registry/node-ca-kwpd4" Jun 15 05:47:30.190457 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.190383 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sv6j\" (UniqueName: \"kubernetes.io/projected/bfbd9b06-f7ea-4191-a985-92c518bef82e-kube-api-access-8sv6j\") pod \"aws-ebs-csi-driver-node-n2qxz\" (UID: \"bfbd9b06-f7ea-4191-a985-92c518bef82e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.190690 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.190669 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q4dg\" (UniqueName: \"kubernetes.io/projected/607f39f7-4e69-48b8-9127-b5d6fa14681c-kube-api-access-7q4dg\") pod \"node-resolver-vkl6p\" (UID: \"607f39f7-4e69-48b8-9127-b5d6fa14681c\") " pod="openshift-dns/node-resolver-vkl6p" Jun 15 05:47:30.192052 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.192031 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f97p\" (UniqueName: \"kubernetes.io/projected/09340711-a3a9-4ef3-b0fb-e57e83099d88-kube-api-access-6f97p\") pod \"iptables-alerter-kspwz\" (UID: \"09340711-a3a9-4ef3-b0fb-e57e83099d88\") " pod="openshift-network-operator/iptables-alerter-kspwz" Jun 15 05:47:30.208359 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.208323 2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 05:47:30.271611 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.271549 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-84c6n" Jun 15 05:47:30.281035 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.281011 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hbff2" Jun 15 05:47:30.288925 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.288901 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:30.293639 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.293619 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5cfkb" Jun 15 05:47:30.301318 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.301295 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-224th" Jun 15 05:47:30.307956 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.307926 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vkl6p" Jun 15 05:47:30.317638 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.317617 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" Jun 15 05:47:30.326178 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.326153 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kwpd4" Jun 15 05:47:30.333769 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.333746 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kspwz" Jun 15 05:47:30.582550 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.582462 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs\") pod \"network-metrics-daemon-hx8xj\" (UID: \"e08f6162-b5b3-4beb-af7c-0b23b0635346\") " pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:30.582710 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.582555 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret\") pod \"global-pull-secret-syncer-gq488\" (UID: \"451d8df0-b161-46b5-9ffb-0a0d3f608881\") " pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:30.582710 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:30.582632 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 05:47:30.582710 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:30.582655 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 05:47:30.582862 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:30.582719 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret podName:451d8df0-b161-46b5-9ffb-0a0d3f608881 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:31.582701282 +0000 UTC m=+4.027067067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret") pod "global-pull-secret-syncer-gq488" (UID: "451d8df0-b161-46b5-9ffb-0a0d3f608881") : object "kube-system"/"original-pull-secret" not registered Jun 15 05:47:30.582862 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:30.582740 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs podName:e08f6162-b5b3-4beb-af7c-0b23b0635346 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:31.582730478 +0000 UTC m=+4.027096262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs") pod "network-metrics-daemon-hx8xj" (UID: "e08f6162-b5b3-4beb-af7c-0b23b0635346") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 05:47:30.784051 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.784013 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm8lb\" (UniqueName: \"kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb\") pod \"network-check-target-twc9d\" (UID: \"7087d934-a825-4c23-9848-4742b1151be7\") " pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:30.784281 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:30.784159 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 05:47:30.784281 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:30.784182 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 05:47:30.784281 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:30.784196 2586 projected.go:196] Error preparing data for projected volume kube-api-access-pm8lb for pod openshift-network-diagnostics/network-check-target-twc9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 05:47:30.784281 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:30.784258 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb podName:7087d934-a825-4c23-9848-4742b1151be7 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:31.78423923 +0000 UTC m=+4.228605028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pm8lb" (UniqueName: "kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb") pod "network-check-target-twc9d" (UID: "7087d934-a825-4c23-9848-4742b1151be7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 05:47:30.928820 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:30.928729 2586 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 05:47:31.009622 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:31.009557 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 05:42:30 +0000 UTC" deadline="2027-11-28 19:55:11.739825047 +0000 UTC" Jun 15 05:47:31.009622 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:31.009614 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12758h7m40.730215369s" Jun 15 05:47:31.039072 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:31.039032 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:31.039254 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:31.039181 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:47:31.112745 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:31.112552 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0871a8a_1c3b_473f_8845_dcc783210854.slice/crio-63c76ab62413b4726a39c4fe09d16e7c151255548987c54bab8282a19b1a6e3b WatchSource:0}: Error finding container 63c76ab62413b4726a39c4fe09d16e7c151255548987c54bab8282a19b1a6e3b: Status 404 returned error can't find the container with id 63c76ab62413b4726a39c4fe09d16e7c151255548987c54bab8282a19b1a6e3b Jun 15 05:47:31.115640 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:31.115607 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb881a9c5_0572_4255_b8f8_63cb06d5c107.slice/crio-5cfda622cb2cd008a9ab7d547c2a76f049711525523e3fa302b6f785dc47b4c9 WatchSource:0}: Error finding container 5cfda622cb2cd008a9ab7d547c2a76f049711525523e3fa302b6f785dc47b4c9: Status 404 returned error can't find the container with id 5cfda622cb2cd008a9ab7d547c2a76f049711525523e3fa302b6f785dc47b4c9 Jun 15 05:47:31.116996 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:31.116976 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb673936d_2921_478e_b86b_0b5d848874b4.slice/crio-1c292094b26055a70c683debb215d4b294454971a05c99f36b797367e8d3a64b WatchSource:0}: Error finding container 1c292094b26055a70c683debb215d4b294454971a05c99f36b797367e8d3a64b: Status 404 returned error can't find the container with id 1c292094b26055a70c683debb215d4b294454971a05c99f36b797367e8d3a64b Jun 15 05:47:31.117834 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:31.117773 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09340711_a3a9_4ef3_b0fb_e57e83099d88.slice/crio-66cfd6ca9dd296fd8f23b084598a7c2e7d32cdc61d2a7dfdb99ef7ff223add85 WatchSource:0}: Error finding container 66cfd6ca9dd296fd8f23b084598a7c2e7d32cdc61d2a7dfdb99ef7ff223add85: Status 404 returned error can't find the container with id 66cfd6ca9dd296fd8f23b084598a7c2e7d32cdc61d2a7dfdb99ef7ff223add85 Jun 15 05:47:31.119443 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:31.119391 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5723186_ee58_4ca9_937f_60a78d5a4d04.slice/crio-b38a7cffc325367e6944b83f9bfe114c296952ace92ceda69316d22d96f1bdfc WatchSource:0}: Error finding container b38a7cffc325367e6944b83f9bfe114c296952ace92ceda69316d22d96f1bdfc: Status 404 returned error can't find the container with id b38a7cffc325367e6944b83f9bfe114c296952ace92ceda69316d22d96f1bdfc Jun 15 05:47:31.121335 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:31.121306 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6667edff_458f_44e4_b82b_a434ede9a795.slice/crio-a76131b6ec4634cd844701865bb5176059cd9b4b950c29ef277a5cc2da3a6bc7 WatchSource:0}: Error finding container a76131b6ec4634cd844701865bb5176059cd9b4b950c29ef277a5cc2da3a6bc7: Status 404 returned error can't find the container with id a76131b6ec4634cd844701865bb5176059cd9b4b950c29ef277a5cc2da3a6bc7 Jun 15 05:47:31.122778 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:31.122719 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod385e0bfa_0d96_489b_a1f3_c83f3ac0066f.slice/crio-3b1eb94301cba3cb2280b4b7b8d7f84fb6d1680667c4f6f446c1c13e23087c90 WatchSource:0}: Error finding container 3b1eb94301cba3cb2280b4b7b8d7f84fb6d1680667c4f6f446c1c13e23087c90: Status 404 returned error can't find the container with id 3b1eb94301cba3cb2280b4b7b8d7f84fb6d1680667c4f6f446c1c13e23087c90 Jun 15 05:47:31.124062 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:31.124037 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfbd9b06_f7ea_4191_a985_92c518bef82e.slice/crio-9b9e36ace8d72af19d1e1a3ae95bec76d303e2d1ad79023dc97bac1edfb88a58 WatchSource:0}: Error finding container 9b9e36ace8d72af19d1e1a3ae95bec76d303e2d1ad79023dc97bac1edfb88a58: Status 404 returned error can't find the container with id 9b9e36ace8d72af19d1e1a3ae95bec76d303e2d1ad79023dc97bac1edfb88a58 Jun 15 05:47:31.125346 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:47:31.125325 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607f39f7_4e69_48b8_9127_b5d6fa14681c.slice/crio-5ab15bb77688ce58c5361acbe13374b90c39919decf6308c99e017c32901637f WatchSource:0}: Error finding container 5ab15bb77688ce58c5361acbe13374b90c39919decf6308c99e017c32901637f: Status 404 returned error can't find the container with id 5ab15bb77688ce58c5361acbe13374b90c39919decf6308c99e017c32901637f Jun 15 05:47:31.590443 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:31.589721 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret\") pod \"global-pull-secret-syncer-gq488\" (UID: \"451d8df0-b161-46b5-9ffb-0a0d3f608881\") " pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:31.590443 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:31.589774 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs\") pod \"network-metrics-daemon-hx8xj\" (UID: \"e08f6162-b5b3-4beb-af7c-0b23b0635346\") " pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:31.590443 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:31.589922 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 05:47:31.590443 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:31.589982 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs podName:e08f6162-b5b3-4beb-af7c-0b23b0635346 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:33.589964739 +0000 UTC m=+6.034330525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs") pod "network-metrics-daemon-hx8xj" (UID: "e08f6162-b5b3-4beb-af7c-0b23b0635346") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 05:47:31.590443 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:31.590349 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 05:47:31.590443 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:31.590391 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret podName:451d8df0-b161-46b5-9ffb-0a0d3f608881 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:33.590377286 +0000 UTC m=+6.034743073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret") pod "global-pull-secret-syncer-gq488" (UID: "451d8df0-b161-46b5-9ffb-0a0d3f608881") : object "kube-system"/"original-pull-secret" not registered Jun 15 05:47:31.791744 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:31.791047 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm8lb\" (UniqueName: \"kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb\") pod \"network-check-target-twc9d\" (UID: \"7087d934-a825-4c23-9848-4742b1151be7\") " pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:31.791744 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:31.791244 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 05:47:31.791744 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:31.791267 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 05:47:31.791744 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:31.791283 2586 projected.go:196] Error preparing data for projected volume kube-api-access-pm8lb for pod openshift-network-diagnostics/network-check-target-twc9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 05:47:31.791744 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:31.791342 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb podName:7087d934-a825-4c23-9848-4742b1151be7 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:33.791325213 +0000 UTC m=+6.235691002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pm8lb" (UniqueName: "kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb") pod "network-check-target-twc9d" (UID: "7087d934-a825-4c23-9848-4742b1151be7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 05:47:32.010492 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.010446 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 05:42:30 +0000 UTC" deadline="2028-02-12 16:52:46.314202847 +0000 UTC" Jun 15 05:47:32.010492 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.010490 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14579h5m14.303717672s" Jun 15 05:47:32.039681 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.038927 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:32.039681 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:32.039060 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:47:32.039681 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.039539 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:32.039681 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:32.039642 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:47:32.077928 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.077840 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vkl6p" event={"ID":"607f39f7-4e69-48b8-9127-b5d6fa14681c","Type":"ContainerStarted","Data":"5ab15bb77688ce58c5361acbe13374b90c39919decf6308c99e017c32901637f"} Jun 15 05:47:32.084316 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.082107 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" event={"ID":"bfbd9b06-f7ea-4191-a985-92c518bef82e","Type":"ContainerStarted","Data":"9b9e36ace8d72af19d1e1a3ae95bec76d303e2d1ad79023dc97bac1edfb88a58"} Jun 15 05:47:32.084479 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.084451 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" event={"ID":"6667edff-458f-44e4-b82b-a434ede9a795","Type":"ContainerStarted","Data":"a76131b6ec4634cd844701865bb5176059cd9b4b950c29ef277a5cc2da3a6bc7"} Jun 15 05:47:32.088776 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.088749 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5cfkb" event={"ID":"d5723186-ee58-4ca9-937f-60a78d5a4d04","Type":"ContainerStarted","Data":"b38a7cffc325367e6944b83f9bfe114c296952ace92ceda69316d22d96f1bdfc"} Jun 15 05:47:32.098889 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.098860 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kspwz" event={"ID":"09340711-a3a9-4ef3-b0fb-e57e83099d88","Type":"ContainerStarted","Data":"66cfd6ca9dd296fd8f23b084598a7c2e7d32cdc61d2a7dfdb99ef7ff223add85"} Jun 15 05:47:32.109839 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.109805 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hbff2" event={"ID":"b673936d-2921-478e-b86b-0b5d848874b4","Type":"ContainerStarted","Data":"1c292094b26055a70c683debb215d4b294454971a05c99f36b797367e8d3a64b"} Jun 15 05:47:32.117348 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.117317 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-84c6n" event={"ID":"b881a9c5-0572-4255-b8f8-63cb06d5c107","Type":"ContainerStarted","Data":"5cfda622cb2cd008a9ab7d547c2a76f049711525523e3fa302b6f785dc47b4c9"} Jun 15 05:47:32.136291 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.134484 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" event={"ID":"d9e068ea74451873cf30d8effd17b743","Type":"ContainerStarted","Data":"1baba0c4994a430b4a98123215df300f111f5ceec833845957dffe0c4b9cd36f"} Jun 15 05:47:32.146146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.145884 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kwpd4" event={"ID":"385e0bfa-0d96-489b-a1f3-c83f3ac0066f","Type":"ContainerStarted","Data":"3b1eb94301cba3cb2280b4b7b8d7f84fb6d1680667c4f6f446c1c13e23087c90"} Jun 15 05:47:32.150838 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.150778 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-224th" event={"ID":"d0871a8a-1c3b-473f-8845-dcc783210854","Type":"ContainerStarted","Data":"63c76ab62413b4726a39c4fe09d16e7c151255548987c54bab8282a19b1a6e3b"} Jun 15 05:47:32.154975 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.154341 2586 generic.go:356] "Generic (PLEG): container finished" podID="e5a6d474b71b6fc751f82cbcd5d9988f" containerID="d7915b007390995db6c416a0b0b50fcd67b6eae7db0bc7429ad9feaeefecffd3" exitCode=0 Jun 15 05:47:32.154975 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.154379 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" event={"ID":"e5a6d474b71b6fc751f82cbcd5d9988f","Type":"ContainerDied","Data":"d7915b007390995db6c416a0b0b50fcd67b6eae7db0bc7429ad9feaeefecffd3"} Jun 15 05:47:32.157331 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:32.157261 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" podStartSLOduration=3.157245214 podStartE2EDuration="3.157245214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:47:32.15627463 +0000 UTC m=+4.600640438" watchObservedRunningTime="2026-06-15 05:47:32.157245214 +0000 UTC m=+4.601611013" Jun 15 05:47:33.038919 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:33.038879 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:33.039377 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:33.039003 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:47:33.175766 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:33.175702 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" event={"ID":"e5a6d474b71b6fc751f82cbcd5d9988f","Type":"ContainerStarted","Data":"61a9b3fbd06e93744e18a8eb97f75adc483079153291ef6bde02b02fcba5b059"} Jun 15 05:47:33.605895 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:33.605854 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret\") pod \"global-pull-secret-syncer-gq488\" (UID: \"451d8df0-b161-46b5-9ffb-0a0d3f608881\") " pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:33.606067 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:33.605917 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs\") pod \"network-metrics-daemon-hx8xj\" (UID: \"e08f6162-b5b3-4beb-af7c-0b23b0635346\") " pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:33.606067 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:33.606058 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 05:47:33.606196 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:33.606120 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs podName:e08f6162-b5b3-4beb-af7c-0b23b0635346 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:37.606101401 +0000 UTC m=+10.050467192 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs") pod "network-metrics-daemon-hx8xj" (UID: "e08f6162-b5b3-4beb-af7c-0b23b0635346") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 05:47:33.606564 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:33.606543 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 05:47:33.606649 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:33.606599 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret podName:451d8df0-b161-46b5-9ffb-0a0d3f608881 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:37.606583826 +0000 UTC m=+10.050949616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret") pod "global-pull-secret-syncer-gq488" (UID: "451d8df0-b161-46b5-9ffb-0a0d3f608881") : object "kube-system"/"original-pull-secret" not registered Jun 15 05:47:33.807603 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:33.807566 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm8lb\" (UniqueName: \"kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb\") pod \"network-check-target-twc9d\" (UID: \"7087d934-a825-4c23-9848-4742b1151be7\") " pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:33.807787 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:33.807746 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 05:47:33.807787 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:33.807768 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 05:47:33.807787 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:33.807780 2586 projected.go:196] Error preparing data for projected volume kube-api-access-pm8lb for pod openshift-network-diagnostics/network-check-target-twc9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 05:47:33.807939 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:33.807839 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb podName:7087d934-a825-4c23-9848-4742b1151be7 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:37.807820907 +0000 UTC m=+10.252186695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pm8lb" (UniqueName: "kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb") pod "network-check-target-twc9d" (UID: "7087d934-a825-4c23-9848-4742b1151be7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 05:47:34.039652 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:34.039562 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:34.040088 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:34.039714 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:47:34.040203 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:34.040165 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:34.040294 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:34.040266 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:47:35.039927 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:35.039408 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:35.039927 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:35.039556 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:47:36.039821 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:36.039257 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:36.039821 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:36.039402 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:47:36.039821 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:36.039450 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:36.039821 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:36.039612 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:47:37.039845 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:37.039354 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:37.039845 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:37.039485 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:47:37.640843 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:37.640804 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret\") pod \"global-pull-secret-syncer-gq488\" (UID: \"451d8df0-b161-46b5-9ffb-0a0d3f608881\") " pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:37.641007 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:37.640858 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs\") pod \"network-metrics-daemon-hx8xj\" (UID: \"e08f6162-b5b3-4beb-af7c-0b23b0635346\") " pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:37.641007 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:37.640949 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 05:47:37.641007 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:37.640968 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 05:47:37.641141 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:37.641016 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret podName:451d8df0-b161-46b5-9ffb-0a0d3f608881 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:45.641000811 +0000 UTC m=+18.085366596 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret") pod "global-pull-secret-syncer-gq488" (UID: "451d8df0-b161-46b5-9ffb-0a0d3f608881") : object "kube-system"/"original-pull-secret" not registered Jun 15 05:47:37.641141 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:37.641031 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs podName:e08f6162-b5b3-4beb-af7c-0b23b0635346 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:45.641024752 +0000 UTC m=+18.085390536 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs") pod "network-metrics-daemon-hx8xj" (UID: "e08f6162-b5b3-4beb-af7c-0b23b0635346") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 05:47:37.842805 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:37.842769 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm8lb\" (UniqueName: \"kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb\") pod \"network-check-target-twc9d\" (UID: \"7087d934-a825-4c23-9848-4742b1151be7\") " pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:37.843029 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:37.842978 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 05:47:37.843029 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:37.843004 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 05:47:37.843029 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:37.843017 2586 projected.go:196] Error preparing data for projected volume kube-api-access-pm8lb for pod openshift-network-diagnostics/network-check-target-twc9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 05:47:37.843188 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:37.843074 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb podName:7087d934-a825-4c23-9848-4742b1151be7 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:45.843056518 +0000 UTC m=+18.287422321 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pm8lb" (UniqueName: "kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb") pod "network-check-target-twc9d" (UID: "7087d934-a825-4c23-9848-4742b1151be7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 05:47:38.039601 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:38.039527 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:38.040544 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:38.040508 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:47:38.040982 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:38.040653 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:38.041089 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:38.041059 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:47:39.038947 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:39.038911 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:39.039117 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:39.039056 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:47:40.043575 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:40.042900 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:40.043575 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:40.043026 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:47:40.043575 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:40.043407 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:40.043575 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:40.043527 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:47:41.039535 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:41.039076 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:41.039535 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:41.039201 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:47:42.039359 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:42.039278 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:42.039359 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:42.039317 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:42.039844 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:42.039463 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:47:42.039844 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:42.039498 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:47:43.038918 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:43.038882 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:43.039105 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:43.039019 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:47:44.039688 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:44.039646 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:44.040134 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:44.039669 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:44.040134 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:44.039794 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:47:44.040134 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:44.039932 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:47:45.039134 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:45.039093 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:45.039327 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:45.039222 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:47:45.700900 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:45.700854 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs\") pod \"network-metrics-daemon-hx8xj\" (UID: \"e08f6162-b5b3-4beb-af7c-0b23b0635346\") " pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:45.701295 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:45.700964 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret\") pod \"global-pull-secret-syncer-gq488\" (UID: \"451d8df0-b161-46b5-9ffb-0a0d3f608881\") " pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:45.701295 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:45.701010 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 05:47:45.701295 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:45.701052 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 05:47:45.701295 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:45.701082 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs podName:e08f6162-b5b3-4beb-af7c-0b23b0635346 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:01.70106212 +0000 UTC m=+34.145427908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs") pod "network-metrics-daemon-hx8xj" (UID: "e08f6162-b5b3-4beb-af7c-0b23b0635346") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 05:47:45.701295 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:45.701100 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret podName:451d8df0-b161-46b5-9ffb-0a0d3f608881 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:01.701088801 +0000 UTC m=+34.145454584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret") pod "global-pull-secret-syncer-gq488" (UID: "451d8df0-b161-46b5-9ffb-0a0d3f608881") : object "kube-system"/"original-pull-secret" not registered Jun 15 05:47:45.902772 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:45.902730 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm8lb\" (UniqueName: \"kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb\") pod \"network-check-target-twc9d\" (UID: \"7087d934-a825-4c23-9848-4742b1151be7\") " pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:45.902936 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:45.902914 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 05:47:45.902988 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:45.902943 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 05:47:45.902988 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:45.902956 2586 projected.go:196] Error preparing data for projected volume kube-api-access-pm8lb for pod openshift-network-diagnostics/network-check-target-twc9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 05:47:45.903071 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:45.903022 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb podName:7087d934-a825-4c23-9848-4742b1151be7 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:01.90300168 +0000 UTC m=+34.347367484 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pm8lb" (UniqueName: "kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb") pod "network-check-target-twc9d" (UID: "7087d934-a825-4c23-9848-4742b1151be7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 05:47:46.039979 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:46.039451 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:46.039979 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:46.039479 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:46.039979 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:46.039585 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:47:46.039979 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:46.039704 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:47:47.039789 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:47.039743 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:47.040331 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:47.039872 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:47:48.040145 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:48.039660 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:48.040145 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:48.039790 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:47:48.040145 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:48.039844 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:48.040145 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:48.039942 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:47:49.038797 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:49.038760 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:49.038957 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:49.038888 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:47:50.041793 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.041768 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:50.042190 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:50.041911 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:47:50.042360 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.042337 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:50.042491 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:50.042469 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:47:50.216191 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.215746 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vkl6p" event={"ID":"607f39f7-4e69-48b8-9127-b5d6fa14681c","Type":"ContainerStarted","Data":"b550569d9bb75d1a1319fb0e00fd1046d0c6c1f31db5b661ecc3b18ec8e83e47"} Jun 15 05:47:50.221596 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.219161 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" event={"ID":"bfbd9b06-f7ea-4191-a985-92c518bef82e","Type":"ContainerStarted","Data":"a1c925ecb301dee8e29cad0e98e6d6d6f003748a0aeba298e6c57213aa667837"} Jun 15 05:47:50.222153 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.222122 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" event={"ID":"6667edff-458f-44e4-b82b-a434ede9a795","Type":"ContainerStarted","Data":"4cb1027d42f5694d9b121a8200a00f0fd6e9f58ba1f9ae66059516f3a741de69"} Jun 15 05:47:50.222271 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.222218 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" event={"ID":"6667edff-458f-44e4-b82b-a434ede9a795","Type":"ContainerStarted","Data":"4c04468288579675d939f81cdd4b2ed60b5d3b2db410ccc5bfaab77f802f78c1"} Jun 15 05:47:50.224133 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.224105 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5cfkb" event={"ID":"d5723186-ee58-4ca9-937f-60a78d5a4d04","Type":"ContainerStarted","Data":"71167052761c46b0172b73e9527a4ca3d918098fadc610aa40b7da4ded03197f"} Jun 15 05:47:50.226746 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.226608 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hbff2" event={"ID":"b673936d-2921-478e-b86b-0b5d848874b4","Type":"ContainerStarted","Data":"6efb80a55b356a2e97403085a25789c7739c9c8b1e7ba01ab5c11c2849d3807e"} Jun 15 05:47:50.233568 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.232984 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-84c6n" event={"ID":"b881a9c5-0572-4255-b8f8-63cb06d5c107","Type":"ContainerStarted","Data":"5a67af07ce89b201b61a2aa0ad7025a09b18a8e4a1e6e4c4cb252a22388cd9ac"} Jun 15 05:47:50.233692 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.233592 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" podStartSLOduration=21.233576752 podStartE2EDuration="21.233576752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:47:33.193853823 +0000 UTC m=+5.638219712" watchObservedRunningTime="2026-06-15 05:47:50.233576752 +0000 UTC m=+22.677942559" Jun 15 05:47:50.237225 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.237193 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kwpd4" event={"ID":"385e0bfa-0d96-489b-a1f3-c83f3ac0066f","Type":"ContainerStarted","Data":"6b21e88cbefd7f04765173910493b976d9d44d251d83a19ee4005e50389cb991"} Jun 15 05:47:50.239065 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.239044 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-224th" event={"ID":"d0871a8a-1c3b-473f-8845-dcc783210854","Type":"ContainerStarted","Data":"49a41dc108b67b35b54608221d9354ea112553dd2f7f41a22bd3e0fa5acf0374"} Jun 15 05:47:50.263709 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.263642 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-84c6n" podStartSLOduration=3.465467398 podStartE2EDuration="22.263623102s" totalImagesPullingTime="18.798155704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:47:50.263389644 +0000 UTC m=+22.707755453" watchObservedRunningTime="2026-06-15 05:47:50.263623102 +0000 UTC m=+22.707988918" Jun 15 05:47:50.263845 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.263808 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vkl6p" podStartSLOduration=3.761779074 podStartE2EDuration="22.263797601s" totalImagesPullingTime="18.502018527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:47:50.235146536 +0000 UTC m=+22.679512341" watchObservedRunningTime="2026-06-15 05:47:50.263797601 +0000 UTC m=+22.708163410" Jun 15 05:47:50.293007 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.292967 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hbff2" podStartSLOduration=3.434114432 podStartE2EDuration="22.292951044s" totalImagesPullingTime="18.858836612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:47:50.292844305 +0000 UTC m=+22.737210112" watchObservedRunningTime="2026-06-15 05:47:50.292951044 +0000 UTC m=+22.737316849" Jun 15 05:47:50.320189 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.320141 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5cfkb" podStartSLOduration=11.837000202 podStartE2EDuration="22.320125268s" totalImagesPullingTime="10.483125066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:47:50.319497191 +0000 UTC m=+22.763863017" watchObservedRunningTime="2026-06-15 05:47:50.320125268 +0000 UTC m=+22.764491073" Jun 15 05:47:50.358907 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:50.358840 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kwpd4" podStartSLOduration=3.852925558 podStartE2EDuration="22.358819776s" totalImagesPullingTime="18.505894218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:47:50.35854538 +0000 UTC m=+22.802911187" watchObservedRunningTime="2026-06-15 05:47:50.358819776 +0000 UTC m=+22.803185584" Jun 15 05:47:51.039593 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:51.039566 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:51.039703 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:51.039682 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:47:51.128500 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:51.128470 2586 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 15 05:47:51.243200 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:51.243120 2586 generic.go:356] "Generic (PLEG): container finished" podID="d0871a8a-1c3b-473f-8845-dcc783210854" containerID="49a41dc108b67b35b54608221d9354ea112553dd2f7f41a22bd3e0fa5acf0374" exitCode=0 Jun 15 05:47:51.243200 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:51.243183 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-224th" event={"ID":"d0871a8a-1c3b-473f-8845-dcc783210854","Type":"ContainerDied","Data":"49a41dc108b67b35b54608221d9354ea112553dd2f7f41a22bd3e0fa5acf0374"} Jun 15 05:47:51.244960 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:51.244934 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" event={"ID":"bfbd9b06-f7ea-4191-a985-92c518bef82e","Type":"ContainerStarted","Data":"2913853b2f8d750c985fb5ce0710abb3dd81fc61d1e9f879d485b6f861bb9286"} Jun 15 05:47:51.247858 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:51.247829 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" event={"ID":"6667edff-458f-44e4-b82b-a434ede9a795","Type":"ContainerStarted","Data":"ab4e59474d259d2fdce20df269d941f50783fe33065b8dff2df22feaa6dbf89b"} Jun 15 05:47:51.247962 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:51.247900 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" event={"ID":"6667edff-458f-44e4-b82b-a434ede9a795","Type":"ContainerStarted","Data":"5ebcedabfb804a6477fef5149839c50513f2f0ad7a60dbc5f2c498a503cb1dc4"} Jun 15 05:47:51.247962 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:51.247934 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" event={"ID":"6667edff-458f-44e4-b82b-a434ede9a795","Type":"ContainerStarted","Data":"6e7137d9875635182d6847ae5f9884117303dac6afc8293d0e8b5e469a8fc3ea"} Jun 15 05:47:51.248029 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:51.247971 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" event={"ID":"6667edff-458f-44e4-b82b-a434ede9a795","Type":"ContainerStarted","Data":"9ca8b547c3aa67289a79359e6cb313f5bae6278d463a299a2e0e4efc64961f73"} Jun 15 05:47:52.034744 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:52.034471 2586 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T05:47:51.12849664Z","UUID":"de88a126-70e9-4e85-8922-572aaabe8670","Handler":null,"Name":"","Endpoint":""} Jun 15 05:47:52.036552 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:52.036528 2586 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 15 05:47:52.036664 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:52.036572 2586 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 15 05:47:52.038853 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:52.038822 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:52.038853 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:52.038837 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:52.038990 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:52.038944 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:47:52.039092 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:52.039073 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:47:52.252268 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:52.252182 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" event={"ID":"bfbd9b06-f7ea-4191-a985-92c518bef82e","Type":"ContainerStarted","Data":"efe1565c4af478327e16a7d311c740ac4ab3edc1a186cf00dd7819a1716ae26e"} Jun 15 05:47:52.253826 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:52.253804 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kspwz" event={"ID":"09340711-a3a9-4ef3-b0fb-e57e83099d88","Type":"ContainerStarted","Data":"bf9ebc14dcb33d8e63558f83b2dae7f0e7c735929cd76302fdb10d978d6b20d9"} Jun 15 05:47:52.272757 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:52.272688 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2qxz" podStartSLOduration=4.104596379 podStartE2EDuration="24.272671384s" totalImagesPullingTime="20.168075005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:47:52.271590106 +0000 UTC m=+24.715955913" watchObservedRunningTime="2026-06-15 05:47:52.272671384 +0000 UTC m=+24.717037189" Jun 15 05:47:52.383703 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:52.383670 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5cfkb" Jun 15 05:47:53.039107 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:53.039077 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:53.039284 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:53.039185 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:47:53.259520 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:53.259443 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" event={"ID":"6667edff-458f-44e4-b82b-a434ede9a795","Type":"ContainerStarted","Data":"6a1e7ba75b662b7e91f63283afda6f6f0b7afc13c905c35e7d8010e315b5e554"} Jun 15 05:47:53.995709 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:53.995661 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5cfkb" Jun 15 05:47:53.996241 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:53.996222 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5cfkb" Jun 15 05:47:54.016578 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:54.016523 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kspwz" podStartSLOduration=11.274209975 podStartE2EDuration="26.016503543s" totalImagesPullingTime="14.742293568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:47:52.287255879 +0000 UTC m=+24.731621685" watchObservedRunningTime="2026-06-15 05:47:54.016503543 +0000 UTC m=+26.460869351" Jun 15 05:47:54.038955 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:54.038916 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:54.039117 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:54.039060 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:47:54.039224 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:54.038916 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:54.039350 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:54.039330 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:47:54.262243 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:54.262168 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5cfkb" Jun 15 05:47:55.039168 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:55.039079 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:55.039343 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:55.039211 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:47:56.039462 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:56.038981 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:56.039462 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:56.039325 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:47:56.039462 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:56.039007 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:56.039462 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:56.039444 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:47:56.269535 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:56.269443 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" event={"ID":"6667edff-458f-44e4-b82b-a434ede9a795","Type":"ContainerStarted","Data":"0d6fa86168837f8f4a0bbab5c7c45f66cd592e04a1adceb0ba5ff37b0c2a5c57"} Jun 15 05:47:56.269794 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:56.269770 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:56.269882 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:56.269834 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:56.269882 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:56.269878 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:56.271574 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:56.271550 2586 generic.go:356] "Generic (PLEG): container finished" podID="d0871a8a-1c3b-473f-8845-dcc783210854" containerID="8c06ccc69ffc6b23f12f489be86358ef6a008bddf3643b147956a690f2ac1621" exitCode=0 Jun 15 05:47:56.271662 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:56.271582 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-224th" event={"ID":"d0871a8a-1c3b-473f-8845-dcc783210854","Type":"ContainerDied","Data":"8c06ccc69ffc6b23f12f489be86358ef6a008bddf3643b147956a690f2ac1621"} Jun 15 05:47:56.286402 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:56.286378 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:56.286552 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:56.286540 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:47:56.298895 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:56.298855 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" podStartSLOduration=9.449841428 podStartE2EDuration="28.298841472s" totalImagesPullingTime="18.849000044s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:47:56.298358524 +0000 UTC m=+28.742724330" watchObservedRunningTime="2026-06-15 05:47:56.298841472 +0000 UTC m=+28.743207277" Jun 15 05:47:57.038850 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:57.038808 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:57.039054 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:57.038944 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:47:57.936681 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:57.936599 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gq488"] Jun 15 05:47:57.937144 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:57.936716 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:57.937144 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:57.936808 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:47:57.939160 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:57.939125 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-twc9d"] Jun 15 05:47:57.939266 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:57.939220 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:47:57.939436 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:57.939320 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:47:57.942836 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:57.942813 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hx8xj"] Jun 15 05:47:57.942943 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:57.942913 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:47:57.943033 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:57.943015 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:47:58.278029 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:58.277941 2586 generic.go:356] "Generic (PLEG): container finished" podID="d0871a8a-1c3b-473f-8845-dcc783210854" containerID="ba56131b411667fef515011decc53f965059156ddad24b81704118bf2cde82c2" exitCode=0 Jun 15 05:47:58.278171 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:58.278024 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-224th" event={"ID":"d0871a8a-1c3b-473f-8845-dcc783210854","Type":"ContainerDied","Data":"ba56131b411667fef515011decc53f965059156ddad24b81704118bf2cde82c2"} Jun 15 05:47:59.039167 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:59.038746 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:47:59.039167 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:47:59.039115 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:47:59.283450 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:59.283362 2586 generic.go:356] "Generic (PLEG): container finished" podID="d0871a8a-1c3b-473f-8845-dcc783210854" containerID="853f3d2bd1d68f9135935dcdcd094873b8e2144da3a6acce9408fdb1e6549f45" exitCode=0 Jun 15 05:47:59.283450 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:47:59.283399 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-224th" event={"ID":"d0871a8a-1c3b-473f-8845-dcc783210854","Type":"ContainerDied","Data":"853f3d2bd1d68f9135935dcdcd094873b8e2144da3a6acce9408fdb1e6549f45"} Jun 15 05:48:00.039443 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:00.039333 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:48:00.039443 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:00.039384 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:48:00.040106 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:00.039492 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:48:00.040106 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:00.039635 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:48:01.039192 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:01.039109 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:48:01.039368 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:01.039217 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gq488" podUID="451d8df0-b161-46b5-9ffb-0a0d3f608881" Jun 15 05:48:01.724435 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:01.724376 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret\") pod \"global-pull-secret-syncer-gq488\" (UID: \"451d8df0-b161-46b5-9ffb-0a0d3f608881\") " pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:48:01.724847 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:01.724453 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs\") pod \"network-metrics-daemon-hx8xj\" (UID: \"e08f6162-b5b3-4beb-af7c-0b23b0635346\") " pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:48:01.724847 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:01.724536 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 05:48:01.724847 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:01.724553 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 05:48:01.724847 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:01.724607 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs podName:e08f6162-b5b3-4beb-af7c-0b23b0635346 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:33.724589151 +0000 UTC m=+66.168954935 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs") pod "network-metrics-daemon-hx8xj" (UID: "e08f6162-b5b3-4beb-af7c-0b23b0635346") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 05:48:01.724847 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:01.724623 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret podName:451d8df0-b161-46b5-9ffb-0a0d3f608881 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:33.724615868 +0000 UTC m=+66.168981658 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret") pod "global-pull-secret-syncer-gq488" (UID: "451d8df0-b161-46b5-9ffb-0a0d3f608881") : object "kube-system"/"original-pull-secret" not registered Jun 15 05:48:01.926644 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:01.926608 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm8lb\" (UniqueName: \"kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb\") pod \"network-check-target-twc9d\" (UID: \"7087d934-a825-4c23-9848-4742b1151be7\") " pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:48:01.926936 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:01.926901 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 05:48:01.927003 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:01.926942 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 05:48:01.927003 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:01.926953 2586 projected.go:196] Error preparing data for projected volume kube-api-access-pm8lb for pod openshift-network-diagnostics/network-check-target-twc9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 05:48:01.927107 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:01.927007 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb podName:7087d934-a825-4c23-9848-4742b1151be7 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:33.926993607 +0000 UTC m=+66.371359395 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pm8lb" (UniqueName: "kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb") pod "network-check-target-twc9d" (UID: "7087d934-a825-4c23-9848-4742b1151be7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 05:48:02.039242 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.039155 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:48:02.039406 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:02.039270 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twc9d" podUID="7087d934-a825-4c23-9848-4742b1151be7" Jun 15 05:48:02.039406 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.039293 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:48:02.039520 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:02.039414 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:48:02.860637 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.860548 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeReady" Jun 15 05:48:02.861212 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.860694 2586 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 15 05:48:02.899220 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.899186 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f47d5dc5c-nvs96"] Jun 15 05:48:02.930791 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.930763 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h9zkf"] Jun 15 05:48:02.931553 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.931531 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:02.934075 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.934051 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 15 05:48:02.934195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.934078 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 15 05:48:02.934195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.934119 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g2hj5\"" Jun 15 05:48:02.934195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.934143 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 15 05:48:02.940633 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.940512 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 15 05:48:02.948835 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.948815 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bldd9"] Jun 15 05:48:02.948965 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.948947 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:02.951507 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.951488 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 15 05:48:02.951507 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.951498 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 15 05:48:02.951658 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.951581 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5mfr5\"" Jun 15 05:48:02.967101 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.967078 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f47d5dc5c-nvs96"] Jun 15 05:48:02.967218 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.967100 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bldd9" Jun 15 05:48:02.967218 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.967114 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h9zkf"] Jun 15 05:48:02.967218 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.967137 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bldd9"] Jun 15 05:48:02.969733 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.969714 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 15 05:48:02.969733 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.969726 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 15 05:48:02.969883 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.969815 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8pttw\"" Jun 15 05:48:02.969972 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:02.969955 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 15 05:48:03.033679 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.033647 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhbvz\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-kube-api-access-mhbvz\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.033861 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.033692 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a528d398-c858-4dd2-be98-3a6fc9422529-tmp-dir\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:03.033861 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.033754 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a528d398-c858-4dd2-be98-3a6fc9422529-config-volume\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:03.033861 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.033777 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b541e040-366d-498b-8e5a-353e5860e633-ca-trust-extracted\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.033861 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.033795 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.033861 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.033842 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b541e040-366d-498b-8e5a-353e5860e633-registry-certificates\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.034077 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.033884 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b541e040-366d-498b-8e5a-353e5860e633-image-registry-private-configuration\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.034077 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.033914 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b541e040-366d-498b-8e5a-353e5860e633-installation-pull-secrets\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.034077 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.033963 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b541e040-366d-498b-8e5a-353e5860e633-trusted-ca\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.034077 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.034014 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-bound-sa-token\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.034077 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.034054 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:03.034077 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.034070 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d829k\" (UniqueName: \"kubernetes.io/projected/a528d398-c858-4dd2-be98-3a6fc9422529-kube-api-access-d829k\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:03.039723 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.039703 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:48:03.042298 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.042279 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 05:48:03.075625 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.075589 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:03.134591 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.134498 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a528d398-c858-4dd2-be98-3a6fc9422529-config-volume\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:03.134591 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.134561 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b541e040-366d-498b-8e5a-353e5860e633-ca-trust-extracted\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.134811 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.134594 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.134811 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.134620 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b541e040-366d-498b-8e5a-353e5860e633-registry-certificates\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.134811 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.134653 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b541e040-366d-498b-8e5a-353e5860e633-image-registry-private-configuration\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.134811 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.134679 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b541e040-366d-498b-8e5a-353e5860e633-installation-pull-secrets\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.134811 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.134724 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b541e040-366d-498b-8e5a-353e5860e633-trusted-ca\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.134811 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.134749 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-bound-sa-token\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.134811 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.134781 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:03.134811 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.134807 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d829k\" (UniqueName: \"kubernetes.io/projected/a528d398-c858-4dd2-be98-3a6fc9422529-kube-api-access-d829k\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:03.135195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.134836 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2314ceb2-1069-49a2-b197-5417e717b4c6-cert\") pod \"ingress-canary-bldd9\" (UID: \"2314ceb2-1069-49a2-b197-5417e717b4c6\") " pod="openshift-ingress-canary/ingress-canary-bldd9" Jun 15 05:48:03.135195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.134897 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnk7t\" (UniqueName: \"kubernetes.io/projected/2314ceb2-1069-49a2-b197-5417e717b4c6-kube-api-access-jnk7t\") pod \"ingress-canary-bldd9\" (UID: \"2314ceb2-1069-49a2-b197-5417e717b4c6\") " pod="openshift-ingress-canary/ingress-canary-bldd9" Jun 15 05:48:03.135195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.134927 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbvz\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-kube-api-access-mhbvz\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.135195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.134963 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a528d398-c858-4dd2-be98-3a6fc9422529-tmp-dir\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:03.135195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.135006 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b541e040-366d-498b-8e5a-353e5860e633-ca-trust-extracted\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.135195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.135139 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a528d398-c858-4dd2-be98-3a6fc9422529-config-volume\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:03.135493 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.135253 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a528d398-c858-4dd2-be98-3a6fc9422529-tmp-dir\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:03.135493 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:03.135260 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 05:48:03.135493 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:03.135320 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls podName:a528d398-c858-4dd2-be98-3a6fc9422529 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:03.635299014 +0000 UTC m=+36.079664812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls") pod "dns-default-h9zkf" (UID: "a528d398-c858-4dd2-be98-3a6fc9422529") : secret "dns-default-metrics-tls" not found Jun 15 05:48:03.135493 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:03.135385 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 05:48:03.135493 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:03.135398 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f47d5dc5c-nvs96: secret "image-registry-tls" not found Jun 15 05:48:03.135493 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:03.135458 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls podName:b541e040-366d-498b-8e5a-353e5860e633 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:03.635446118 +0000 UTC m=+36.079811934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls") pod "image-registry-f47d5dc5c-nvs96" (UID: "b541e040-366d-498b-8e5a-353e5860e633") : secret "image-registry-tls" not found Jun 15 05:48:03.136305 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.135917 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b541e040-366d-498b-8e5a-353e5860e633-registry-certificates\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.137085 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.137064 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b541e040-366d-498b-8e5a-353e5860e633-trusted-ca\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.140332 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.140308 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b541e040-366d-498b-8e5a-353e5860e633-image-registry-private-configuration\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.140332 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.140327 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b541e040-366d-498b-8e5a-353e5860e633-installation-pull-secrets\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.149728 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.149706 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d829k\" (UniqueName: \"kubernetes.io/projected/a528d398-c858-4dd2-be98-3a6fc9422529-kube-api-access-d829k\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:03.150175 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.150149 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhbvz\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-kube-api-access-mhbvz\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.150934 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.150912 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-bound-sa-token\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.167412 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.167372 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:03.235442 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.235382 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2314ceb2-1069-49a2-b197-5417e717b4c6-cert\") pod \"ingress-canary-bldd9\" (UID: \"2314ceb2-1069-49a2-b197-5417e717b4c6\") " pod="openshift-ingress-canary/ingress-canary-bldd9" Jun 15 05:48:03.235625 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.235475 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnk7t\" (UniqueName: \"kubernetes.io/projected/2314ceb2-1069-49a2-b197-5417e717b4c6-kube-api-access-jnk7t\") pod \"ingress-canary-bldd9\" (UID: \"2314ceb2-1069-49a2-b197-5417e717b4c6\") " pod="openshift-ingress-canary/ingress-canary-bldd9" Jun 15 05:48:03.238352 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.238324 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2314ceb2-1069-49a2-b197-5417e717b4c6-cert\") pod \"ingress-canary-bldd9\" (UID: \"2314ceb2-1069-49a2-b197-5417e717b4c6\") " pod="openshift-ingress-canary/ingress-canary-bldd9" Jun 15 05:48:03.245841 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.245800 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnk7t\" (UniqueName: \"kubernetes.io/projected/2314ceb2-1069-49a2-b197-5417e717b4c6-kube-api-access-jnk7t\") pod \"ingress-canary-bldd9\" (UID: \"2314ceb2-1069-49a2-b197-5417e717b4c6\") " pod="openshift-ingress-canary/ingress-canary-bldd9" Jun 15 05:48:03.277733 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.277693 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bldd9" Jun 15 05:48:03.638076 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.638044 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:03.638260 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.638100 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:03.638260 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:03.638212 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 05:48:03.638260 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:03.638220 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 05:48:03.638260 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:03.638246 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f47d5dc5c-nvs96: secret "image-registry-tls" not found Jun 15 05:48:03.638499 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:03.638278 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls podName:a528d398-c858-4dd2-be98-3a6fc9422529 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:04.638258377 +0000 UTC m=+37.082624161 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls") pod "dns-default-h9zkf" (UID: "a528d398-c858-4dd2-be98-3a6fc9422529") : secret "dns-default-metrics-tls" not found Jun 15 05:48:03.638499 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:03.638298 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls podName:b541e040-366d-498b-8e5a-353e5860e633 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:04.638285932 +0000 UTC m=+37.082651735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls") pod "image-registry-f47d5dc5c-nvs96" (UID: "b541e040-366d-498b-8e5a-353e5860e633") : secret "image-registry-tls" not found Jun 15 05:48:03.699702 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:03.699670 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:04.039262 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:04.039009 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:48:04.039262 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:04.039035 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:48:04.042989 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:04.042962 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 05:48:04.043286 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:04.043266 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 05:48:04.043356 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:04.043271 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 05:48:04.043961 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:04.043933 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8qp7w\"" Jun 15 05:48:04.044082 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:04.043949 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s8jdr\"" Jun 15 05:48:04.619352 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:04.619173 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bldd9"] Jun 15 05:48:04.647615 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:04.647577 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:04.647755 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:04.647642 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:04.647755 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:04.647700 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 05:48:04.647755 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:04.647719 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f47d5dc5c-nvs96: secret "image-registry-tls" not found Jun 15 05:48:04.647755 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:04.647745 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 05:48:04.647883 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:04.647775 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls podName:b541e040-366d-498b-8e5a-353e5860e633 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:06.647758483 +0000 UTC m=+39.092124267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls") pod "image-registry-f47d5dc5c-nvs96" (UID: "b541e040-366d-498b-8e5a-353e5860e633") : secret "image-registry-tls" not found Jun 15 05:48:04.647883 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:04.647791 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls podName:a528d398-c858-4dd2-be98-3a6fc9422529 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:06.647779746 +0000 UTC m=+39.092145531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls") pod "dns-default-h9zkf" (UID: "a528d398-c858-4dd2-be98-3a6fc9422529") : secret "dns-default-metrics-tls" not found Jun 15 05:48:04.689644 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:48:04.689605 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2314ceb2_1069_49a2_b197_5417e717b4c6.slice/crio-e4acd1de173a1e47ff5fed47c76ab6542ad98f587ae6c12e2b8d69f32fe9e580 WatchSource:0}: Error finding container e4acd1de173a1e47ff5fed47c76ab6542ad98f587ae6c12e2b8d69f32fe9e580: Status 404 returned error can't find the container with id e4acd1de173a1e47ff5fed47c76ab6542ad98f587ae6c12e2b8d69f32fe9e580 Jun 15 05:48:05.302666 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:05.302635 2586 generic.go:356] "Generic (PLEG): container finished" podID="d0871a8a-1c3b-473f-8845-dcc783210854" containerID="5a3c1bbfe800afddf579745e9814e0e5a43e83a1767389e579f5173954840412" exitCode=0 Jun 15 05:48:05.303135 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:05.302713 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-224th" event={"ID":"d0871a8a-1c3b-473f-8845-dcc783210854","Type":"ContainerDied","Data":"5a3c1bbfe800afddf579745e9814e0e5a43e83a1767389e579f5173954840412"} Jun 15 05:48:05.303912 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:05.303888 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bldd9" event={"ID":"2314ceb2-1069-49a2-b197-5417e717b4c6","Type":"ContainerStarted","Data":"e4acd1de173a1e47ff5fed47c76ab6542ad98f587ae6c12e2b8d69f32fe9e580"} Jun 15 05:48:06.310723 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:06.310673 2586 generic.go:356] "Generic (PLEG): container finished" podID="d0871a8a-1c3b-473f-8845-dcc783210854" containerID="ee233ee3dbe52934ec64cb416f672745a628f97d053a95bd32cdc83779d9a521" exitCode=0 Jun 15 05:48:06.310723 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:06.310723 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-224th" event={"ID":"d0871a8a-1c3b-473f-8845-dcc783210854","Type":"ContainerDied","Data":"ee233ee3dbe52934ec64cb416f672745a628f97d053a95bd32cdc83779d9a521"} Jun 15 05:48:06.663690 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:06.663660 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:06.663825 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:06.663743 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:06.663875 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:06.663845 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 05:48:06.663875 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:06.663865 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f47d5dc5c-nvs96: secret "image-registry-tls" not found Jun 15 05:48:06.663948 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:06.663895 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 05:48:06.663948 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:06.663925 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls podName:b541e040-366d-498b-8e5a-353e5860e633 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:10.663908672 +0000 UTC m=+43.108274462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls") pod "image-registry-f47d5dc5c-nvs96" (UID: "b541e040-366d-498b-8e5a-353e5860e633") : secret "image-registry-tls" not found Jun 15 05:48:06.663948 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:06.663942 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls podName:a528d398-c858-4dd2-be98-3a6fc9422529 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:10.663933818 +0000 UTC m=+43.108299602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls") pod "dns-default-h9zkf" (UID: "a528d398-c858-4dd2-be98-3a6fc9422529") : secret "dns-default-metrics-tls" not found Jun 15 05:48:07.316578 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:07.316542 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-224th" event={"ID":"d0871a8a-1c3b-473f-8845-dcc783210854","Type":"ContainerStarted","Data":"bdead873aaa8188ec1546482a343988f009318e343c0b1e70a320f247107a1e9"} Jun 15 05:48:07.317953 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:07.317930 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bldd9" event={"ID":"2314ceb2-1069-49a2-b197-5417e717b4c6","Type":"ContainerStarted","Data":"1d8539bf82fd104872b3b1c539169ee396497dd622f3616c64bada5c657ffcf9"} Jun 15 05:48:07.342335 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:07.342276 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-224th" podStartSLOduration=7.663478318 podStartE2EDuration="39.34226129s" totalImagesPullingTime="31.678782972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:07.341721152 +0000 UTC m=+39.786086982" watchObservedRunningTime="2026-06-15 05:48:07.34226129 +0000 UTC m=+39.786627095" Jun 15 05:48:07.359905 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:07.359861 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bldd9" podStartSLOduration=2.974693973 podStartE2EDuration="5.359846116s" totalImagesPullingTime="2.385152143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:07.359290199 +0000 UTC m=+39.803656038" watchObservedRunningTime="2026-06-15 05:48:07.359846116 +0000 UTC m=+39.804211922" Jun 15 05:48:07.475931 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:07.475860 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:07.533036 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:07.533012 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:07.996288 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:07.996255 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:08.053617 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:08.053583 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:09.826569 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:09.826539 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:09.925192 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:09.925161 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:10.024374 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:10.024342 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:10.693066 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:10.693025 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:10.693283 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:10.693082 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:10.693283 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:10.693187 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 05:48:10.693283 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:10.693195 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 05:48:10.693283 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:10.693217 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f47d5dc5c-nvs96: secret "image-registry-tls" not found Jun 15 05:48:10.693283 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:10.693238 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls podName:a528d398-c858-4dd2-be98-3a6fc9422529 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:18.693225237 +0000 UTC m=+51.137591022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls") pod "dns-default-h9zkf" (UID: "a528d398-c858-4dd2-be98-3a6fc9422529") : secret "dns-default-metrics-tls" not found Jun 15 05:48:10.693283 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:10.693271 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls podName:b541e040-366d-498b-8e5a-353e5860e633 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:18.693254178 +0000 UTC m=+51.137619976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls") pod "image-registry-f47d5dc5c-nvs96" (UID: "b541e040-366d-498b-8e5a-353e5860e633") : secret "image-registry-tls" not found Jun 15 05:48:11.779483 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:11.779405 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:11.880976 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:11.880942 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:11.933838 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:11.933808 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:12.476596 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:12.476557 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:12.574870 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:12.574831 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:15.854406 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:15.854369 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:15.955023 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:15.954988 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:17.314637 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:17.314606 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:17.368039 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:17.367984 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:18.755508 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:18.755465 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:18.755979 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:18.755658 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 05:48:18.755979 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:18.755676 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:18.755979 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:18.755732 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls podName:a528d398-c858-4dd2-be98-3a6fc9422529 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:34.755711016 +0000 UTC m=+67.200076805 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls") pod "dns-default-h9zkf" (UID: "a528d398-c858-4dd2-be98-3a6fc9422529") : secret "dns-default-metrics-tls" not found Jun 15 05:48:18.755979 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:18.755823 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 05:48:18.755979 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:18.755846 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f47d5dc5c-nvs96: secret "image-registry-tls" not found Jun 15 05:48:18.755979 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:18.755912 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls podName:b541e040-366d-498b-8e5a-353e5860e633 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:34.755889629 +0000 UTC m=+67.200255414 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls") pod "image-registry-f47d5dc5c-nvs96" (UID: "b541e040-366d-498b-8e5a-353e5860e633") : secret "image-registry-tls" not found Jun 15 05:48:21.257797 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:21.257757 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:22.094107 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:22.094076 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:22.195242 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:22.195214 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:25.919612 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:25.919575 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:26.020981 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:26.020939 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:27.640235 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:27.640202 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:27.720567 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:27.720534 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:28.289700 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:28.289671 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h6dj8" Jun 15 05:48:28.451821 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:28.451788 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:28.550856 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:28.550772 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:33.762745 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:33.762686 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret\") pod \"global-pull-secret-syncer-gq488\" (UID: \"451d8df0-b161-46b5-9ffb-0a0d3f608881\") " pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:48:33.762745 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:33.762757 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs\") pod \"network-metrics-daemon-hx8xj\" (UID: \"e08f6162-b5b3-4beb-af7c-0b23b0635346\") " pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:48:33.768287 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:33.768271 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 05:48:33.768342 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:33.768330 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 05:48:33.772899 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:33.772878 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 05:48:33.772971 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:33.772962 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs podName:e08f6162-b5b3-4beb-af7c-0b23b0635346 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:37.772942286 +0000 UTC m=+130.217308070 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs") pod "network-metrics-daemon-hx8xj" (UID: "e08f6162-b5b3-4beb-af7c-0b23b0635346") : secret "metrics-daemon-secret" not found Jun 15 05:48:33.776594 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:33.776578 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451d8df0-b161-46b5-9ffb-0a0d3f608881-original-pull-secret\") pod \"global-pull-secret-syncer-gq488\" (UID: \"451d8df0-b161-46b5-9ffb-0a0d3f608881\") " pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:48:33.950271 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:33.950225 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gq488" Jun 15 05:48:33.964530 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:33.964477 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm8lb\" (UniqueName: \"kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb\") pod \"network-check-target-twc9d\" (UID: \"7087d934-a825-4c23-9848-4742b1151be7\") " pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:48:33.967521 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:33.967501 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 05:48:33.977600 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:33.977573 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 05:48:33.987568 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:33.987540 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm8lb\" (UniqueName: \"kubernetes.io/projected/7087d934-a825-4c23-9848-4742b1151be7-kube-api-access-pm8lb\") pod \"network-check-target-twc9d\" (UID: \"7087d934-a825-4c23-9848-4742b1151be7\") " pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:48:34.062870 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:34.062841 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s8jdr\"" Jun 15 05:48:34.071056 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:34.071032 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:48:34.076868 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:34.076460 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gq488"] Jun 15 05:48:34.082701 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:48:34.082662 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod451d8df0_b161_46b5_9ffb_0a0d3f608881.slice/crio-466bb6139cc7bdf926b09c869ad8e2e431bfd2aca4a1c2415f1b0410f9d7b2f9 WatchSource:0}: Error finding container 466bb6139cc7bdf926b09c869ad8e2e431bfd2aca4a1c2415f1b0410f9d7b2f9: Status 404 returned error can't find the container with id 466bb6139cc7bdf926b09c869ad8e2e431bfd2aca4a1c2415f1b0410f9d7b2f9 Jun 15 05:48:34.217240 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:34.217208 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-twc9d"] Jun 15 05:48:34.220030 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:48:34.220001 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7087d934_a825_4c23_9848_4742b1151be7.slice/crio-37ec5574a2a4d374aced4567a119170dad7ac6a3c0dd419069724feceb1da76f WatchSource:0}: Error finding container 37ec5574a2a4d374aced4567a119170dad7ac6a3c0dd419069724feceb1da76f: Status 404 returned error can't find the container with id 37ec5574a2a4d374aced4567a119170dad7ac6a3c0dd419069724feceb1da76f Jun 15 05:48:34.380317 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:34.380223 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-twc9d" event={"ID":"7087d934-a825-4c23-9848-4742b1151be7","Type":"ContainerStarted","Data":"37ec5574a2a4d374aced4567a119170dad7ac6a3c0dd419069724feceb1da76f"} Jun 15 05:48:34.381322 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:34.381297 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gq488" event={"ID":"451d8df0-b161-46b5-9ffb-0a0d3f608881","Type":"ContainerStarted","Data":"466bb6139cc7bdf926b09c869ad8e2e431bfd2aca4a1c2415f1b0410f9d7b2f9"} Jun 15 05:48:34.770545 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:34.770500 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:48:34.771023 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:34.770565 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:48:34.771023 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:34.770670 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 05:48:34.771023 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:34.770681 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 05:48:34.771023 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:34.770707 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f47d5dc5c-nvs96: secret "image-registry-tls" not found Jun 15 05:48:34.771023 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:34.770733 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls podName:a528d398-c858-4dd2-be98-3a6fc9422529 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:06.770716195 +0000 UTC m=+99.215082004 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls") pod "dns-default-h9zkf" (UID: "a528d398-c858-4dd2-be98-3a6fc9422529") : secret "dns-default-metrics-tls" not found Jun 15 05:48:34.771023 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:48:34.770763 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls podName:b541e040-366d-498b-8e5a-353e5860e633 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:06.77074508 +0000 UTC m=+99.215110883 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls") pod "image-registry-f47d5dc5c-nvs96" (UID: "b541e040-366d-498b-8e5a-353e5860e633") : secret "image-registry-tls" not found Jun 15 05:48:38.394517 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:38.394484 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-twc9d" event={"ID":"7087d934-a825-4c23-9848-4742b1151be7","Type":"ContainerStarted","Data":"5401dc7b1eed051d6552514f13aa3ff5c16a3ac5dc7824e122d9ecb613022377"} Jun 15 05:48:38.395023 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:38.394630 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:48:38.414852 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:38.414798 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-twc9d" podStartSLOduration=67.112141614 podStartE2EDuration="1m10.414778574s" totalImagesPullingTime="3.30263696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:38.414518613 +0000 UTC m=+70.858884419" watchObservedRunningTime="2026-06-15 05:48:38.414778574 +0000 UTC m=+70.859144384" Jun 15 05:48:38.831755 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:38.831713 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:38.926945 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:38.926910 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:40.400983 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:40.400943 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gq488" event={"ID":"451d8df0-b161-46b5-9ffb-0a0d3f608881","Type":"ContainerStarted","Data":"cc4e032856e30029d58aa876cc20c107cf22182e3b8e1c2815559000e94deb47"} Jun 15 05:48:47.908743 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:47.908615 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:48:48.001511 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:48:48.001478 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:49:06.796648 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:49:06.796588 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:49:06.797130 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:49:06.796684 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:49:06.797130 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:49:06.796734 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 05:49:06.797130 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:49:06.796756 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f47d5dc5c-nvs96: secret "image-registry-tls" not found Jun 15 05:49:06.797130 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:49:06.796801 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 05:49:06.797130 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:49:06.796822 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls podName:b541e040-366d-498b-8e5a-353e5860e633 nodeName:}" failed. No retries permitted until 2026-06-15 05:50:10.796806842 +0000 UTC m=+163.241172625 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls") pod "image-registry-f47d5dc5c-nvs96" (UID: "b541e040-366d-498b-8e5a-353e5860e633") : secret "image-registry-tls" not found Jun 15 05:49:06.797130 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:49:06.796857 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls podName:a528d398-c858-4dd2-be98-3a6fc9422529 nodeName:}" failed. No retries permitted until 2026-06-15 05:50:10.796845585 +0000 UTC m=+163.241211369 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls") pod "dns-default-h9zkf" (UID: "a528d398-c858-4dd2-be98-3a6fc9422529") : secret "dns-default-metrics-tls" not found Jun 15 05:49:09.399351 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:49:09.399324 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-twc9d" Jun 15 05:49:09.424731 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:49:09.424686 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gq488" podStartSLOduration=95.933266056 podStartE2EDuration="1m41.424654071s" totalImagesPullingTime="5.491388015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:40.422402192 +0000 UTC m=+72.866768016" watchObservedRunningTime="2026-06-15 05:49:09.424654071 +0000 UTC m=+101.869019871" Jun 15 05:49:37.818562 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:49:37.818505 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs\") pod \"network-metrics-daemon-hx8xj\" (UID: \"e08f6162-b5b3-4beb-af7c-0b23b0635346\") " pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:49:37.819056 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:49:37.818664 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 05:49:37.819056 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:49:37.818736 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs podName:e08f6162-b5b3-4beb-af7c-0b23b0635346 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:39.818719413 +0000 UTC m=+252.263085198 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs") pod "network-metrics-daemon-hx8xj" (UID: "e08f6162-b5b3-4beb-af7c-0b23b0635346") : secret "metrics-daemon-secret" not found Jun 15 05:50:05.943851 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:50:05.943806 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" podUID="b541e040-366d-498b-8e5a-353e5860e633" Jun 15 05:50:05.958988 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:50:05.958951 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-h9zkf" podUID="a528d398-c858-4dd2-be98-3a6fc9422529" Jun 15 05:50:06.603388 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:50:06.603356 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:50:06.603388 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:50:06.603387 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h9zkf" Jun 15 05:50:07.053754 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:50:07.053706 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:50:10.849675 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:50:10.849613 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:50:10.849675 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:50:10.849687 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:50:10.850127 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:50:10.849776 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 05:50:10.850127 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:50:10.849841 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls podName:a528d398-c858-4dd2-be98-3a6fc9422529 nodeName:}" failed. No retries permitted until 2026-06-15 05:52:12.849824568 +0000 UTC m=+285.294190351 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls") pod "dns-default-h9zkf" (UID: "a528d398-c858-4dd2-be98-3a6fc9422529") : secret "dns-default-metrics-tls" not found Jun 15 05:50:10.850127 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:50:10.849782 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 05:50:10.850127 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:50:10.849876 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f47d5dc5c-nvs96: secret "image-registry-tls" not found Jun 15 05:50:10.850127 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:50:10.849937 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls podName:b541e040-366d-498b-8e5a-353e5860e633 nodeName:}" failed. No retries permitted until 2026-06-15 05:52:12.849923991 +0000 UTC m=+285.294289792 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls") pod "image-registry-f47d5dc5c-nvs96" (UID: "b541e040-366d-498b-8e5a-353e5860e633") : secret "image-registry-tls" not found Jun 15 05:50:22.038933 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:50:22.038840 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:51:01.269053 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:01.269021 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:31.995329 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:31.995293 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj"] Jun 15 05:51:31.997212 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:31.997189 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj" Jun 15 05:51:31.998296 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:31.998276 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-47jpt"] Jun 15 05:51:31.999864 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:31.999842 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 15 05:51:32.000029 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:31.999927 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:32.001191 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.001172 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 15 05:51:32.001569 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.001549 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-72hhk\"" Jun 15 05:51:32.001768 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.001744 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-rf87f"] Jun 15 05:51:32.002601 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.002583 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 15 05:51:32.002914 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.002898 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 15 05:51:32.003188 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.003172 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hzqnz\"" Jun 15 05:51:32.003443 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.003408 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 15 05:51:32.003522 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.003488 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.003678 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.003657 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 15 05:51:32.003934 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.003920 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 15 05:51:32.004673 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.004657 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 15 05:51:32.006018 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.005996 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 15 05:51:32.006111 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.006024 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 15 05:51:32.006111 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.006039 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 15 05:51:32.006233 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.006214 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 15 05:51:32.006292 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.006232 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hz9ng\"" Jun 15 05:51:32.010700 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.010678 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj"] Jun 15 05:51:32.011533 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.011510 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 15 05:51:32.012847 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.012827 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 15 05:51:32.014185 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.014165 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-47jpt"] Jun 15 05:51:32.020463 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.020437 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-rf87f"] Jun 15 05:51:32.095878 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.095842 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-cz27n"] Jun 15 05:51:32.097582 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.097561 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4"] Jun 15 05:51:32.097707 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.097688 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" Jun 15 05:51:32.099462 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.099440 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" Jun 15 05:51:32.100205 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.100185 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2vlm9\"" Jun 15 05:51:32.100366 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.100348 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 15 05:51:32.100799 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.100783 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-958db9c48-7c8vk"] Jun 15 05:51:32.101251 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.101236 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 15 05:51:32.101852 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.101833 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 15 05:51:32.101947 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.101900 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 15 05:51:32.102063 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.102047 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 15 05:51:32.102141 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.102125 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6m9s8\"" Jun 15 05:51:32.102339 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.102326 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:32.105603 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.105583 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 15 05:51:32.105704 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.105603 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 15 05:51:32.106316 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.106292 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 15 05:51:32.106472 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.106453 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 15 05:51:32.107078 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.107055 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 15 05:51:32.107169 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.107104 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 15 05:51:32.107226 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.107105 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-l4zzh\"" Jun 15 05:51:32.111567 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.111003 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ede4dc49-81e5-443d-a5a2-6d8e18cb51de-config\") pod \"service-ca-operator-7ccbfd59dc-pfvzj\" (UID: \"ede4dc49-81e5-443d-a5a2-6d8e18cb51de\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj" Jun 15 05:51:32.111567 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.111013 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-cz27n"] Jun 15 05:51:32.111567 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.111093 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrbns\" (UniqueName: \"kubernetes.io/projected/ede4dc49-81e5-443d-a5a2-6d8e18cb51de-kube-api-access-nrbns\") pod \"service-ca-operator-7ccbfd59dc-pfvzj\" (UID: \"ede4dc49-81e5-443d-a5a2-6d8e18cb51de\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj" Jun 15 05:51:32.111567 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.111134 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb5db5db-873d-45de-b051-b6afdc3f8563-trusted-ca\") pod \"console-operator-5dbbb5d744-47jpt\" (UID: \"eb5db5db-873d-45de-b051-b6afdc3f8563\") " pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:32.111567 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.111169 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xjbf\" (UniqueName: \"kubernetes.io/projected/eb5db5db-873d-45de-b051-b6afdc3f8563-kube-api-access-5xjbf\") pod \"console-operator-5dbbb5d744-47jpt\" (UID: \"eb5db5db-873d-45de-b051-b6afdc3f8563\") " pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:32.111567 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.111200 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb5db5db-873d-45de-b051-b6afdc3f8563-config\") pod \"console-operator-5dbbb5d744-47jpt\" (UID: \"eb5db5db-873d-45de-b051-b6afdc3f8563\") " pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:32.111567 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.111225 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb5db5db-873d-45de-b051-b6afdc3f8563-serving-cert\") pod \"console-operator-5dbbb5d744-47jpt\" (UID: \"eb5db5db-873d-45de-b051-b6afdc3f8563\") " pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:32.111567 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.111259 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/16423435-593d-4a83-9d74-75edb172923b-snapshots\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.111567 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.111286 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16423435-593d-4a83-9d74-75edb172923b-serving-cert\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.111567 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.111382 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ede4dc49-81e5-443d-a5a2-6d8e18cb51de-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-pfvzj\" (UID: \"ede4dc49-81e5-443d-a5a2-6d8e18cb51de\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj" Jun 15 05:51:32.111567 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.111472 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16423435-593d-4a83-9d74-75edb172923b-tmp\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.111567 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.111501 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vx7v\" (UniqueName: \"kubernetes.io/projected/16423435-593d-4a83-9d74-75edb172923b-kube-api-access-8vx7v\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.111567 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.111537 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16423435-593d-4a83-9d74-75edb172923b-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.112165 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.111635 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16423435-593d-4a83-9d74-75edb172923b-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.121819 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.121791 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4"] Jun 15 05:51:32.122622 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.122602 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-958db9c48-7c8vk"] Jun 15 05:51:32.192358 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.192325 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t"] Jun 15 05:51:32.194402 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.194386 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t" Jun 15 05:51:32.196854 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.196828 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 15 05:51:32.197078 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.196856 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 15 05:51:32.197078 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.196880 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zsbm6\"" Jun 15 05:51:32.197227 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.197173 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 15 05:51:32.197227 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.197186 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 15 05:51:32.203670 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.203649 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t"] Jun 15 05:51:32.212277 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212252 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ede4dc49-81e5-443d-a5a2-6d8e18cb51de-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-pfvzj\" (UID: \"ede4dc49-81e5-443d-a5a2-6d8e18cb51de\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj" Jun 15 05:51:32.212406 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212283 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdplm\" (UniqueName: \"kubernetes.io/projected/432b3548-a9e2-4861-a58f-50cc85ac1a84-kube-api-access-xdplm\") pod \"cluster-samples-operator-9547488fd-7wqc4\" (UID: \"432b3548-a9e2-4861-a58f-50cc85ac1a84\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" Jun 15 05:51:32.212406 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212303 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16423435-593d-4a83-9d74-75edb172923b-tmp\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.212406 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212320 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vx7v\" (UniqueName: \"kubernetes.io/projected/16423435-593d-4a83-9d74-75edb172923b-kube-api-access-8vx7v\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.212406 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212337 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16423435-593d-4a83-9d74-75edb172923b-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.212644 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212433 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:32.212644 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212477 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16423435-593d-4a83-9d74-75edb172923b-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.212644 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212537 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/458b7d17-e77f-4343-9178-644fa6ed65b4-nginx-conf\") pod \"networking-console-plugin-867b76cb74-cz27n\" (UID: \"458b7d17-e77f-4343-9178-644fa6ed65b4\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" Jun 15 05:51:32.212644 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212574 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-cz27n\" (UID: \"458b7d17-e77f-4343-9178-644fa6ed65b4\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" Jun 15 05:51:32.212644 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212603 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-stats-auth\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:32.212893 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212681 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16423435-593d-4a83-9d74-75edb172923b-tmp\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.212893 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212687 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ede4dc49-81e5-443d-a5a2-6d8e18cb51de-config\") pod \"service-ca-operator-7ccbfd59dc-pfvzj\" (UID: \"ede4dc49-81e5-443d-a5a2-6d8e18cb51de\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj" Jun 15 05:51:32.212893 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212724 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-7wqc4\" (UID: \"432b3548-a9e2-4861-a58f-50cc85ac1a84\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" Jun 15 05:51:32.212893 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212851 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrbns\" (UniqueName: \"kubernetes.io/projected/ede4dc49-81e5-443d-a5a2-6d8e18cb51de-kube-api-access-nrbns\") pod \"service-ca-operator-7ccbfd59dc-pfvzj\" (UID: \"ede4dc49-81e5-443d-a5a2-6d8e18cb51de\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj" Jun 15 05:51:32.212893 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212870 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9966s\" (UniqueName: \"kubernetes.io/projected/f19cd9f9-7da1-4505-99b0-b4b97d240670-kube-api-access-9966s\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:32.213133 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212896 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb5db5db-873d-45de-b051-b6afdc3f8563-trusted-ca\") pod \"console-operator-5dbbb5d744-47jpt\" (UID: \"eb5db5db-873d-45de-b051-b6afdc3f8563\") " pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:32.213133 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212919 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xjbf\" (UniqueName: \"kubernetes.io/projected/eb5db5db-873d-45de-b051-b6afdc3f8563-kube-api-access-5xjbf\") pod \"console-operator-5dbbb5d744-47jpt\" (UID: \"eb5db5db-873d-45de-b051-b6afdc3f8563\") " pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:32.213133 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.212953 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-default-certificate\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:32.213133 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.213056 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16423435-593d-4a83-9d74-75edb172923b-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.213133 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.213117 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb5db5db-873d-45de-b051-b6afdc3f8563-config\") pod \"console-operator-5dbbb5d744-47jpt\" (UID: \"eb5db5db-873d-45de-b051-b6afdc3f8563\") " pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:32.213363 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.213147 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16423435-593d-4a83-9d74-75edb172923b-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.213363 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.213170 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb5db5db-873d-45de-b051-b6afdc3f8563-serving-cert\") pod \"console-operator-5dbbb5d744-47jpt\" (UID: \"eb5db5db-873d-45de-b051-b6afdc3f8563\") " pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:32.213363 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.213211 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/16423435-593d-4a83-9d74-75edb172923b-snapshots\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.213363 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.213236 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16423435-593d-4a83-9d74-75edb172923b-serving-cert\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.213363 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.213266 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:32.213629 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.213483 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ede4dc49-81e5-443d-a5a2-6d8e18cb51de-config\") pod \"service-ca-operator-7ccbfd59dc-pfvzj\" (UID: \"ede4dc49-81e5-443d-a5a2-6d8e18cb51de\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj" Jun 15 05:51:32.213793 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.213773 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb5db5db-873d-45de-b051-b6afdc3f8563-config\") pod \"console-operator-5dbbb5d744-47jpt\" (UID: \"eb5db5db-873d-45de-b051-b6afdc3f8563\") " pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:32.213852 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.213827 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/16423435-593d-4a83-9d74-75edb172923b-snapshots\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.213890 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.213829 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb5db5db-873d-45de-b051-b6afdc3f8563-trusted-ca\") pod \"console-operator-5dbbb5d744-47jpt\" (UID: \"eb5db5db-873d-45de-b051-b6afdc3f8563\") " pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:32.215327 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.215301 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ede4dc49-81e5-443d-a5a2-6d8e18cb51de-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-pfvzj\" (UID: \"ede4dc49-81e5-443d-a5a2-6d8e18cb51de\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj" Jun 15 05:51:32.215630 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.215603 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16423435-593d-4a83-9d74-75edb172923b-serving-cert\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.215758 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.215742 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb5db5db-873d-45de-b051-b6afdc3f8563-serving-cert\") pod \"console-operator-5dbbb5d744-47jpt\" (UID: \"eb5db5db-873d-45de-b051-b6afdc3f8563\") " pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:32.223495 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.223470 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vx7v\" (UniqueName: \"kubernetes.io/projected/16423435-593d-4a83-9d74-75edb172923b-kube-api-access-8vx7v\") pod \"insights-operator-5bbd86d6bd-rf87f\" (UID: \"16423435-593d-4a83-9d74-75edb172923b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.225521 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.225497 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrbns\" (UniqueName: \"kubernetes.io/projected/ede4dc49-81e5-443d-a5a2-6d8e18cb51de-kube-api-access-nrbns\") pod \"service-ca-operator-7ccbfd59dc-pfvzj\" (UID: \"ede4dc49-81e5-443d-a5a2-6d8e18cb51de\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj" Jun 15 05:51:32.225840 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.225818 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xjbf\" (UniqueName: \"kubernetes.io/projected/eb5db5db-873d-45de-b051-b6afdc3f8563-kube-api-access-5xjbf\") pod \"console-operator-5dbbb5d744-47jpt\" (UID: \"eb5db5db-873d-45de-b051-b6afdc3f8563\") " pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:32.290236 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.290201 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:32.308134 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.308112 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj" Jun 15 05:51:32.313877 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.313856 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66629\" (UniqueName: \"kubernetes.io/projected/d4b20d67-802a-4a38-b55a-c98bb9bfa1a0-kube-api-access-66629\") pod \"kube-storage-version-migrator-operator-7c578b78fc-djl2t\" (UID: \"d4b20d67-802a-4a38-b55a-c98bb9bfa1a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t" Jun 15 05:51:32.313987 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.313886 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:32.313987 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.313912 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/458b7d17-e77f-4343-9178-644fa6ed65b4-nginx-conf\") pod \"networking-console-plugin-867b76cb74-cz27n\" (UID: \"458b7d17-e77f-4343-9178-644fa6ed65b4\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" Jun 15 05:51:32.313987 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.313934 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-cz27n\" (UID: \"458b7d17-e77f-4343-9178-644fa6ed65b4\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" Jun 15 05:51:32.313987 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.313952 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-stats-auth\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:32.314184 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.313988 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-7wqc4\" (UID: \"432b3548-a9e2-4861-a58f-50cc85ac1a84\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" Jun 15 05:51:32.314184 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:32.314025 2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 05:51:32.314184 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:32.314088 2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 05:51:32.314184 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:32.314105 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs podName:f19cd9f9-7da1-4505-99b0-b4b97d240670 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:32.814084944 +0000 UTC m=+245.258450743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs") pod "router-default-958db9c48-7c8vk" (UID: "f19cd9f9-7da1-4505-99b0-b4b97d240670") : secret "router-metrics-certs-default" not found Jun 15 05:51:32.314184 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:32.314130 2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 05:51:32.314477 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.314031 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9966s\" (UniqueName: \"kubernetes.io/projected/f19cd9f9-7da1-4505-99b0-b4b97d240670-kube-api-access-9966s\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:32.314477 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:32.314205 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls podName:432b3548-a9e2-4861-a58f-50cc85ac1a84 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:32.814189891 +0000 UTC m=+245.258555680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls") pod "cluster-samples-operator-9547488fd-7wqc4" (UID: "432b3548-a9e2-4861-a58f-50cc85ac1a84") : secret "samples-operator-tls" not found Jun 15 05:51:32.314477 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:32.314229 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert podName:458b7d17-e77f-4343-9178-644fa6ed65b4 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:32.814220478 +0000 UTC m=+245.258586264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-cz27n" (UID: "458b7d17-e77f-4343-9178-644fa6ed65b4") : secret "networking-console-plugin-cert" not found Jun 15 05:51:32.314477 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.314283 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-default-certificate\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:32.314477 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.314320 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4b20d67-802a-4a38-b55a-c98bb9bfa1a0-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-djl2t\" (UID: \"d4b20d67-802a-4a38-b55a-c98bb9bfa1a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t" Jun 15 05:51:32.314477 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.314368 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4b20d67-802a-4a38-b55a-c98bb9bfa1a0-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-djl2t\" (UID: \"d4b20d67-802a-4a38-b55a-c98bb9bfa1a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t" Jun 15 05:51:32.314477 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.314438 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:32.314839 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.314491 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdplm\" (UniqueName: \"kubernetes.io/projected/432b3548-a9e2-4861-a58f-50cc85ac1a84-kube-api-access-xdplm\") pod \"cluster-samples-operator-9547488fd-7wqc4\" (UID: \"432b3548-a9e2-4861-a58f-50cc85ac1a84\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" Jun 15 05:51:32.314839 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.314623 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/458b7d17-e77f-4343-9178-644fa6ed65b4-nginx-conf\") pod \"networking-console-plugin-867b76cb74-cz27n\" (UID: \"458b7d17-e77f-4343-9178-644fa6ed65b4\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" Jun 15 05:51:32.314839 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:32.314649 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle podName:f19cd9f9-7da1-4505-99b0-b4b97d240670 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:32.814633017 +0000 UTC m=+245.258998818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle") pod "router-default-958db9c48-7c8vk" (UID: "f19cd9f9-7da1-4505-99b0-b4b97d240670") : configmap references non-existent config key: service-ca.crt Jun 15 05:51:32.315852 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.315829 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:32.316928 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.316899 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-stats-auth\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:32.316928 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.316923 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-default-certificate\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:32.321117 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.320444 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" Jun 15 05:51:32.324129 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.324110 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9966s\" (UniqueName: \"kubernetes.io/projected/f19cd9f9-7da1-4505-99b0-b4b97d240670-kube-api-access-9966s\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:32.324738 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.324720 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdplm\" (UniqueName: \"kubernetes.io/projected/432b3548-a9e2-4861-a58f-50cc85ac1a84-kube-api-access-xdplm\") pod \"cluster-samples-operator-9547488fd-7wqc4\" (UID: \"432b3548-a9e2-4861-a58f-50cc85ac1a84\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" Jun 15 05:51:32.393367 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.393259 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:32.415915 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.415867 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4b20d67-802a-4a38-b55a-c98bb9bfa1a0-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-djl2t\" (UID: \"d4b20d67-802a-4a38-b55a-c98bb9bfa1a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t" Jun 15 05:51:32.416059 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.415932 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4b20d67-802a-4a38-b55a-c98bb9bfa1a0-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-djl2t\" (UID: \"d4b20d67-802a-4a38-b55a-c98bb9bfa1a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t" Jun 15 05:51:32.416059 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.416013 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66629\" (UniqueName: \"kubernetes.io/projected/d4b20d67-802a-4a38-b55a-c98bb9bfa1a0-kube-api-access-66629\") pod \"kube-storage-version-migrator-operator-7c578b78fc-djl2t\" (UID: \"d4b20d67-802a-4a38-b55a-c98bb9bfa1a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t" Jun 15 05:51:32.416783 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.416756 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4b20d67-802a-4a38-b55a-c98bb9bfa1a0-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-djl2t\" (UID: \"d4b20d67-802a-4a38-b55a-c98bb9bfa1a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t" Jun 15 05:51:32.418866 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.418847 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4b20d67-802a-4a38-b55a-c98bb9bfa1a0-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-djl2t\" (UID: \"d4b20d67-802a-4a38-b55a-c98bb9bfa1a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t" Jun 15 05:51:32.427652 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.427605 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66629\" (UniqueName: \"kubernetes.io/projected/d4b20d67-802a-4a38-b55a-c98bb9bfa1a0-kube-api-access-66629\") pod \"kube-storage-version-migrator-operator-7c578b78fc-djl2t\" (UID: \"d4b20d67-802a-4a38-b55a-c98bb9bfa1a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t" Jun 15 05:51:32.453658 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.453625 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj"] Jun 15 05:51:32.456778 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:51:32.456744 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede4dc49_81e5_443d_a5a2_6d8e18cb51de.slice/crio-720e9869d5e4c7ffc8ede1bb4bdbbae627a1896e74fe8a01e9dc40857059edf0 WatchSource:0}: Error finding container 720e9869d5e4c7ffc8ede1bb4bdbbae627a1896e74fe8a01e9dc40857059edf0: Status 404 returned error can't find the container with id 720e9869d5e4c7ffc8ede1bb4bdbbae627a1896e74fe8a01e9dc40857059edf0 Jun 15 05:51:32.503337 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.503294 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t" Jun 15 05:51:32.629606 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.629564 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t"] Jun 15 05:51:32.632065 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:51:32.632034 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b20d67_802a_4a38_b55a_c98bb9bfa1a0.slice/crio-4304d1a754cf238e883c8d393f965743db2d639bed1831f625b635b60a280523 WatchSource:0}: Error finding container 4304d1a754cf238e883c8d393f965743db2d639bed1831f625b635b60a280523: Status 404 returned error can't find the container with id 4304d1a754cf238e883c8d393f965743db2d639bed1831f625b635b60a280523 Jun 15 05:51:32.682284 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.682253 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-rf87f"] Jun 15 05:51:32.685105 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.685080 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-47jpt"] Jun 15 05:51:32.686117 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:51:32.686095 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16423435_593d_4a83_9d74_75edb172923b.slice/crio-ec972d0a4a694885582c6afbb5dbb43aae31c31b10dbd3513e101d36230bc907 WatchSource:0}: Error finding container ec972d0a4a694885582c6afbb5dbb43aae31c31b10dbd3513e101d36230bc907: Status 404 returned error can't find the container with id ec972d0a4a694885582c6afbb5dbb43aae31c31b10dbd3513e101d36230bc907 Jun 15 05:51:32.686998 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:51:32.686971 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb5db5db_873d_45de_b051_b6afdc3f8563.slice/crio-f58a725c48c1cb58085f252872112dbdd8345bc7f372c319eb308c0f60acbf5f WatchSource:0}: Error finding container f58a725c48c1cb58085f252872112dbdd8345bc7f372c319eb308c0f60acbf5f: Status 404 returned error can't find the container with id f58a725c48c1cb58085f252872112dbdd8345bc7f372c319eb308c0f60acbf5f Jun 15 05:51:32.806862 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.806779 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t" event={"ID":"d4b20d67-802a-4a38-b55a-c98bb9bfa1a0","Type":"ContainerStarted","Data":"4304d1a754cf238e883c8d393f965743db2d639bed1831f625b635b60a280523"} Jun 15 05:51:32.807879 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.807853 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj" event={"ID":"ede4dc49-81e5-443d-a5a2-6d8e18cb51de","Type":"ContainerStarted","Data":"720e9869d5e4c7ffc8ede1bb4bdbbae627a1896e74fe8a01e9dc40857059edf0"} Jun 15 05:51:32.808851 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.808832 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" event={"ID":"16423435-593d-4a83-9d74-75edb172923b","Type":"ContainerStarted","Data":"ec972d0a4a694885582c6afbb5dbb43aae31c31b10dbd3513e101d36230bc907"} Jun 15 05:51:32.809853 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.809826 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" event={"ID":"eb5db5db-873d-45de-b051-b6afdc3f8563","Type":"ContainerStarted","Data":"f58a725c48c1cb58085f252872112dbdd8345bc7f372c319eb308c0f60acbf5f"} Jun 15 05:51:32.819280 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.819247 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:32.819357 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.819292 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-cz27n\" (UID: \"458b7d17-e77f-4343-9178-644fa6ed65b4\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" Jun 15 05:51:32.819357 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.819322 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-7wqc4\" (UID: \"432b3548-a9e2-4861-a58f-50cc85ac1a84\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" Jun 15 05:51:32.819463 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:32.819368 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:32.819463 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:32.819392 2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 05:51:32.819463 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:32.819395 2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 05:51:32.819564 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:32.819474 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs podName:f19cd9f9-7da1-4505-99b0-b4b97d240670 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:33.819456285 +0000 UTC m=+246.263822072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs") pod "router-default-958db9c48-7c8vk" (UID: "f19cd9f9-7da1-4505-99b0-b4b97d240670") : secret "router-metrics-certs-default" not found Jun 15 05:51:32.819564 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:32.819494 2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 05:51:32.819564 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:32.819497 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle podName:f19cd9f9-7da1-4505-99b0-b4b97d240670 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:33.819482956 +0000 UTC m=+246.263848746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle") pod "router-default-958db9c48-7c8vk" (UID: "f19cd9f9-7da1-4505-99b0-b4b97d240670") : configmap references non-existent config key: service-ca.crt Jun 15 05:51:32.819564 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:32.819521 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert podName:458b7d17-e77f-4343-9178-644fa6ed65b4 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:33.819512378 +0000 UTC m=+246.263878167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-cz27n" (UID: "458b7d17-e77f-4343-9178-644fa6ed65b4") : secret "networking-console-plugin-cert" not found Jun 15 05:51:32.819564 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:32.819537 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls podName:432b3548-a9e2-4861-a58f-50cc85ac1a84 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:33.819527219 +0000 UTC m=+246.263893003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls") pod "cluster-samples-operator-9547488fd-7wqc4" (UID: "432b3548-a9e2-4861-a58f-50cc85ac1a84") : secret "samples-operator-tls" not found Jun 15 05:51:33.829914 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:33.829780 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-7wqc4\" (UID: \"432b3548-a9e2-4861-a58f-50cc85ac1a84\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" Jun 15 05:51:33.829914 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:33.829871 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:33.830469 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:33.829948 2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 05:51:33.830469 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:33.830019 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls podName:432b3548-a9e2-4861-a58f-50cc85ac1a84 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:35.829996404 +0000 UTC m=+248.274362194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls") pod "cluster-samples-operator-9547488fd-7wqc4" (UID: "432b3548-a9e2-4861-a58f-50cc85ac1a84") : secret "samples-operator-tls" not found Jun 15 05:51:33.830469 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:33.830052 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle podName:f19cd9f9-7da1-4505-99b0-b4b97d240670 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:35.830031578 +0000 UTC m=+248.274397374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle") pod "router-default-958db9c48-7c8vk" (UID: "f19cd9f9-7da1-4505-99b0-b4b97d240670") : configmap references non-existent config key: service-ca.crt Jun 15 05:51:33.830469 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:33.830112 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:33.830469 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:33.830161 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-cz27n\" (UID: \"458b7d17-e77f-4343-9178-644fa6ed65b4\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" Jun 15 05:51:33.830469 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:33.830271 2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 05:51:33.830469 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:33.830271 2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 05:51:33.830469 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:33.830316 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert podName:458b7d17-e77f-4343-9178-644fa6ed65b4 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:35.830304993 +0000 UTC m=+248.274670782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-cz27n" (UID: "458b7d17-e77f-4343-9178-644fa6ed65b4") : secret "networking-console-plugin-cert" not found Jun 15 05:51:33.830469 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:33.830332 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs podName:f19cd9f9-7da1-4505-99b0-b4b97d240670 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:35.830323773 +0000 UTC m=+248.274689581 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs") pod "router-default-958db9c48-7c8vk" (UID: "f19cd9f9-7da1-4505-99b0-b4b97d240670") : secret "router-metrics-certs-default" not found Jun 15 05:51:34.315756 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:34.315717 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:34.418806 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:34.418763 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:35.849313 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:35.849270 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:35.849778 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:35.849357 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:35.849778 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:35.849388 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-cz27n\" (UID: \"458b7d17-e77f-4343-9178-644fa6ed65b4\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" Jun 15 05:51:35.849778 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:35.849456 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-7wqc4\" (UID: \"432b3548-a9e2-4861-a58f-50cc85ac1a84\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" Jun 15 05:51:35.849778 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:35.849517 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle podName:f19cd9f9-7da1-4505-99b0-b4b97d240670 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:39.84949016 +0000 UTC m=+252.293855951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle") pod "router-default-958db9c48-7c8vk" (UID: "f19cd9f9-7da1-4505-99b0-b4b97d240670") : configmap references non-existent config key: service-ca.crt Jun 15 05:51:35.849778 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:35.849563 2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 05:51:35.849778 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:35.849626 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs podName:f19cd9f9-7da1-4505-99b0-b4b97d240670 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:39.849607464 +0000 UTC m=+252.293973254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs") pod "router-default-958db9c48-7c8vk" (UID: "f19cd9f9-7da1-4505-99b0-b4b97d240670") : secret "router-metrics-certs-default" not found Jun 15 05:51:35.849778 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:35.849567 2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 05:51:35.849778 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:35.849652 2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 05:51:35.849778 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:35.849680 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert podName:458b7d17-e77f-4343-9178-644fa6ed65b4 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:39.849669448 +0000 UTC m=+252.294035233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-cz27n" (UID: "458b7d17-e77f-4343-9178-644fa6ed65b4") : secret "networking-console-plugin-cert" not found Jun 15 05:51:35.849778 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:35.849709 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls podName:432b3548-a9e2-4861-a58f-50cc85ac1a84 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:39.849690178 +0000 UTC m=+252.294055965 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls") pod "cluster-samples-operator-9547488fd-7wqc4" (UID: "432b3548-a9e2-4861-a58f-50cc85ac1a84") : secret "samples-operator-tls" not found Jun 15 05:51:36.826247 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:36.826206 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" event={"ID":"16423435-593d-4a83-9d74-75edb172923b","Type":"ContainerStarted","Data":"dcb615773b5c9d83f0b0ff67b681acc1832ee35da3e114c53ca07ce04c5b238a"} Jun 15 05:51:36.827866 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:36.827844 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/0.log" Jun 15 05:51:36.827998 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:36.827882 2586 generic.go:356] "Generic (PLEG): container finished" podID="eb5db5db-873d-45de-b051-b6afdc3f8563" containerID="7959e651451bae2314fa1ddc3fbd412da37eec9d613f3ccf2a65ce3a9946a623" exitCode=255 Jun 15 05:51:36.827998 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:36.827981 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" event={"ID":"eb5db5db-873d-45de-b051-b6afdc3f8563","Type":"ContainerDied","Data":"7959e651451bae2314fa1ddc3fbd412da37eec9d613f3ccf2a65ce3a9946a623"} Jun 15 05:51:36.828205 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:36.828177 2586 scope.go:117] "RemoveContainer" containerID="7959e651451bae2314fa1ddc3fbd412da37eec9d613f3ccf2a65ce3a9946a623" Jun 15 05:51:36.829650 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:36.829622 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t" event={"ID":"d4b20d67-802a-4a38-b55a-c98bb9bfa1a0","Type":"ContainerStarted","Data":"076d893c528a20562d1535c506786680a4e28c8d1b72776e2eeca5a4492481fd"} Jun 15 05:51:36.831150 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:36.831126 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj" event={"ID":"ede4dc49-81e5-443d-a5a2-6d8e18cb51de","Type":"ContainerStarted","Data":"ef22cd2e0190d9e5a5e56440e31303e65954ccead916d83e602522ded135189c"} Jun 15 05:51:36.848404 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:36.848207 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" podStartSLOduration=2.483006569 podStartE2EDuration="5.848186522s" totalImagesPullingTime="3.365179953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:51:36.848162257 +0000 UTC m=+249.292528065" watchObservedRunningTime="2026-06-15 05:51:36.848186522 +0000 UTC m=+249.292552327" Jun 15 05:51:36.915369 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:36.915303 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:36.954022 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:36.953938 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t" podStartSLOduration=1.5310799720000001 podStartE2EDuration="4.95391759s" totalImagesPullingTime="3.422837618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:51:36.952927474 +0000 UTC m=+249.397293297" watchObservedRunningTime="2026-06-15 05:51:36.95391759 +0000 UTC m=+249.398283396" Jun 15 05:51:36.955296 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:36.955255 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj" podStartSLOduration=2.363128781 podStartE2EDuration="5.955242779s" totalImagesPullingTime="3.592113998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:51:36.893596054 +0000 UTC m=+249.337961879" watchObservedRunningTime="2026-06-15 05:51:36.955242779 +0000 UTC m=+249.399608585" Jun 15 05:51:37.007690 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.007657 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:37.373186 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.373149 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:37.463036 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.463005 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:37.518285 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.518250 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:37.582205 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.582168 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:37.683671 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.683585 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:37.762985 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.762950 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l4fhk"] Jun 15 05:51:37.765882 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.765860 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:37.768893 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.768702 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 15 05:51:37.769030 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.769016 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 15 05:51:37.769791 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.769758 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-snc9v\"" Jun 15 05:51:37.778649 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.778627 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l4fhk"] Jun 15 05:51:37.811933 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.811902 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:37.837817 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.837794 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 05:51:37.838254 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.838234 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/0.log" Jun 15 05:51:37.838351 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.838273 2586 generic.go:356] "Generic (PLEG): container finished" podID="eb5db5db-873d-45de-b051-b6afdc3f8563" containerID="73f8505fc27fcbcfb1e3bc195ce1fda112ec5e5522f3dcd9914d95fcb5ea8b96" exitCode=255 Jun 15 05:51:37.838410 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.838388 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" event={"ID":"eb5db5db-873d-45de-b051-b6afdc3f8563","Type":"ContainerDied","Data":"73f8505fc27fcbcfb1e3bc195ce1fda112ec5e5522f3dcd9914d95fcb5ea8b96"} Jun 15 05:51:37.839348 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.839322 2586 scope.go:117] "RemoveContainer" containerID="7959e651451bae2314fa1ddc3fbd412da37eec9d613f3ccf2a65ce3a9946a623" Jun 15 05:51:37.839464 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.839450 2586 scope.go:117] "RemoveContainer" containerID="73f8505fc27fcbcfb1e3bc195ce1fda112ec5e5522f3dcd9914d95fcb5ea8b96" Jun 15 05:51:37.839669 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:37.839646 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-47jpt_openshift-console-operator(eb5db5db-873d-45de-b051-b6afdc3f8563)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" podUID="eb5db5db-873d-45de-b051-b6afdc3f8563" Jun 15 05:51:37.869812 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.869776 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:37.869812 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.869814 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-data-volume\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:37.870011 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.869946 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqg24\" (UniqueName: \"kubernetes.io/projected/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-api-access-bqg24\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:37.870052 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.870007 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-crio-socket\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:37.870052 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.870027 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:37.970869 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.970773 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:37.970869 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.970827 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-data-volume\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:37.971385 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:37.970864 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 05:51:37.971385 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:37.970943 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls podName:cb93c3f8-d6f5-4126-84ec-87a7df5f296c nodeName:}" failed. No retries permitted until 2026-06-15 05:51:38.470922526 +0000 UTC m=+250.915288332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4fhk" (UID: "cb93c3f8-d6f5-4126-84ec-87a7df5f296c") : secret "insights-runtime-extractor-tls" not found Jun 15 05:51:37.971385 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.971142 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqg24\" (UniqueName: \"kubernetes.io/projected/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-api-access-bqg24\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:37.971385 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.971214 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-data-volume\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:37.971830 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.971801 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-crio-socket\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:37.971898 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.971756 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-crio-socket\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:37.971898 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.971876 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:37.972068 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:37.972051 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 05:51:37.972237 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:37.972124 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm podName:cb93c3f8-d6f5-4126-84ec-87a7df5f296c nodeName:}" failed. No retries permitted until 2026-06-15 05:51:38.47209808 +0000 UTC m=+250.916463881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l4fhk" (UID: "cb93c3f8-d6f5-4126-84ec-87a7df5f296c") : configmap "kube-rbac-proxy" not found Jun 15 05:51:37.982960 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:37.982933 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqg24\" (UniqueName: \"kubernetes.io/projected/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-api-access-bqg24\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:38.477635 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:38.477587 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:38.477635 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:38.477641 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:38.477905 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:38.477723 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 05:51:38.477905 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:38.477804 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 05:51:38.477905 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:38.477812 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm podName:cb93c3f8-d6f5-4126-84ec-87a7df5f296c nodeName:}" failed. No retries permitted until 2026-06-15 05:51:39.477794713 +0000 UTC m=+251.922160505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l4fhk" (UID: "cb93c3f8-d6f5-4126-84ec-87a7df5f296c") : configmap "kube-rbac-proxy" not found Jun 15 05:51:38.477905 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:38.477868 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls podName:cb93c3f8-d6f5-4126-84ec-87a7df5f296c nodeName:}" failed. No retries permitted until 2026-06-15 05:51:39.47785144 +0000 UTC m=+251.922217225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4fhk" (UID: "cb93c3f8-d6f5-4126-84ec-87a7df5f296c") : secret "insights-runtime-extractor-tls" not found Jun 15 05:51:38.842586 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:38.842558 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 05:51:38.842898 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:38.842883 2586 scope.go:117] "RemoveContainer" containerID="73f8505fc27fcbcfb1e3bc195ce1fda112ec5e5522f3dcd9914d95fcb5ea8b96" Jun 15 05:51:38.843051 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:38.843031 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-47jpt_openshift-console-operator(eb5db5db-873d-45de-b051-b6afdc3f8563)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" podUID="eb5db5db-873d-45de-b051-b6afdc3f8563" Jun 15 05:51:39.232229 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:39.232149 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:39.340779 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:39.340749 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:39.402599 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:39.402551 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:39.485007 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:39.484924 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:39.485007 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:39.484974 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:39.485177 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:39.485049 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 05:51:39.485177 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:39.485087 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 05:51:39.485177 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:39.485119 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm podName:cb93c3f8-d6f5-4126-84ec-87a7df5f296c nodeName:}" failed. No retries permitted until 2026-06-15 05:51:41.485102841 +0000 UTC m=+253.929468627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l4fhk" (UID: "cb93c3f8-d6f5-4126-84ec-87a7df5f296c") : configmap "kube-rbac-proxy" not found Jun 15 05:51:39.485177 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:39.485141 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls podName:cb93c3f8-d6f5-4126-84ec-87a7df5f296c nodeName:}" failed. No retries permitted until 2026-06-15 05:51:41.485127445 +0000 UTC m=+253.929493230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4fhk" (UID: "cb93c3f8-d6f5-4126-84ec-87a7df5f296c") : secret "insights-runtime-extractor-tls" not found Jun 15 05:51:39.889088 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:39.889033 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:39.889088 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:39.889088 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs\") pod \"network-metrics-daemon-hx8xj\" (UID: \"e08f6162-b5b3-4beb-af7c-0b23b0635346\") " pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:51:39.889319 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:39.889119 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:39.889319 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:39.889144 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-cz27n\" (UID: \"458b7d17-e77f-4343-9178-644fa6ed65b4\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" Jun 15 05:51:39.889319 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:39.889174 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-7wqc4\" (UID: \"432b3548-a9e2-4861-a58f-50cc85ac1a84\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" Jun 15 05:51:39.889319 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:39.889214 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle podName:f19cd9f9-7da1-4505-99b0-b4b97d240670 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:47.889192181 +0000 UTC m=+260.333557967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle") pod "router-default-958db9c48-7c8vk" (UID: "f19cd9f9-7da1-4505-99b0-b4b97d240670") : configmap references non-existent config key: service-ca.crt Jun 15 05:51:39.889319 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:39.889257 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 05:51:39.889319 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:39.889273 2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 05:51:39.889319 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:39.889297 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs podName:e08f6162-b5b3-4beb-af7c-0b23b0635346 nodeName:}" failed. No retries permitted until 2026-06-15 05:53:41.889286234 +0000 UTC m=+374.333652021 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs") pod "network-metrics-daemon-hx8xj" (UID: "e08f6162-b5b3-4beb-af7c-0b23b0635346") : secret "metrics-daemon-secret" not found Jun 15 05:51:39.889628 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:39.889322 2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 05:51:39.889628 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:39.889324 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert podName:458b7d17-e77f-4343-9178-644fa6ed65b4 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:47.889309463 +0000 UTC m=+260.333675251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-cz27n" (UID: "458b7d17-e77f-4343-9178-644fa6ed65b4") : secret "networking-console-plugin-cert" not found Jun 15 05:51:39.889628 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:39.889273 2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 05:51:39.889628 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:39.889380 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls podName:432b3548-a9e2-4861-a58f-50cc85ac1a84 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:47.889369813 +0000 UTC m=+260.333735600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls") pod "cluster-samples-operator-9547488fd-7wqc4" (UID: "432b3548-a9e2-4861-a58f-50cc85ac1a84") : secret "samples-operator-tls" not found Jun 15 05:51:39.889628 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:39.889481 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs podName:f19cd9f9-7da1-4505-99b0-b4b97d240670 nodeName:}" failed. No retries permitted until 2026-06-15 05:51:47.889456604 +0000 UTC m=+260.333822396 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs") pod "router-default-958db9c48-7c8vk" (UID: "f19cd9f9-7da1-4505-99b0-b4b97d240670") : secret "router-metrics-certs-default" not found Jun 15 05:51:40.061551 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:40.061517 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:40.767502 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:40.767472 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vkl6p_607f39f7-4e69-48b8-9127-b5d6fa14681c/dns-node-resolver/0.log" Jun 15 05:51:41.503265 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:41.503223 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:41.503480 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:41.503361 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:41.503480 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:41.503379 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 05:51:41.503480 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:41.503454 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 05:51:41.503480 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:41.503465 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls podName:cb93c3f8-d6f5-4126-84ec-87a7df5f296c nodeName:}" failed. No retries permitted until 2026-06-15 05:51:45.503450652 +0000 UTC m=+257.947816436 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4fhk" (UID: "cb93c3f8-d6f5-4126-84ec-87a7df5f296c") : secret "insights-runtime-extractor-tls" not found Jun 15 05:51:41.503622 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:41.503494 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm podName:cb93c3f8-d6f5-4126-84ec-87a7df5f296c nodeName:}" failed. No retries permitted until 2026-06-15 05:51:45.503483026 +0000 UTC m=+257.947848810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l4fhk" (UID: "cb93c3f8-d6f5-4126-84ec-87a7df5f296c") : configmap "kube-rbac-proxy" not found Jun 15 05:51:41.768349 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:41.768271 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kwpd4_385e0bfa-0d96-489b-a1f3-c83f3ac0066f/node-ca/0.log" Jun 15 05:51:42.316185 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:42.316140 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:42.316185 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:42.316197 2586 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:42.316548 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:42.316534 2586 scope.go:117] "RemoveContainer" containerID="73f8505fc27fcbcfb1e3bc195ce1fda112ec5e5522f3dcd9914d95fcb5ea8b96" Jun 15 05:51:42.316706 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:42.316687 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-47jpt_openshift-console-operator(eb5db5db-873d-45de-b051-b6afdc3f8563)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" podUID="eb5db5db-873d-45de-b051-b6afdc3f8563" Jun 15 05:51:42.367177 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:42.367142 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bldd9_2314ceb2-1069-49a2-b197-5417e717b4c6/serve-healthcheck-canary/0.log" Jun 15 05:51:42.610232 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:42.610108 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:42.767706 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:42.767644 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:43.024777 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:43.024742 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:43.128769 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:43.128737 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:43.169309 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:43.169279 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-djl2t_d4b20d67-802a-4a38-b55a-c98bb9bfa1a0/kube-storage-version-migrator-operator/0.log" Jun 15 05:51:43.224599 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:43.224555 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:43.327393 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:43.327267 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:43.468747 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:43.468698 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:44.487453 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:44.487393 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:44.871398 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:44.871352 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:45.076847 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:45.076812 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:45.263695 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:45.263655 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:45.477918 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:45.477815 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:45.539384 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:45.539293 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:45.539384 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:45.539334 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:45.539881 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:45.539449 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 05:51:45.539881 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:45.539455 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 05:51:45.539881 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:45.539546 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm podName:cb93c3f8-d6f5-4126-84ec-87a7df5f296c nodeName:}" failed. No retries permitted until 2026-06-15 05:51:53.539521924 +0000 UTC m=+265.983887728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l4fhk" (UID: "cb93c3f8-d6f5-4126-84ec-87a7df5f296c") : configmap "kube-rbac-proxy" not found Jun 15 05:51:45.539881 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:45.539576 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls podName:cb93c3f8-d6f5-4126-84ec-87a7df5f296c nodeName:}" failed. No retries permitted until 2026-06-15 05:51:53.539563079 +0000 UTC m=+265.983928867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4fhk" (UID: "cb93c3f8-d6f5-4126-84ec-87a7df5f296c") : secret "insights-runtime-extractor-tls" not found Jun 15 05:51:46.680331 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:46.680285 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:46.780643 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:46.780608 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:46.883703 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:46.883672 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:46.989196 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:46.989123 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:47.128970 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:47.128936 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:47.282215 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:47.282186 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:47.493194 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:47.493160 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:47.962345 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:47.962307 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:47.962806 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:47.962364 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:47.962806 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:47.962392 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-cz27n\" (UID: \"458b7d17-e77f-4343-9178-644fa6ed65b4\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" Jun 15 05:51:47.962806 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:47.962440 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-7wqc4\" (UID: \"432b3548-a9e2-4861-a58f-50cc85ac1a84\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" Jun 15 05:51:47.962806 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:47.962494 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle podName:f19cd9f9-7da1-4505-99b0-b4b97d240670 nodeName:}" failed. No retries permitted until 2026-06-15 05:52:03.962470304 +0000 UTC m=+276.406836292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle") pod "router-default-958db9c48-7c8vk" (UID: "f19cd9f9-7da1-4505-99b0-b4b97d240670") : configmap references non-existent config key: service-ca.crt Jun 15 05:51:47.962806 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:47.962551 2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 05:51:47.962806 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:51:47.962628 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert podName:458b7d17-e77f-4343-9178-644fa6ed65b4 nodeName:}" failed. No retries permitted until 2026-06-15 05:52:03.962611503 +0000 UTC m=+276.406977287 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-cz27n" (UID: "458b7d17-e77f-4343-9178-644fa6ed65b4") : secret "networking-console-plugin-cert" not found Jun 15 05:51:47.964996 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:47.964978 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f19cd9f9-7da1-4505-99b0-b4b97d240670-metrics-certs\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:51:47.965056 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:47.965024 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/432b3548-a9e2-4861-a58f-50cc85ac1a84-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-7wqc4\" (UID: \"432b3548-a9e2-4861-a58f-50cc85ac1a84\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" Jun 15 05:51:48.017822 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:48.017788 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" Jun 15 05:51:48.150349 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:48.150321 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4"] Jun 15 05:51:48.680505 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:48.680465 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:48.872608 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:48.872570 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:48.873940 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:48.873900 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" event={"ID":"432b3548-a9e2-4861-a58f-50cc85ac1a84","Type":"ContainerStarted","Data":"5f01f85aba1a8a16b3f534487f7e4ef3852370f047782b07865f310995d2dd67"} Jun 15 05:51:49.070550 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:49.070518 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:49.275597 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:49.275552 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:49.341565 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:49.341479 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:49.480086 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:49.480045 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:49.881988 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:49.881957 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" event={"ID":"432b3548-a9e2-4861-a58f-50cc85ac1a84","Type":"ContainerStarted","Data":"1ba8d5e67ec7fa5b57735e62532127150f3702c0dce979cae9d212ea361ff7a6"} Jun 15 05:51:49.882174 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:49.882006 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" event={"ID":"432b3548-a9e2-4861-a58f-50cc85ac1a84","Type":"ContainerStarted","Data":"bfb32239375cb9f63cb5ad152785df6fbedf0c6dcaadd917aec9378bd5b2c640"} Jun 15 05:51:49.901408 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:49.901355 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7wqc4" podStartSLOduration=16.358943088 podStartE2EDuration="17.901340793s" totalImagesPullingTime="1.542397705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:51:49.90026837 +0000 UTC m=+262.344634175" watchObservedRunningTime="2026-06-15 05:51:49.901340793 +0000 UTC m=+262.345706599" Jun 15 05:51:49.996783 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:49.996693 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:50.493224 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:50.493162 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:50.873715 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:50.873680 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:51.091409 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:51.091374 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:51.267078 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:51.267045 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:51.664389 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:51.664286 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:52.429953 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:52.429921 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:52.527783 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:52.527751 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:52.665815 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:52.665781 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:53.066787 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:53.066757 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:53.267454 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:53.267408 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:53.473236 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:53.473134 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:53.610602 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:53.610570 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:53.610602 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:53.610605 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:53.611151 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:53.611126 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:53.613096 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:53.613076 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb93c3f8-d6f5-4126-84ec-87a7df5f296c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4fhk\" (UID: \"cb93c3f8-d6f5-4126-84ec-87a7df5f296c\") " pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:53.676909 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:53.676873 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l4fhk" Jun 15 05:51:53.808029 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:53.808001 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l4fhk"] Jun 15 05:51:53.811098 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:51:53.811069 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb93c3f8_d6f5_4126_84ec_87a7df5f296c.slice/crio-2eea5b1d2520fae72f4b5c3fbcf781daee6ff56245cf1cf7e9013b23e5fb4e41 WatchSource:0}: Error finding container 2eea5b1d2520fae72f4b5c3fbcf781daee6ff56245cf1cf7e9013b23e5fb4e41: Status 404 returned error can't find the container with id 2eea5b1d2520fae72f4b5c3fbcf781daee6ff56245cf1cf7e9013b23e5fb4e41 Jun 15 05:51:53.894917 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:53.894886 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l4fhk" event={"ID":"cb93c3f8-d6f5-4126-84ec-87a7df5f296c","Type":"ContainerStarted","Data":"2eea5b1d2520fae72f4b5c3fbcf781daee6ff56245cf1cf7e9013b23e5fb4e41"} Jun 15 05:51:56.039869 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:56.039836 2586 scope.go:117] "RemoveContainer" containerID="73f8505fc27fcbcfb1e3bc195ce1fda112ec5e5522f3dcd9914d95fcb5ea8b96" Jun 15 05:51:57.911340 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:57.911298 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l4fhk" event={"ID":"cb93c3f8-d6f5-4126-84ec-87a7df5f296c","Type":"ContainerStarted","Data":"84987cbaafbd9dc695b9a1414cf92fcef565282d74e3d9534e06afa43fb48cdf"} Jun 15 05:51:57.913586 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:57.913563 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 05:51:57.913705 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:57.913608 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" event={"ID":"eb5db5db-873d-45de-b051-b6afdc3f8563","Type":"ContainerStarted","Data":"21e6512ba267194d96ecd72b4c04915e349365dc18998c01c69749c90ef6549b"} Jun 15 05:51:57.913938 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:57.913885 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:57.934305 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:57.934244 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" podStartSLOduration=23.56833846 podStartE2EDuration="26.934223986s" totalImagesPullingTime="3.365885526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:51:57.932271541 +0000 UTC m=+270.376637352" watchObservedRunningTime="2026-06-15 05:51:57.934223986 +0000 UTC m=+270.378589793" Jun 15 05:51:58.267097 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:58.267069 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-47jpt" Jun 15 05:51:58.475750 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:58.475722 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:58.576190 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:58.576100 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:58.627961 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:58.627926 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:58.761810 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:58.761776 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:58.919475 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:58.919377 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l4fhk" event={"ID":"cb93c3f8-d6f5-4126-84ec-87a7df5f296c","Type":"ContainerStarted","Data":"efebb78d75be2c71bff837c061192d024e2b8a26884ee63b7d08793e76cd9f74"} Jun 15 05:51:59.125705 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:59.125668 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:59.226773 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:59.226689 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:59.525783 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:59.525738 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:59.924288 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:59.924195 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l4fhk" event={"ID":"cb93c3f8-d6f5-4126-84ec-87a7df5f296c","Type":"ContainerStarted","Data":"141fc45e1e816059b1ec691b79332f1aae7ffdaba5ee7cebd431d022bc50e7aa"} Jun 15 05:51:59.947458 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:59.947409 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:51:59.947702 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:51:59.947667 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l4fhk" podStartSLOduration=17.273699992 podStartE2EDuration="22.947652534s" totalImagesPullingTime="5.673952542s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:51:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:51:59.945897995 +0000 UTC m=+272.390263801" watchObservedRunningTime="2026-06-15 05:51:59.947652534 +0000 UTC m=+272.392018698" Jun 15 05:52:00.343976 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:00.343940 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:00.541365 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:00.541336 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:00.991876 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:00.991846 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:01.166306 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:01.166272 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:01.263875 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:01.263847 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:01.633783 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:01.633698 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:01.745072 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:01.745041 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:01.836673 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:01.836643 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:04.002875 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:04.002833 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-cz27n\" (UID: \"458b7d17-e77f-4343-9178-644fa6ed65b4\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" Jun 15 05:52:04.003358 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:04.002935 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:52:04.003634 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:04.003614 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f19cd9f9-7da1-4505-99b0-b4b97d240670-service-ca-bundle\") pod \"router-default-958db9c48-7c8vk\" (UID: \"f19cd9f9-7da1-4505-99b0-b4b97d240670\") " pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:52:04.005543 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:04.005522 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/458b7d17-e77f-4343-9178-644fa6ed65b4-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-cz27n\" (UID: \"458b7d17-e77f-4343-9178-644fa6ed65b4\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" Jun 15 05:52:04.211663 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:04.211619 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" Jun 15 05:52:04.224099 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:04.224072 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:52:04.356076 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:04.356042 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-cz27n"] Jun 15 05:52:04.360057 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:52:04.360017 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod458b7d17_e77f_4343_9178_644fa6ed65b4.slice/crio-eac3d3a17b1c4bbeece118a9721fe1d9e9c26223b71fed3dc2a1b56c1a4fb538 WatchSource:0}: Error finding container eac3d3a17b1c4bbeece118a9721fe1d9e9c26223b71fed3dc2a1b56c1a4fb538: Status 404 returned error can't find the container with id eac3d3a17b1c4bbeece118a9721fe1d9e9c26223b71fed3dc2a1b56c1a4fb538 Jun 15 05:52:04.377913 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:04.377818 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-958db9c48-7c8vk"] Jun 15 05:52:04.380187 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:52:04.380156 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19cd9f9_7da1_4505_99b0_b4b97d240670.slice/crio-1d0a781175a7f9a92cf5dd004abc7f41f13bf457d9354074e757b1251d161602 WatchSource:0}: Error finding container 1d0a781175a7f9a92cf5dd004abc7f41f13bf457d9354074e757b1251d161602: Status 404 returned error can't find the container with id 1d0a781175a7f9a92cf5dd004abc7f41f13bf457d9354074e757b1251d161602 Jun 15 05:52:04.940915 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:04.940879 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" event={"ID":"458b7d17-e77f-4343-9178-644fa6ed65b4","Type":"ContainerStarted","Data":"eac3d3a17b1c4bbeece118a9721fe1d9e9c26223b71fed3dc2a1b56c1a4fb538"} Jun 15 05:52:04.942355 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:04.942279 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-958db9c48-7c8vk" event={"ID":"f19cd9f9-7da1-4505-99b0-b4b97d240670","Type":"ContainerStarted","Data":"ec6da51c8067f2d8d5720d8d7df1f53f8fde3802a50c0c4dfc43918fd75f928d"} Jun 15 05:52:04.942355 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:04.942330 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-958db9c48-7c8vk" event={"ID":"f19cd9f9-7da1-4505-99b0-b4b97d240670","Type":"ContainerStarted","Data":"1d0a781175a7f9a92cf5dd004abc7f41f13bf457d9354074e757b1251d161602"} Jun 15 05:52:05.225336 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:05.225243 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:52:05.228294 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:05.228268 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:52:05.251630 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:05.251575 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-958db9c48-7c8vk" podStartSLOduration=33.251556335 podStartE2EDuration="33.251556335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:51:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:52:04.973365968 +0000 UTC m=+277.417731774" watchObservedRunningTime="2026-06-15 05:52:05.251556335 +0000 UTC m=+277.695922143" Jun 15 05:52:05.947311 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:05.947205 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" event={"ID":"458b7d17-e77f-4343-9178-644fa6ed65b4","Type":"ContainerStarted","Data":"bb7da5f114199165296cb4c0d057bb1e157e970c5fae838b91258926b14e38c8"} Jun 15 05:52:05.947548 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:05.947528 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:52:05.948838 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:05.948814 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-958db9c48-7c8vk" Jun 15 05:52:05.967093 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:05.967045 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-cz27n" podStartSLOduration=32.821550539 podStartE2EDuration="33.967030802s" totalImagesPullingTime="1.145480263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:52:05.966027096 +0000 UTC m=+278.410392921" watchObservedRunningTime="2026-06-15 05:52:05.967030802 +0000 UTC m=+278.411396608" Jun 15 05:52:06.071240 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:06.071209 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:06.171005 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:06.170969 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:06.271634 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:06.271596 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:06.352890 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:06.352844 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:06.583884 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:06.583775 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:06.647269 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:06.647234 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:06.710978 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:06.710926 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:07.817308 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.817275 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bcb7c4655-q4hgr"] Jun 15 05:52:07.820621 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.820604 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:07.825101 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.825073 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 15 05:52:07.826140 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.826122 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 15 05:52:07.826245 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.826124 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4njqx\"" Jun 15 05:52:07.826245 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.826166 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 15 05:52:07.826245 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.826130 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 15 05:52:07.826921 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.826900 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 15 05:52:07.827103 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.826941 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 15 05:52:07.827103 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.827038 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 15 05:52:07.837488 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.837465 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bcb7c4655-q4hgr"] Jun 15 05:52:07.936882 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.936844 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-oauth-config\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:07.937042 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.936895 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-serving-cert\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:07.937042 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.936963 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-service-ca\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:07.937042 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.936989 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-oauth-serving-cert\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:07.937042 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.937008 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-config\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:07.937042 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:07.937038 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt5k2\" (UniqueName: \"kubernetes.io/projected/e3c16d8d-a40d-4db9-b626-33c62d39fe03-kube-api-access-vt5k2\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:08.038134 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:08.038093 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-oauth-config\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:08.038335 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:08.038187 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-serving-cert\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:08.038403 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:08.038357 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-service-ca\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:08.038403 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:08.038396 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-oauth-serving-cert\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:08.038550 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:08.038477 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-config\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:08.038595 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:08.038568 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt5k2\" (UniqueName: \"kubernetes.io/projected/e3c16d8d-a40d-4db9-b626-33c62d39fe03-kube-api-access-vt5k2\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:08.039176 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:08.039147 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-oauth-serving-cert\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:08.039299 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:08.039198 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-service-ca\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:08.039299 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:08.039230 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-config\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:08.041333 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:08.041307 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-oauth-config\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:08.041665 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:08.041345 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-serving-cert\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:08.067095 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:08.067055 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt5k2\" (UniqueName: \"kubernetes.io/projected/e3c16d8d-a40d-4db9-b626-33c62d39fe03-kube-api-access-vt5k2\") pod \"console-bcb7c4655-q4hgr\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:08.129963 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:08.129873 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:08.264956 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:08.264918 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bcb7c4655-q4hgr"] Jun 15 05:52:08.267878 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:52:08.267850 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c16d8d_a40d_4db9_b626_33c62d39fe03.slice/crio-f976d969e02db9faa6374d11307db7d298d2b2ac590c3714ac5ce5d8472cd68b WatchSource:0}: Error finding container f976d969e02db9faa6374d11307db7d298d2b2ac590c3714ac5ce5d8472cd68b: Status 404 returned error can't find the container with id f976d969e02db9faa6374d11307db7d298d2b2ac590c3714ac5ce5d8472cd68b Jun 15 05:52:08.957933 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:08.957890 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcb7c4655-q4hgr" event={"ID":"e3c16d8d-a40d-4db9-b626-33c62d39fe03","Type":"ContainerStarted","Data":"f976d969e02db9faa6374d11307db7d298d2b2ac590c3714ac5ce5d8472cd68b"} Jun 15 05:52:09.026320 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:09.026284 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:09.098709 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:09.098661 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:09.604519 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:52:09.604479 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-h9zkf" podUID="a528d398-c858-4dd2-be98-3a6fc9422529" Jun 15 05:52:09.604519 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:52:09.604496 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" podUID="b541e040-366d-498b-8e5a-353e5860e633" Jun 15 05:52:09.961763 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:09.961684 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:52:09.961763 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:09.961699 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h9zkf" Jun 15 05:52:10.382919 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.382880 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:10.436709 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.436671 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7"] Jun 15 05:52:10.453298 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.453262 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7"] Jun 15 05:52:10.453539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.453414 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" Jun 15 05:52:10.458238 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.457474 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 15 05:52:10.458238 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.457488 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gswr4\"" Jun 15 05:52:10.458238 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.457504 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 15 05:52:10.458238 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.457588 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 15 05:52:10.458238 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.458078 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 15 05:52:10.458238 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.458137 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 15 05:52:10.459064 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.459036 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:10.560627 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.560581 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c55p9\" (UniqueName: \"kubernetes.io/projected/1ae33c38-32d5-4da1-a760-046a9419ae09-kube-api-access-c55p9\") pod \"prometheus-operator-864fcfc6f9-wtpg7\" (UID: \"1ae33c38-32d5-4da1-a760-046a9419ae09\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" Jun 15 05:52:10.560805 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.560706 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ae33c38-32d5-4da1-a760-046a9419ae09-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-wtpg7\" (UID: \"1ae33c38-32d5-4da1-a760-046a9419ae09\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" Jun 15 05:52:10.560805 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.560761 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ae33c38-32d5-4da1-a760-046a9419ae09-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-wtpg7\" (UID: \"1ae33c38-32d5-4da1-a760-046a9419ae09\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" Jun 15 05:52:10.560805 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.560794 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ae33c38-32d5-4da1-a760-046a9419ae09-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-wtpg7\" (UID: \"1ae33c38-32d5-4da1-a760-046a9419ae09\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" Jun 15 05:52:10.661590 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.661492 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ae33c38-32d5-4da1-a760-046a9419ae09-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-wtpg7\" (UID: \"1ae33c38-32d5-4da1-a760-046a9419ae09\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" Jun 15 05:52:10.661590 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.661562 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ae33c38-32d5-4da1-a760-046a9419ae09-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-wtpg7\" (UID: \"1ae33c38-32d5-4da1-a760-046a9419ae09\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" Jun 15 05:52:10.661813 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.661629 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c55p9\" (UniqueName: \"kubernetes.io/projected/1ae33c38-32d5-4da1-a760-046a9419ae09-kube-api-access-c55p9\") pod \"prometheus-operator-864fcfc6f9-wtpg7\" (UID: \"1ae33c38-32d5-4da1-a760-046a9419ae09\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" Jun 15 05:52:10.661813 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:52:10.661679 2586 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 15 05:52:10.661813 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.661699 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ae33c38-32d5-4da1-a760-046a9419ae09-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-wtpg7\" (UID: \"1ae33c38-32d5-4da1-a760-046a9419ae09\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" Jun 15 05:52:10.661813 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:52:10.661745 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae33c38-32d5-4da1-a760-046a9419ae09-prometheus-operator-tls podName:1ae33c38-32d5-4da1-a760-046a9419ae09 nodeName:}" failed. No retries permitted until 2026-06-15 05:52:11.161725574 +0000 UTC m=+283.606091381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1ae33c38-32d5-4da1-a760-046a9419ae09-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-wtpg7" (UID: "1ae33c38-32d5-4da1-a760-046a9419ae09") : secret "prometheus-operator-tls" not found Jun 15 05:52:10.662449 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.662399 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ae33c38-32d5-4da1-a760-046a9419ae09-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-wtpg7\" (UID: \"1ae33c38-32d5-4da1-a760-046a9419ae09\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" Jun 15 05:52:10.664374 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.664349 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ae33c38-32d5-4da1-a760-046a9419ae09-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-wtpg7\" (UID: \"1ae33c38-32d5-4da1-a760-046a9419ae09\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" Jun 15 05:52:10.672436 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:10.672392 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c55p9\" (UniqueName: \"kubernetes.io/projected/1ae33c38-32d5-4da1-a760-046a9419ae09-kube-api-access-c55p9\") pod \"prometheus-operator-864fcfc6f9-wtpg7\" (UID: \"1ae33c38-32d5-4da1-a760-046a9419ae09\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" Jun 15 05:52:11.079801 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:11.079760 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:11.166731 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:11.166697 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ae33c38-32d5-4da1-a760-046a9419ae09-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-wtpg7\" (UID: \"1ae33c38-32d5-4da1-a760-046a9419ae09\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" Jun 15 05:52:11.169158 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:11.169125 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ae33c38-32d5-4da1-a760-046a9419ae09-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-wtpg7\" (UID: \"1ae33c38-32d5-4da1-a760-046a9419ae09\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" Jun 15 05:52:11.365339 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:11.365250 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" Jun 15 05:52:11.493189 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:11.493164 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7"] Jun 15 05:52:11.495609 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:52:11.495587 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae33c38_32d5_4da1_a760_046a9419ae09.slice/crio-f794df7b4f2cb5312f177c20b5487ef1a369850f40c0d8558a5928b38f4b0adc WatchSource:0}: Error finding container f794df7b4f2cb5312f177c20b5487ef1a369850f40c0d8558a5928b38f4b0adc: Status 404 returned error can't find the container with id f794df7b4f2cb5312f177c20b5487ef1a369850f40c0d8558a5928b38f4b0adc Jun 15 05:52:11.970818 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:11.970783 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcb7c4655-q4hgr" event={"ID":"e3c16d8d-a40d-4db9-b626-33c62d39fe03","Type":"ContainerStarted","Data":"1f87940a88b20383dd364297b492169907042b4ee8b4a726dce09b8139d96e88"} Jun 15 05:52:11.971911 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:11.971888 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" event={"ID":"1ae33c38-32d5-4da1-a760-046a9419ae09","Type":"ContainerStarted","Data":"f794df7b4f2cb5312f177c20b5487ef1a369850f40c0d8558a5928b38f4b0adc"} Jun 15 05:52:11.991102 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:11.991052 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bcb7c4655-q4hgr" podStartSLOduration=2.075976004 podStartE2EDuration="4.991036764s" totalImagesPullingTime="2.91506076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:52:11.990200485 +0000 UTC m=+284.434566291" watchObservedRunningTime="2026-06-15 05:52:11.991036764 +0000 UTC m=+284.435402567" Jun 15 05:52:12.881953 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:12.881912 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:52:12.881953 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:12.881960 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:52:12.884336 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:12.884313 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a528d398-c858-4dd2-be98-3a6fc9422529-metrics-tls\") pod \"dns-default-h9zkf\" (UID: \"a528d398-c858-4dd2-be98-3a6fc9422529\") " pod="openshift-dns/dns-default-h9zkf" Jun 15 05:52:12.884566 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:12.884548 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls\") pod \"image-registry-f47d5dc5c-nvs96\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:52:12.966770 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:12.966689 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5mfr5\"" Jun 15 05:52:12.966770 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:12.966690 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g2hj5\"" Jun 15 05:52:12.973414 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:12.973375 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h9zkf" Jun 15 05:52:12.973414 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:12.973392 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:52:12.977504 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:12.977478 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" event={"ID":"1ae33c38-32d5-4da1-a760-046a9419ae09","Type":"ContainerStarted","Data":"cd3f381962c492bc886f3470a39f4dc6bde562b2456ebd46428a0f5b7ffa6509"} Jun 15 05:52:12.977612 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:12.977583 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" event={"ID":"1ae33c38-32d5-4da1-a760-046a9419ae09","Type":"ContainerStarted","Data":"853d0c5690daa48e617454e5fbbc21df4d5178556b21e1c875ca1a638c1301fc"} Jun 15 05:52:13.005081 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:13.004998 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wtpg7" podStartSLOduration=1.790331885 podStartE2EDuration="3.004970597s" totalImagesPullingTime="1.214638712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:52:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:52:13.003306191 +0000 UTC m=+285.447672078" watchObservedRunningTime="2026-06-15 05:52:13.004970597 +0000 UTC m=+285.449336461" Jun 15 05:52:13.070131 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:13.070101 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:13.135623 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:13.135576 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f47d5dc5c-nvs96"] Jun 15 05:52:13.138414 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:52:13.138384 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb541e040_366d_498b_8e5a_353e5860e633.slice/crio-63058c1cbbdca4d95874372b658cf33db5c3ea57512c7c9a72f6687106c27eb7 WatchSource:0}: Error finding container 63058c1cbbdca4d95874372b658cf33db5c3ea57512c7c9a72f6687106c27eb7: Status 404 returned error can't find the container with id 63058c1cbbdca4d95874372b658cf33db5c3ea57512c7c9a72f6687106c27eb7 Jun 15 05:52:13.151155 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:13.151130 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h9zkf"] Jun 15 05:52:13.153167 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:52:13.153138 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda528d398_c858_4dd2_be98_3a6fc9422529.slice/crio-59ac1b87e2447bc9bdf182fa1638a95ac94a3938ee039df9d194af6129731ba0 WatchSource:0}: Error finding container 59ac1b87e2447bc9bdf182fa1638a95ac94a3938ee039df9d194af6129731ba0: Status 404 returned error can't find the container with id 59ac1b87e2447bc9bdf182fa1638a95ac94a3938ee039df9d194af6129731ba0 Jun 15 05:52:13.962876 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:13.962841 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:13.981544 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:13.981505 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h9zkf" event={"ID":"a528d398-c858-4dd2-be98-3a6fc9422529","Type":"ContainerStarted","Data":"59ac1b87e2447bc9bdf182fa1638a95ac94a3938ee039df9d194af6129731ba0"} Jun 15 05:52:13.982929 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:13.982896 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" event={"ID":"b541e040-366d-498b-8e5a-353e5860e633","Type":"ContainerStarted","Data":"c36d71991fca7df1f97c60ab5d89442d864b143c4087802de8778ddb2df1659a"} Jun 15 05:52:13.983048 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:13.982946 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" event={"ID":"b541e040-366d-498b-8e5a-353e5860e633","Type":"ContainerStarted","Data":"63058c1cbbdca4d95874372b658cf33db5c3ea57512c7c9a72f6687106c27eb7"} Jun 15 05:52:14.006273 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.006218 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" podStartSLOduration=286.006199331 podStartE2EDuration="4m46.006199331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:52:14.004386776 +0000 UTC m=+286.448752582" watchObservedRunningTime="2026-06-15 05:52:14.006199331 +0000 UTC m=+286.450565139" Jun 15 05:52:14.063504 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.063465 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:14.556547 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.556510 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:14.719164 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.719084 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:14.823925 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.823821 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:14.879382 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.879353 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wvgq6"] Jun 15 05:52:14.882034 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.882011 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:14.884365 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.884341 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 15 05:52:14.884499 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.884404 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zztp9\"" Jun 15 05:52:14.884556 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.884535 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 15 05:52:14.884766 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.884751 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 15 05:52:14.914091 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.914060 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:14.968306 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.968271 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:14.987953 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.987916 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h9zkf" event={"ID":"a528d398-c858-4dd2-be98-3a6fc9422529","Type":"ContainerStarted","Data":"b89664e41d6e4d7152e231261da2f3578c12f72ae0090cce9118c8893b713dde"} Jun 15 05:52:14.988128 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.987979 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h9zkf" event={"ID":"a528d398-c858-4dd2-be98-3a6fc9422529","Type":"ContainerStarted","Data":"8f4ce1a57ee754f7e2fec634ebee3dfeece2e7dcdb869873760d960a283c648e"} Jun 15 05:52:14.988192 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.988145 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h9zkf" Jun 15 05:52:14.988192 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:14.988181 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:52:15.003198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.003173 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d3f1a446-f953-4e83-bcee-0491a529dec7-node-exporter-textfile\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.003198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.003204 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3f1a446-f953-4e83-bcee-0491a529dec7-metrics-client-ca\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.003390 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.003224 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3f1a446-f953-4e83-bcee-0491a529dec7-sys\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.003390 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.003248 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3f1a446-f953-4e83-bcee-0491a529dec7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.003390 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.003271 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d3f1a446-f953-4e83-bcee-0491a529dec7-root\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.003390 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.003319 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d3f1a446-f953-4e83-bcee-0491a529dec7-node-exporter-tls\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.003390 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.003375 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2blz4\" (UniqueName: \"kubernetes.io/projected/d3f1a446-f953-4e83-bcee-0491a529dec7-kube-api-access-2blz4\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.003574 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.003404 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d3f1a446-f953-4e83-bcee-0491a529dec7-node-exporter-accelerators-collector-config\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.003574 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.003477 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d3f1a446-f953-4e83-bcee-0491a529dec7-node-exporter-wtmp\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.015209 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.015156 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h9zkf" podStartSLOduration=251.481061374 podStartE2EDuration="4m13.01514075s" totalImagesPullingTime="1.534079376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:52:15.014601345 +0000 UTC m=+287.458967151" watchObservedRunningTime="2026-06-15 05:52:15.01514075 +0000 UTC m=+287.459506557" Jun 15 05:52:15.084376 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.084290 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:15.104517 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.104481 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3f1a446-f953-4e83-bcee-0491a529dec7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.104685 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.104523 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d3f1a446-f953-4e83-bcee-0491a529dec7-root\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.104685 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.104544 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d3f1a446-f953-4e83-bcee-0491a529dec7-node-exporter-tls\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.104685 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.104616 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d3f1a446-f953-4e83-bcee-0491a529dec7-root\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.104841 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.104713 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2blz4\" (UniqueName: \"kubernetes.io/projected/d3f1a446-f953-4e83-bcee-0491a529dec7-kube-api-access-2blz4\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.104841 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.104753 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d3f1a446-f953-4e83-bcee-0491a529dec7-node-exporter-accelerators-collector-config\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.104841 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.104818 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d3f1a446-f953-4e83-bcee-0491a529dec7-node-exporter-wtmp\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.104999 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.104966 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d3f1a446-f953-4e83-bcee-0491a529dec7-node-exporter-wtmp\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.104999 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.104967 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d3f1a446-f953-4e83-bcee-0491a529dec7-node-exporter-textfile\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.105098 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.105026 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3f1a446-f953-4e83-bcee-0491a529dec7-metrics-client-ca\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.105098 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.105075 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3f1a446-f953-4e83-bcee-0491a529dec7-sys\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.105195 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.105145 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3f1a446-f953-4e83-bcee-0491a529dec7-sys\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.105249 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.105225 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d3f1a446-f953-4e83-bcee-0491a529dec7-node-exporter-textfile\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.105443 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.105395 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d3f1a446-f953-4e83-bcee-0491a529dec7-node-exporter-accelerators-collector-config\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.105777 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.105759 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3f1a446-f953-4e83-bcee-0491a529dec7-metrics-client-ca\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.107304 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.107283 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3f1a446-f953-4e83-bcee-0491a529dec7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.107766 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.107750 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d3f1a446-f953-4e83-bcee-0491a529dec7-node-exporter-tls\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.118271 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.118248 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2blz4\" (UniqueName: \"kubernetes.io/projected/d3f1a446-f953-4e83-bcee-0491a529dec7-kube-api-access-2blz4\") pod \"node-exporter-wvgq6\" (UID: \"d3f1a446-f953-4e83-bcee-0491a529dec7\") " pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.171646 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.171614 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:15.191728 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.191702 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wvgq6" Jun 15 05:52:15.201777 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:52:15.201745 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f1a446_f953_4e83_bcee_0491a529dec7.slice/crio-3a9371c0a23466e54a023a67f1ff98bcdb546d686cd8dde56e8610de01b57a58 WatchSource:0}: Error finding container 3a9371c0a23466e54a023a67f1ff98bcdb546d686cd8dde56e8610de01b57a58: Status 404 returned error can't find the container with id 3a9371c0a23466e54a023a67f1ff98bcdb546d686cd8dde56e8610de01b57a58 Jun 15 05:52:15.271391 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.271356 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:15.724547 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.724516 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:15.916127 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.916082 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:15.993934 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:15.993838 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wvgq6" event={"ID":"d3f1a446-f953-4e83-bcee-0491a529dec7","Type":"ContainerStarted","Data":"3a9371c0a23466e54a023a67f1ff98bcdb546d686cd8dde56e8610de01b57a58"} Jun 15 05:52:16.016840 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.016806 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:16.045253 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.045208 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 05:52:16.050626 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.050597 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.057328 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.054287 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 15 05:52:16.057328 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.054861 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 15 05:52:16.057328 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.056344 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 15 05:52:16.057328 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.056745 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 15 05:52:16.057328 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.057007 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 15 05:52:16.057328 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.057069 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 15 05:52:16.057328 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.057010 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 15 05:52:16.057328 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.057194 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zdsv4\"" Jun 15 05:52:16.057852 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.057360 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 15 05:52:16.057852 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.057369 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 15 05:52:16.067480 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.067448 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 05:52:16.116641 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.116603 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.116641 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.116650 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.116880 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.116677 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.116880 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.116753 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.116880 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.116784 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.116880 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.116807 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.116880 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.116837 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.117112 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.117034 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.117165 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.117124 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-config-volume\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.117222 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.117205 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.117273 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.117223 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-web-config\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.117273 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.117238 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2vx2\" (UniqueName: \"kubernetes.io/projected/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-kube-api-access-b2vx2\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.117375 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.117290 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-config-out\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.217789 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.217764 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.217897 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.217801 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.217897 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.217828 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.218008 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.217907 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.218008 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.217947 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-config-volume\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.218008 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.217991 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.218152 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.218018 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-web-config\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.218152 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:52:16.218041 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-alertmanager-trusted-ca-bundle podName:80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1 nodeName:}" failed. No retries permitted until 2026-06-15 05:52:16.718016302 +0000 UTC m=+289.162382093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1") : configmap references non-existent config key: ca-bundle.crt Jun 15 05:52:16.218152 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.218086 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2vx2\" (UniqueName: \"kubernetes.io/projected/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-kube-api-access-b2vx2\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.218152 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.218129 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-config-out\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.218339 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.218161 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.218339 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.218186 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.218339 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.218211 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.218339 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.218252 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.219304 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.219257 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.220105 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.220047 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.220985 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.220921 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:16.222034 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.221961 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.222358 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.222333 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-config-out\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.222806 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.222787 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.223226 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.223182 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-web-config\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.223358 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.223336 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-config-volume\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.223497 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.223469 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.223816 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.223784 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.224106 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.224086 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.224546 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.224517 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.235250 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.235194 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2vx2\" (UniqueName: \"kubernetes.io/projected/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-kube-api-access-b2vx2\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.722805 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.722714 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.723732 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.723709 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.966844 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.966802 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:52:16.999569 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.999536 2586 generic.go:356] "Generic (PLEG): container finished" podID="d3f1a446-f953-4e83-bcee-0491a529dec7" containerID="39b20be88af4c18c96ac2c5409652f58d34eb08a7524c9dcbc7b0a1f73064da4" exitCode=0 Jun 15 05:52:16.999569 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:16.999573 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wvgq6" event={"ID":"d3f1a446-f953-4e83-bcee-0491a529dec7","Type":"ContainerDied","Data":"39b20be88af4c18c96ac2c5409652f58d34eb08a7524c9dcbc7b0a1f73064da4"} Jun 15 05:52:17.125296 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:17.125262 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 05:52:17.126690 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:52:17.126661 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80284e1d_c7d5_4cf3_b5c3_39683bbe7ef1.slice/crio-b1dc3119b5e9c4232b2ccf10271a5b37bcd1c9000873cf4e5278a93692427035 WatchSource:0}: Error finding container b1dc3119b5e9c4232b2ccf10271a5b37bcd1c9000873cf4e5278a93692427035: Status 404 returned error can't find the container with id b1dc3119b5e9c4232b2ccf10271a5b37bcd1c9000873cf4e5278a93692427035 Jun 15 05:52:17.827943 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:17.827910 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:17.929409 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:17.929370 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:18.007010 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:18.006971 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wvgq6" event={"ID":"d3f1a446-f953-4e83-bcee-0491a529dec7","Type":"ContainerStarted","Data":"b0d81d5fdd1ec54ce55cac02f20db70b231df57bc2eb9e1a3ebfab8ebdb8f6a2"} Jun 15 05:52:18.007481 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:18.007038 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wvgq6" event={"ID":"d3f1a446-f953-4e83-bcee-0491a529dec7","Type":"ContainerStarted","Data":"a434a1efc4f2b795a7098b5b4184799e36de702897b571592c50e383804e2efe"} Jun 15 05:52:18.008226 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:18.008201 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1","Type":"ContainerStarted","Data":"b1dc3119b5e9c4232b2ccf10271a5b37bcd1c9000873cf4e5278a93692427035"} Jun 15 05:52:18.029908 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:18.029853 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wvgq6" podStartSLOduration=2.9977291790000002 podStartE2EDuration="4.029835923s" totalImagesPullingTime="955.844099ms" totalInitContainerRuntime="76.262645ms" isStatefulPod=true podCreationTimestamp="2026-06-15 05:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:52:18.027825258 +0000 UTC m=+290.472191073" watchObservedRunningTime="2026-06-15 05:52:18.029835923 +0000 UTC m=+290.474201728" Jun 15 05:52:18.034329 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:18.034292 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:18.130082 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:18.130055 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:18.130210 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:18.130134 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:18.131403 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:18.131381 2586 patch_prober.go:28] interesting pod/console-bcb7c4655-q4hgr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused" start-of-body= Jun 15 05:52:18.131514 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:18.131433 2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-bcb7c4655-q4hgr" podUID="e3c16d8d-a40d-4db9-b626-33c62d39fe03" containerName="console" probeResult="failure" output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused" Jun 15 05:52:18.409452 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:18.409338 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:19.014046 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.014009 2586 generic.go:356] "Generic (PLEG): container finished" podID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerID="405b892f3ea1e6e5a1439d05953ddcca40533078cc7bc3dfa47904e330e46e42" exitCode=0 Jun 15 05:52:19.014475 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.014089 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1","Type":"ContainerDied","Data":"405b892f3ea1e6e5a1439d05953ddcca40533078cc7bc3dfa47904e330e46e42"} Jun 15 05:52:19.330616 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.330536 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7796c75c49-s79hx"] Jun 15 05:52:19.335262 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.335242 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.342471 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.342443 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 15 05:52:19.342471 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.342469 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 15 05:52:19.342657 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.342537 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 15 05:52:19.342657 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.342490 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-86glw\"" Jun 15 05:52:19.342896 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.342883 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8rnrbtuk8lcsn\"" Jun 15 05:52:19.342959 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.342899 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 05:52:19.352670 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.352649 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7796c75c49-s79hx"] Jun 15 05:52:19.445637 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.445596 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8tlk\" (UniqueName: \"kubernetes.io/projected/734feb89-7ac0-4d84-be74-35932cc220c1-kube-api-access-v8tlk\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.445835 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.445712 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/734feb89-7ac0-4d84-be74-35932cc220c1-secret-metrics-server-tls\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.445835 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.445752 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/734feb89-7ac0-4d84-be74-35932cc220c1-metrics-server-audit-profiles\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.445835 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.445807 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/734feb89-7ac0-4d84-be74-35932cc220c1-client-ca-bundle\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.445966 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.445872 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/734feb89-7ac0-4d84-be74-35932cc220c1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.445966 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.445927 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/734feb89-7ac0-4d84-be74-35932cc220c1-audit-log\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.445966 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.445963 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/734feb89-7ac0-4d84-be74-35932cc220c1-secret-metrics-server-client-certs\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.547072 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.547019 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/734feb89-7ac0-4d84-be74-35932cc220c1-secret-metrics-server-tls\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.547236 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.547083 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/734feb89-7ac0-4d84-be74-35932cc220c1-metrics-server-audit-profiles\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.547236 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.547141 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/734feb89-7ac0-4d84-be74-35932cc220c1-client-ca-bundle\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.547236 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.547176 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/734feb89-7ac0-4d84-be74-35932cc220c1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.547236 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.547212 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/734feb89-7ac0-4d84-be74-35932cc220c1-audit-log\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.547522 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.547254 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/734feb89-7ac0-4d84-be74-35932cc220c1-secret-metrics-server-client-certs\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.547522 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.547280 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8tlk\" (UniqueName: \"kubernetes.io/projected/734feb89-7ac0-4d84-be74-35932cc220c1-kube-api-access-v8tlk\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.548979 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.548945 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/734feb89-7ac0-4d84-be74-35932cc220c1-audit-log\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.549107 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.549089 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/734feb89-7ac0-4d84-be74-35932cc220c1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.549887 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.549861 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/734feb89-7ac0-4d84-be74-35932cc220c1-metrics-server-audit-profiles\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.551086 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.551057 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/734feb89-7ac0-4d84-be74-35932cc220c1-secret-metrics-server-tls\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.551962 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.551914 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/734feb89-7ac0-4d84-be74-35932cc220c1-secret-metrics-server-client-certs\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.552065 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.551982 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/734feb89-7ac0-4d84-be74-35932cc220c1-client-ca-bundle\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.556655 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.556626 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8tlk\" (UniqueName: \"kubernetes.io/projected/734feb89-7ac0-4d84-be74-35932cc220c1-kube-api-access-v8tlk\") pod \"metrics-server-7796c75c49-s79hx\" (UID: \"734feb89-7ac0-4d84-be74-35932cc220c1\") " pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.603669 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.603575 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:19.646773 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.646737 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:19.660929 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.660896 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:19.802967 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.802934 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7796c75c49-s79hx"] Jun 15 05:52:19.806809 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:52:19.806775 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734feb89_7ac0_4d84_be74_35932cc220c1.slice/crio-0fac8c71ff0fab581e48a1f3e86cb7ab8ad84fcc07cc501f15ed14c1bdd74b40 WatchSource:0}: Error finding container 0fac8c71ff0fab581e48a1f3e86cb7ab8ad84fcc07cc501f15ed14c1bdd74b40: Status 404 returned error can't find the container with id 0fac8c71ff0fab581e48a1f3e86cb7ab8ad84fcc07cc501f15ed14c1bdd74b40 Jun 15 05:52:19.947149 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:19.947057 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:20.019861 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:20.019826 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" event={"ID":"734feb89-7ac0-4d84-be74-35932cc220c1","Type":"ContainerStarted","Data":"0fac8c71ff0fab581e48a1f3e86cb7ab8ad84fcc07cc501f15ed14c1bdd74b40"} Jun 15 05:52:21.030969 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.030927 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1","Type":"ContainerStarted","Data":"170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875"} Jun 15 05:52:21.031358 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.031014 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1","Type":"ContainerStarted","Data":"6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f"} Jun 15 05:52:21.031358 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.031044 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1","Type":"ContainerStarted","Data":"c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5"} Jun 15 05:52:21.031358 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.031070 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1","Type":"ContainerStarted","Data":"63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358"} Jun 15 05:52:21.031358 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.031093 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1","Type":"ContainerStarted","Data":"a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c"} Jun 15 05:52:21.117649 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.117551 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:21.123248 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.123214 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 05:52:21.129230 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.129199 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.136172 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.136117 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 15 05:52:21.136349 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.136316 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 15 05:52:21.136483 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.136407 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 15 05:52:21.137113 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.137089 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 15 05:52:21.137203 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.137118 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d5qzd\"" Jun 15 05:52:21.137347 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.137330 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 15 05:52:21.138001 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.137532 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 15 05:52:21.138001 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.137623 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 15 05:52:21.138001 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.137725 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 15 05:52:21.138001 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.137845 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 15 05:52:21.138001 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.137875 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 15 05:52:21.138001 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.137903 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 15 05:52:21.138351 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.138145 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 15 05:52:21.138556 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.138539 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 15 05:52:21.138809 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.138783 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ed7rq90723i3n\"" Jun 15 05:52:21.141189 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.141133 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 15 05:52:21.153108 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.153006 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 05:52:21.265984 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.265942 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266156 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.265999 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266156 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266032 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266156 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266105 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266156 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266144 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266338 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266173 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266338 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266252 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266338 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266296 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266338 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266336 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266554 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266362 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266554 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266467 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266554 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266499 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-config\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266554 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266522 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266724 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266632 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266724 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266673 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266724 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266704 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266869 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266729 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266869 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266780 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266869 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266817 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg8cq\" (UniqueName: \"kubernetes.io/projected/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-kube-api-access-xg8cq\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.266869 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.266849 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.367642 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.367610 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.367762 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.367650 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.367762 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.367675 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.367762 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.367698 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.367762 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.367720 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.367762 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.367746 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg8cq\" (UniqueName: \"kubernetes.io/projected/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-kube-api-access-xg8cq\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.368004 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.367773 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.368004 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.367800 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.368004 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.367831 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.368004 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.367856 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.368004 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.367882 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.368004 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.367902 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.368004 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.367921 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.368004 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.367966 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.368381 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.368018 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.368381 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.368063 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.368381 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.368086 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.368381 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.368161 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.368381 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.368190 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-config\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.368381 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.368216 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.368381 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.368280 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.368789 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.368675 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.369849 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.369819 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.370059 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.370035 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.370146 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.370056 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.371081 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.370995 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.372347 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.372187 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.372347 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.372305 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.372347 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.372340 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.373110 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.373071 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.373204 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.373158 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.373977 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.373464 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.373977 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.373938 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.374122 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.374099 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.375352 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.375196 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-config\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.375352 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.375281 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.375653 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.375368 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.375653 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.375631 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.375867 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.375845 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.379033 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.379014 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg8cq\" (UniqueName: \"kubernetes.io/projected/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-kube-api-access-xg8cq\") pod \"prometheus-k8s-0\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.444027 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.443986 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:21.648282 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:21.648250 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 05:52:21.772955 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:52:21.772924 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c2f5ae6_ba56_4ea5_8fb5_b978640a14cf.slice/crio-f33a899c528792a0a17b776e752b233d77c05b6b9dd8e0f6f946031c39b222a0 WatchSource:0}: Error finding container f33a899c528792a0a17b776e752b233d77c05b6b9dd8e0f6f946031c39b222a0: Status 404 returned error can't find the container with id f33a899c528792a0a17b776e752b233d77c05b6b9dd8e0f6f946031c39b222a0 Jun 15 05:52:22.037728 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:22.037691 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" event={"ID":"734feb89-7ac0-4d84-be74-35932cc220c1","Type":"ContainerStarted","Data":"b6d3ea8fd409ecd8a96a73e51eaf3f18de912bd0f7b045c89650455874d8bd8c"} Jun 15 05:52:22.043921 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:22.043890 2586 generic.go:356] "Generic (PLEG): container finished" podID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerID="bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b" exitCode=0 Jun 15 05:52:22.045282 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:22.045255 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1","Type":"ContainerStarted","Data":"4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282"} Jun 15 05:52:22.045397 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:22.045324 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf","Type":"ContainerDied","Data":"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b"} Jun 15 05:52:22.045397 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:22.045359 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf","Type":"ContainerStarted","Data":"f33a899c528792a0a17b776e752b233d77c05b6b9dd8e0f6f946031c39b222a0"} Jun 15 05:52:22.128214 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:22.128155 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" podStartSLOduration=1.5914284109999999 podStartE2EDuration="3.128139594s" totalImagesPullingTime="1.536711183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:52:22.067823303 +0000 UTC m=+294.512189110" watchObservedRunningTime="2026-06-15 05:52:22.128139594 +0000 UTC m=+294.572505399" Jun 15 05:52:22.175166 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:22.175061 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.734935732 podStartE2EDuration="6.175043772s" totalImagesPullingTime="3.425671256s" totalInitContainerRuntime="14.436784ms" isStatefulPod=false podCreationTimestamp="2026-06-15 05:52:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:52:22.173317263 +0000 UTC m=+294.617683107" watchObservedRunningTime="2026-06-15 05:52:22.175043772 +0000 UTC m=+294.619409577" Jun 15 05:52:24.181383 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:24.181344 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bcb7c4655-q4hgr"] Jun 15 05:52:24.996744 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:24.996712 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h9zkf" Jun 15 05:52:25.039911 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:52:25.039873 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hx8xj" podUID="e08f6162-b5b3-4beb-af7c-0b23b0635346" Jun 15 05:52:25.920545 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:25.920504 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:26.019516 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:26.019414 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:26.065225 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:26.065187 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf","Type":"ContainerStarted","Data":"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558"} Jun 15 05:52:26.065553 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:26.065278 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf","Type":"ContainerStarted","Data":"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e"} Jun 15 05:52:26.125207 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:26.125169 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:27.190686 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:27.190596 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:27.571133 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:27.571054 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:27.993358 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:27.993273 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 05:52:27.993941 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:27.993921 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 05:52:28.007499 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:28.007479 2586 kubelet.go:1648] "Image garbage collection succeeded" Jun 15 05:52:28.076035 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:28.075860 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf","Type":"ContainerStarted","Data":"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8"} Jun 15 05:52:28.076035 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:28.075942 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf","Type":"ContainerStarted","Data":"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1"} Jun 15 05:52:28.076035 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:28.075980 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf","Type":"ContainerStarted","Data":"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3"} Jun 15 05:52:28.076035 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:28.076019 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf","Type":"ContainerStarted","Data":"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0"} Jun 15 05:52:28.454739 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:28.112337 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.206674388 podStartE2EDuration="7.112320356s" totalImagesPullingTime="4.882592239s" totalInitContainerRuntime="23.053729ms" isStatefulPod=false podCreationTimestamp="2026-06-15 05:52:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:52:28.109653068 +0000 UTC m=+300.554018874" watchObservedRunningTime="2026-06-15 05:52:28.112320356 +0000 UTC m=+300.556686161" Jun 15 05:52:28.992724 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:28.992671 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:29.063675 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:29.063640 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:29.792226 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:29.792197 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:30.729687 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:30.729648 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:31.444499 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:31.444457 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:52:32.977788 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:32.977753 2586 patch_prober.go:28] interesting pod/image-registry-f47d5dc5c-nvs96 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 05:52:32.978167 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:32.977811 2586 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" podUID="b541e040-366d-498b-8e5a-353e5860e633" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 05:52:33.107107 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:33.107075 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:33.209829 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:33.209791 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:33.421803 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:33.421768 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f47d5dc5c-nvs96"] Jun 15 05:52:33.426089 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:33.426061 2586 patch_prober.go:28] interesting pod/image-registry-f47d5dc5c-nvs96 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 05:52:33.426229 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:33.426110 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" podUID="b541e040-366d-498b-8e5a-353e5860e633" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 05:52:33.518387 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:33.518353 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:33.621307 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:33.621272 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:34.153752 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:34.153712 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:34.210258 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:34.210224 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:35.234979 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:35.234949 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:35.307308 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:35.307273 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:35.689447 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:35.689368 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:35.755701 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:35.755666 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:35.812043 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:35.812012 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:39.039131 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:39.039095 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:52:39.647029 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:39.646990 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:39.647198 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:39.647077 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:42.251337 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:42.251307 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:42.369255 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:42.369216 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:43.426451 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:43.426404 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:52:43.608811 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:43.608778 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:43.672281 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:43.672219 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:49.205121 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.205078 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-bcb7c4655-q4hgr" podUID="e3c16d8d-a40d-4db9-b626-33c62d39fe03" containerName="console" containerID="cri-o://1f87940a88b20383dd364297b492169907042b4ee8b4a726dce09b8139d96e88" gracePeriod=15 Jun 15 05:52:49.460221 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.460157 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:49.557517 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.557470 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-service-ca\") pod \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " Jun 15 05:52:49.557713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.557536 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-serving-cert\") pod \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " Jun 15 05:52:49.557713 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.557586 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-oauth-serving-cert\") pod \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " Jun 15 05:52:49.557828 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.557769 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-oauth-config\") pod \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " Jun 15 05:52:49.557884 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.557824 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vt5k2\" (UniqueName: \"kubernetes.io/projected/e3c16d8d-a40d-4db9-b626-33c62d39fe03-kube-api-access-vt5k2\") pod \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " Jun 15 05:52:49.557884 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.557850 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-config\") pod \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\" (UID: \"e3c16d8d-a40d-4db9-b626-33c62d39fe03\") " Jun 15 05:52:49.558285 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.558253 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-service-ca" (OuterVolumeSpecName: "service-ca") pod "e3c16d8d-a40d-4db9-b626-33c62d39fe03" (UID: "e3c16d8d-a40d-4db9-b626-33c62d39fe03"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:52:49.558586 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.558275 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e3c16d8d-a40d-4db9-b626-33c62d39fe03" (UID: "e3c16d8d-a40d-4db9-b626-33c62d39fe03"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:52:49.558586 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.558401 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-config" (OuterVolumeSpecName: "console-config") pod "e3c16d8d-a40d-4db9-b626-33c62d39fe03" (UID: "e3c16d8d-a40d-4db9-b626-33c62d39fe03"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:52:49.560061 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.560033 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e3c16d8d-a40d-4db9-b626-33c62d39fe03" (UID: "e3c16d8d-a40d-4db9-b626-33c62d39fe03"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:52:49.560061 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.560053 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3c16d8d-a40d-4db9-b626-33c62d39fe03-kube-api-access-vt5k2" (OuterVolumeSpecName: "kube-api-access-vt5k2") pod "e3c16d8d-a40d-4db9-b626-33c62d39fe03" (UID: "e3c16d8d-a40d-4db9-b626-33c62d39fe03"). InnerVolumeSpecName "kube-api-access-vt5k2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:52:49.560185 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.560053 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e3c16d8d-a40d-4db9-b626-33c62d39fe03" (UID: "e3c16d8d-a40d-4db9-b626-33c62d39fe03"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:52:49.659519 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.659475 2586 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-oauth-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:52:49.659519 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.659509 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vt5k2\" (UniqueName: \"kubernetes.io/projected/e3c16d8d-a40d-4db9-b626-33c62d39fe03-kube-api-access-vt5k2\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:52:49.659519 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.659523 2586 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:52:49.659754 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.659535 2586 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:52:49.659754 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.659547 2586 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3c16d8d-a40d-4db9-b626-33c62d39fe03-console-serving-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:52:49.659754 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:49.659557 2586 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3c16d8d-a40d-4db9-b626-33c62d39fe03-oauth-serving-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:52:50.160148 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:50.160115 2586 generic.go:356] "Generic (PLEG): container finished" podID="e3c16d8d-a40d-4db9-b626-33c62d39fe03" containerID="1f87940a88b20383dd364297b492169907042b4ee8b4a726dce09b8139d96e88" exitCode=0 Jun 15 05:52:50.160323 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:50.160174 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcb7c4655-q4hgr" Jun 15 05:52:50.160323 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:50.160196 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcb7c4655-q4hgr" event={"ID":"e3c16d8d-a40d-4db9-b626-33c62d39fe03","Type":"ContainerDied","Data":"1f87940a88b20383dd364297b492169907042b4ee8b4a726dce09b8139d96e88"} Jun 15 05:52:50.160323 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:50.160244 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcb7c4655-q4hgr" event={"ID":"e3c16d8d-a40d-4db9-b626-33c62d39fe03","Type":"ContainerDied","Data":"f976d969e02db9faa6374d11307db7d298d2b2ac590c3714ac5ce5d8472cd68b"} Jun 15 05:52:50.160323 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:50.160263 2586 scope.go:117] "RemoveContainer" containerID="1f87940a88b20383dd364297b492169907042b4ee8b4a726dce09b8139d96e88" Jun 15 05:52:50.169408 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:50.169387 2586 scope.go:117] "RemoveContainer" containerID="1f87940a88b20383dd364297b492169907042b4ee8b4a726dce09b8139d96e88" Jun 15 05:52:50.169721 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:52:50.169690 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f87940a88b20383dd364297b492169907042b4ee8b4a726dce09b8139d96e88\": container with ID starting with 1f87940a88b20383dd364297b492169907042b4ee8b4a726dce09b8139d96e88 not found: ID does not exist" containerID="1f87940a88b20383dd364297b492169907042b4ee8b4a726dce09b8139d96e88" Jun 15 05:52:50.169796 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:50.169728 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f87940a88b20383dd364297b492169907042b4ee8b4a726dce09b8139d96e88"} err="failed to get container status \"1f87940a88b20383dd364297b492169907042b4ee8b4a726dce09b8139d96e88\": rpc error: code = NotFound desc = could not find container \"1f87940a88b20383dd364297b492169907042b4ee8b4a726dce09b8139d96e88\": container with ID starting with 1f87940a88b20383dd364297b492169907042b4ee8b4a726dce09b8139d96e88 not found: ID does not exist" Jun 15 05:52:50.181364 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:50.181333 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bcb7c4655-q4hgr"] Jun 15 05:52:50.182938 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:50.182914 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bcb7c4655-q4hgr"] Jun 15 05:52:52.043957 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:52.043923 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3c16d8d-a40d-4db9-b626-33c62d39fe03" path="/var/lib/kubelet/pods/e3c16d8d-a40d-4db9-b626-33c62d39fe03/volumes" Jun 15 05:52:52.443834 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:52.443749 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:52.503820 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:52.503782 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:53.755680 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:53.755646 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:53.815223 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:53.815195 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:52:57.190377 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:57.190344 2586 generic.go:356] "Generic (PLEG): container finished" podID="16423435-593d-4a83-9d74-75edb172923b" containerID="dcb615773b5c9d83f0b0ff67b681acc1832ee35da3e114c53ca07ce04c5b238a" exitCode=0 Jun 15 05:52:57.190759 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:57.190442 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" event={"ID":"16423435-593d-4a83-9d74-75edb172923b","Type":"ContainerDied","Data":"dcb615773b5c9d83f0b0ff67b681acc1832ee35da3e114c53ca07ce04c5b238a"} Jun 15 05:52:57.190803 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:57.190781 2586 scope.go:117] "RemoveContainer" containerID="dcb615773b5c9d83f0b0ff67b681acc1832ee35da3e114c53ca07ce04c5b238a" Jun 15 05:52:58.195972 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.195940 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-rf87f" event={"ID":"16423435-593d-4a83-9d74-75edb172923b","Type":"ContainerStarted","Data":"488d8a5366cde15c99426c309e8e4cd4383dd270c4241dc342dbd72e4c501712"} Jun 15 05:52:58.441754 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.441694 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" podUID="b541e040-366d-498b-8e5a-353e5860e633" containerName="registry" containerID="cri-o://c36d71991fca7df1f97c60ab5d89442d864b143c4087802de8778ddb2df1659a" gracePeriod=30 Jun 15 05:52:58.714196 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.714127 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:52:58.846038 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.846003 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b541e040-366d-498b-8e5a-353e5860e633-image-registry-private-configuration\") pod \"b541e040-366d-498b-8e5a-353e5860e633\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " Jun 15 05:52:58.846213 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.846059 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhbvz\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-kube-api-access-mhbvz\") pod \"b541e040-366d-498b-8e5a-353e5860e633\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " Jun 15 05:52:58.846213 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.846115 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b541e040-366d-498b-8e5a-353e5860e633-installation-pull-secrets\") pod \"b541e040-366d-498b-8e5a-353e5860e633\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " Jun 15 05:52:58.846213 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.846139 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b541e040-366d-498b-8e5a-353e5860e633-trusted-ca\") pod \"b541e040-366d-498b-8e5a-353e5860e633\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " Jun 15 05:52:58.846213 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.846188 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls\") pod \"b541e040-366d-498b-8e5a-353e5860e633\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " Jun 15 05:52:58.846404 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.846224 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b541e040-366d-498b-8e5a-353e5860e633-registry-certificates\") pod \"b541e040-366d-498b-8e5a-353e5860e633\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " Jun 15 05:52:58.846404 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.846259 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-bound-sa-token\") pod \"b541e040-366d-498b-8e5a-353e5860e633\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " Jun 15 05:52:58.846404 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.846286 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b541e040-366d-498b-8e5a-353e5860e633-ca-trust-extracted\") pod \"b541e040-366d-498b-8e5a-353e5860e633\" (UID: \"b541e040-366d-498b-8e5a-353e5860e633\") " Jun 15 05:52:58.846744 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.846694 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b541e040-366d-498b-8e5a-353e5860e633-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b541e040-366d-498b-8e5a-353e5860e633" (UID: "b541e040-366d-498b-8e5a-353e5860e633"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:52:58.846847 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.846816 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b541e040-366d-498b-8e5a-353e5860e633-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b541e040-366d-498b-8e5a-353e5860e633" (UID: "b541e040-366d-498b-8e5a-353e5860e633"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:52:58.848770 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.848746 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b541e040-366d-498b-8e5a-353e5860e633" (UID: "b541e040-366d-498b-8e5a-353e5860e633"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:52:58.848969 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.848941 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-kube-api-access-mhbvz" (OuterVolumeSpecName: "kube-api-access-mhbvz") pod "b541e040-366d-498b-8e5a-353e5860e633" (UID: "b541e040-366d-498b-8e5a-353e5860e633"). InnerVolumeSpecName "kube-api-access-mhbvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:52:58.849107 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.849084 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b541e040-366d-498b-8e5a-353e5860e633-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b541e040-366d-498b-8e5a-353e5860e633" (UID: "b541e040-366d-498b-8e5a-353e5860e633"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:52:58.849253 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.849230 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b541e040-366d-498b-8e5a-353e5860e633-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b541e040-366d-498b-8e5a-353e5860e633" (UID: "b541e040-366d-498b-8e5a-353e5860e633"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:52:58.849370 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.849348 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b541e040-366d-498b-8e5a-353e5860e633" (UID: "b541e040-366d-498b-8e5a-353e5860e633"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:52:58.855117 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.855093 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b541e040-366d-498b-8e5a-353e5860e633-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b541e040-366d-498b-8e5a-353e5860e633" (UID: "b541e040-366d-498b-8e5a-353e5860e633"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:52:58.947227 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.947188 2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-registry-tls\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:52:58.947227 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.947219 2586 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b541e040-366d-498b-8e5a-353e5860e633-registry-certificates\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:52:58.947227 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.947229 2586 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-bound-sa-token\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:52:58.947227 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.947237 2586 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b541e040-366d-498b-8e5a-353e5860e633-ca-trust-extracted\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:52:58.947561 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.947247 2586 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b541e040-366d-498b-8e5a-353e5860e633-image-registry-private-configuration\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:52:58.947561 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.947256 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhbvz\" (UniqueName: \"kubernetes.io/projected/b541e040-366d-498b-8e5a-353e5860e633-kube-api-access-mhbvz\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:52:58.947561 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.947264 2586 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b541e040-366d-498b-8e5a-353e5860e633-installation-pull-secrets\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:52:58.947561 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:58.947272 2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b541e040-366d-498b-8e5a-353e5860e633-trusted-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:52:59.200904 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:59.200869 2586 generic.go:356] "Generic (PLEG): container finished" podID="b541e040-366d-498b-8e5a-353e5860e633" containerID="c36d71991fca7df1f97c60ab5d89442d864b143c4087802de8778ddb2df1659a" exitCode=0 Jun 15 05:52:59.201305 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:59.200934 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" Jun 15 05:52:59.201305 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:59.200937 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" event={"ID":"b541e040-366d-498b-8e5a-353e5860e633","Type":"ContainerDied","Data":"c36d71991fca7df1f97c60ab5d89442d864b143c4087802de8778ddb2df1659a"} Jun 15 05:52:59.201305 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:59.200985 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f47d5dc5c-nvs96" event={"ID":"b541e040-366d-498b-8e5a-353e5860e633","Type":"ContainerDied","Data":"63058c1cbbdca4d95874372b658cf33db5c3ea57512c7c9a72f6687106c27eb7"} Jun 15 05:52:59.201305 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:59.201013 2586 scope.go:117] "RemoveContainer" containerID="c36d71991fca7df1f97c60ab5d89442d864b143c4087802de8778ddb2df1659a" Jun 15 05:52:59.209605 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:59.209586 2586 scope.go:117] "RemoveContainer" containerID="c36d71991fca7df1f97c60ab5d89442d864b143c4087802de8778ddb2df1659a" Jun 15 05:52:59.209849 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:52:59.209830 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c36d71991fca7df1f97c60ab5d89442d864b143c4087802de8778ddb2df1659a\": container with ID starting with c36d71991fca7df1f97c60ab5d89442d864b143c4087802de8778ddb2df1659a not found: ID does not exist" containerID="c36d71991fca7df1f97c60ab5d89442d864b143c4087802de8778ddb2df1659a" Jun 15 05:52:59.209910 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:59.209860 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c36d71991fca7df1f97c60ab5d89442d864b143c4087802de8778ddb2df1659a"} err="failed to get container status \"c36d71991fca7df1f97c60ab5d89442d864b143c4087802de8778ddb2df1659a\": rpc error: code = NotFound desc = could not find container \"c36d71991fca7df1f97c60ab5d89442d864b143c4087802de8778ddb2df1659a\": container with ID starting with c36d71991fca7df1f97c60ab5d89442d864b143c4087802de8778ddb2df1659a not found: ID does not exist" Jun 15 05:52:59.227679 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:59.227652 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f47d5dc5c-nvs96"] Jun 15 05:52:59.236406 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:59.236378 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f47d5dc5c-nvs96"] Jun 15 05:52:59.652278 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:59.652250 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:52:59.656099 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:52:59.656077 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7796c75c49-s79hx" Jun 15 05:53:00.044309 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:00.044272 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b541e040-366d-498b-8e5a-353e5860e633" path="/var/lib/kubelet/pods/b541e040-366d-498b-8e5a-353e5860e633/volumes" Jun 15 05:53:02.214370 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:02.214336 2586 generic.go:356] "Generic (PLEG): container finished" podID="ede4dc49-81e5-443d-a5a2-6d8e18cb51de" containerID="ef22cd2e0190d9e5a5e56440e31303e65954ccead916d83e602522ded135189c" exitCode=0 Jun 15 05:53:02.214773 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:02.214404 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj" event={"ID":"ede4dc49-81e5-443d-a5a2-6d8e18cb51de","Type":"ContainerDied","Data":"ef22cd2e0190d9e5a5e56440e31303e65954ccead916d83e602522ded135189c"} Jun 15 05:53:02.214773 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:02.214728 2586 scope.go:117] "RemoveContainer" containerID="ef22cd2e0190d9e5a5e56440e31303e65954ccead916d83e602522ded135189c" Jun 15 05:53:03.219791 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:03.219755 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-pfvzj" event={"ID":"ede4dc49-81e5-443d-a5a2-6d8e18cb51de","Type":"ContainerStarted","Data":"1c742f582e6f200d34510307632c8c1a7e6fa54603763e0892701b3a18b67f7b"} Jun 15 05:53:07.427905 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:07.427862 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:53:07.484486 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:07.484450 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:53:12.257926 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:12.257893 2586 generic.go:356] "Generic (PLEG): container finished" podID="d4b20d67-802a-4a38-b55a-c98bb9bfa1a0" containerID="076d893c528a20562d1535c506786680a4e28c8d1b72776e2eeca5a4492481fd" exitCode=0 Jun 15 05:53:12.258284 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:12.257968 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t" event={"ID":"d4b20d67-802a-4a38-b55a-c98bb9bfa1a0","Type":"ContainerDied","Data":"076d893c528a20562d1535c506786680a4e28c8d1b72776e2eeca5a4492481fd"} Jun 15 05:53:12.258284 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:12.258266 2586 scope.go:117] "RemoveContainer" containerID="076d893c528a20562d1535c506786680a4e28c8d1b72776e2eeca5a4492481fd" Jun 15 05:53:13.264123 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:13.264089 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-djl2t" event={"ID":"d4b20d67-802a-4a38-b55a-c98bb9bfa1a0","Type":"ContainerStarted","Data":"35f80ee75a6f321d660368192cdb950434132cd9c3efdd718fc215cd2defdd89"} Jun 15 05:53:21.444977 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:21.444883 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:21.461789 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:21.461756 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:22.316045 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:22.316008 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:34.210870 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:34.210832 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:53:34.569875 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:34.569842 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:53:35.409525 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:35.409491 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 05:53:35.410013 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:35.409837 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="alertmanager" containerID="cri-o://a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c" gracePeriod=120 Jun 15 05:53:35.410013 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:35.409872 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="kube-rbac-proxy-metric" containerID="cri-o://170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875" gracePeriod=120 Jun 15 05:53:35.410013 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:35.409926 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="kube-rbac-proxy-web" containerID="cri-o://c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5" gracePeriod=120 Jun 15 05:53:35.410013 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:35.409954 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="kube-rbac-proxy" containerID="cri-o://6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f" gracePeriod=120 Jun 15 05:53:35.410013 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:35.409979 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="config-reloader" containerID="cri-o://63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358" gracePeriod=120 Jun 15 05:53:35.410303 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:35.409926 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="prom-label-proxy" containerID="cri-o://4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282" gracePeriod=120 Jun 15 05:53:36.355751 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.355717 2586 generic.go:356] "Generic (PLEG): container finished" podID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerID="4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282" exitCode=0 Jun 15 05:53:36.355751 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.355741 2586 generic.go:356] "Generic (PLEG): container finished" podID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerID="6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f" exitCode=0 Jun 15 05:53:36.355751 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.355747 2586 generic.go:356] "Generic (PLEG): container finished" podID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerID="63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358" exitCode=0 Jun 15 05:53:36.355751 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.355752 2586 generic.go:356] "Generic (PLEG): container finished" podID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerID="a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c" exitCode=0 Jun 15 05:53:36.356014 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.355792 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1","Type":"ContainerDied","Data":"4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282"} Jun 15 05:53:36.356014 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.355859 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1","Type":"ContainerDied","Data":"6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f"} Jun 15 05:53:36.356014 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.355886 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1","Type":"ContainerDied","Data":"63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358"} Jun 15 05:53:36.356014 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.355910 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1","Type":"ContainerDied","Data":"a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c"} Jun 15 05:53:36.655475 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.655451 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:36.705099 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705070 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-config-out\") pod \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " Jun 15 05:53:36.705367 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705107 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-alertmanager-main-db\") pod \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " Jun 15 05:53:36.705367 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705135 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-metrics-client-ca\") pod \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " Jun 15 05:53:36.705367 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705170 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy-web\") pod \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " Jun 15 05:53:36.705367 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705226 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-alertmanager-trusted-ca-bundle\") pod \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " Jun 15 05:53:36.705367 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705257 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " Jun 15 05:53:36.705367 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705285 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2vx2\" (UniqueName: \"kubernetes.io/projected/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-kube-api-access-b2vx2\") pod \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " Jun 15 05:53:36.705367 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705315 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy\") pod \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " Jun 15 05:53:36.705367 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705344 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-cluster-tls-config\") pod \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " Jun 15 05:53:36.706151 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705383 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-config-volume\") pod \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " Jun 15 05:53:36.706151 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705411 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-web-config\") pod \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " Jun 15 05:53:36.706151 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705470 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-tls-assets\") pod \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " Jun 15 05:53:36.706151 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705494 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-main-tls\") pod \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\" (UID: \"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1\") " Jun 15 05:53:36.706151 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705525 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" (UID: "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:53:36.706151 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705625 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" (UID: "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:53:36.706151 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705734 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" (UID: "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:53:36.706151 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705840 2586 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-alertmanager-main-db\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:36.706151 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705859 2586 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-metrics-client-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:36.706151 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.705873 2586 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:36.709216 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.709178 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-config-out" (OuterVolumeSpecName: "config-out") pod "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" (UID: "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:53:36.710775 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.710739 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-kube-api-access-b2vx2" (OuterVolumeSpecName: "kube-api-access-b2vx2") pod "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" (UID: "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1"). InnerVolumeSpecName "kube-api-access-b2vx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:53:36.710882 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.710819 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" (UID: "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:53:36.710945 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.710916 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-config-volume" (OuterVolumeSpecName: "config-volume") pod "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" (UID: "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:53:36.713853 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.713757 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" (UID: "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:53:36.713853 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.713830 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" (UID: "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:53:36.714967 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.714944 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" (UID: "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:53:36.715257 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.715218 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" (UID: "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:53:36.718293 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.718256 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" (UID: "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:53:36.725106 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.725076 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-web-config" (OuterVolumeSpecName: "web-config") pod "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" (UID: "80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:53:36.806956 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.806919 2586 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-web-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:36.806956 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.806951 2586 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-tls-assets\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:36.806956 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.806960 2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-main-tls\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:36.807186 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.806969 2586 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-config-out\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:36.807186 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.806979 2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:36.807186 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.806987 2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:36.807186 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.806996 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2vx2\" (UniqueName: \"kubernetes.io/projected/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-kube-api-access-b2vx2\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:36.807186 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.807005 2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:36.807186 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.807013 2586 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-cluster-tls-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:36.807186 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:36.807021 2586 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:37.363769 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.363737 2586 generic.go:356] "Generic (PLEG): container finished" podID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerID="170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875" exitCode=0 Jun 15 05:53:37.363769 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.363762 2586 generic.go:356] "Generic (PLEG): container finished" podID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerID="c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5" exitCode=0 Jun 15 05:53:37.363989 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.363840 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.363989 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.363839 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1","Type":"ContainerDied","Data":"170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875"} Jun 15 05:53:37.364066 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.363991 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1","Type":"ContainerDied","Data":"c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5"} Jun 15 05:53:37.364066 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.364042 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1","Type":"ContainerDied","Data":"b1dc3119b5e9c4232b2ccf10271a5b37bcd1c9000873cf4e5278a93692427035"} Jun 15 05:53:37.364161 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.364063 2586 scope.go:117] "RemoveContainer" containerID="4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282" Jun 15 05:53:37.372372 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.372354 2586 scope.go:117] "RemoveContainer" containerID="170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875" Jun 15 05:53:37.379393 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.379371 2586 scope.go:117] "RemoveContainer" containerID="6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f" Jun 15 05:53:37.386498 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.386473 2586 scope.go:117] "RemoveContainer" containerID="c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5" Jun 15 05:53:37.389110 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.389087 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 05:53:37.394567 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.394541 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 05:53:37.395040 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.395021 2586 scope.go:117] "RemoveContainer" containerID="63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358" Jun 15 05:53:37.402238 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.402219 2586 scope.go:117] "RemoveContainer" containerID="a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c" Jun 15 05:53:37.409859 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.409842 2586 scope.go:117] "RemoveContainer" containerID="405b892f3ea1e6e5a1439d05953ddcca40533078cc7bc3dfa47904e330e46e42" Jun 15 05:53:37.417215 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.417199 2586 scope.go:117] "RemoveContainer" containerID="4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282" Jun 15 05:53:37.417499 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:53:37.417482 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282\": container with ID starting with 4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282 not found: ID does not exist" containerID="4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282" Jun 15 05:53:37.417556 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.417508 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282"} err="failed to get container status \"4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282\": rpc error: code = NotFound desc = could not find container \"4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282\": container with ID starting with 4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282 not found: ID does not exist" Jun 15 05:53:37.417556 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.417524 2586 scope.go:117] "RemoveContainer" containerID="170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875" Jun 15 05:53:37.417730 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:53:37.417713 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875\": container with ID starting with 170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875 not found: ID does not exist" containerID="170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875" Jun 15 05:53:37.417768 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.417740 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875"} err="failed to get container status \"170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875\": rpc error: code = NotFound desc = could not find container \"170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875\": container with ID starting with 170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875 not found: ID does not exist" Jun 15 05:53:37.417768 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.417752 2586 scope.go:117] "RemoveContainer" containerID="6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f" Jun 15 05:53:37.417942 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:53:37.417928 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f\": container with ID starting with 6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f not found: ID does not exist" containerID="6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f" Jun 15 05:53:37.417981 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.417946 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f"} err="failed to get container status \"6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f\": rpc error: code = NotFound desc = could not find container \"6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f\": container with ID starting with 6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f not found: ID does not exist" Jun 15 05:53:37.417981 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.417959 2586 scope.go:117] "RemoveContainer" containerID="c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5" Jun 15 05:53:37.418226 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:53:37.418209 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5\": container with ID starting with c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5 not found: ID does not exist" containerID="c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5" Jun 15 05:53:37.418266 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.418233 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5"} err="failed to get container status \"c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5\": rpc error: code = NotFound desc = could not find container \"c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5\": container with ID starting with c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5 not found: ID does not exist" Jun 15 05:53:37.418266 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.418249 2586 scope.go:117] "RemoveContainer" containerID="63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358" Jun 15 05:53:37.418476 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:53:37.418458 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358\": container with ID starting with 63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358 not found: ID does not exist" containerID="63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358" Jun 15 05:53:37.418523 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.418481 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358"} err="failed to get container status \"63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358\": rpc error: code = NotFound desc = could not find container \"63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358\": container with ID starting with 63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358 not found: ID does not exist" Jun 15 05:53:37.418523 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.418493 2586 scope.go:117] "RemoveContainer" containerID="a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c" Jun 15 05:53:37.418707 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:53:37.418692 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c\": container with ID starting with a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c not found: ID does not exist" containerID="a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c" Jun 15 05:53:37.418745 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.418711 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c"} err="failed to get container status \"a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c\": rpc error: code = NotFound desc = could not find container \"a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c\": container with ID starting with a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c not found: ID does not exist" Jun 15 05:53:37.418745 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.418723 2586 scope.go:117] "RemoveContainer" containerID="405b892f3ea1e6e5a1439d05953ddcca40533078cc7bc3dfa47904e330e46e42" Jun 15 05:53:37.418951 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:53:37.418935 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"405b892f3ea1e6e5a1439d05953ddcca40533078cc7bc3dfa47904e330e46e42\": container with ID starting with 405b892f3ea1e6e5a1439d05953ddcca40533078cc7bc3dfa47904e330e46e42 not found: ID does not exist" containerID="405b892f3ea1e6e5a1439d05953ddcca40533078cc7bc3dfa47904e330e46e42" Jun 15 05:53:37.418995 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.418953 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"405b892f3ea1e6e5a1439d05953ddcca40533078cc7bc3dfa47904e330e46e42"} err="failed to get container status \"405b892f3ea1e6e5a1439d05953ddcca40533078cc7bc3dfa47904e330e46e42\": rpc error: code = NotFound desc = could not find container \"405b892f3ea1e6e5a1439d05953ddcca40533078cc7bc3dfa47904e330e46e42\": container with ID starting with 405b892f3ea1e6e5a1439d05953ddcca40533078cc7bc3dfa47904e330e46e42 not found: ID does not exist" Jun 15 05:53:37.418995 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.418965 2586 scope.go:117] "RemoveContainer" containerID="4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282" Jun 15 05:53:37.419160 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.419141 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282"} err="failed to get container status \"4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282\": rpc error: code = NotFound desc = could not find container \"4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282\": container with ID starting with 4bdf50de1b9f730f8c4fd87931087c9b01e95fafb013502c3fffee6942a27282 not found: ID does not exist" Jun 15 05:53:37.419205 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.419160 2586 scope.go:117] "RemoveContainer" containerID="170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875" Jun 15 05:53:37.419399 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.419381 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875"} err="failed to get container status \"170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875\": rpc error: code = NotFound desc = could not find container \"170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875\": container with ID starting with 170f037cb8c9b56ad86a36ded516ac31c8939cbded5e44efc846deb0b5611875 not found: ID does not exist" Jun 15 05:53:37.419399 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.419399 2586 scope.go:117] "RemoveContainer" containerID="6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f" Jun 15 05:53:37.419777 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.419742 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f"} err="failed to get container status \"6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f\": rpc error: code = NotFound desc = could not find container \"6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f\": container with ID starting with 6b13f0c553485b68c8d571ec55212a601bcdb7c11796d87bd9082fd4f0df3b1f not found: ID does not exist" Jun 15 05:53:37.419877 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.419778 2586 scope.go:117] "RemoveContainer" containerID="c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5" Jun 15 05:53:37.420234 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.420116 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5"} err="failed to get container status \"c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5\": rpc error: code = NotFound desc = could not find container \"c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5\": container with ID starting with c74ba240bf23b021ad060db560bd23ff7f9b2b67a6d2c71d526ff67a4430a6a5 not found: ID does not exist" Jun 15 05:53:37.420234 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.420143 2586 scope.go:117] "RemoveContainer" containerID="63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358" Jun 15 05:53:37.420514 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.420492 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358"} err="failed to get container status \"63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358\": rpc error: code = NotFound desc = could not find container \"63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358\": container with ID starting with 63aa022578b8e03ebb3a3db13d399c5c13cf703ed0274666720e715b9e3eb358 not found: ID does not exist" Jun 15 05:53:37.420590 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.420515 2586 scope.go:117] "RemoveContainer" containerID="a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c" Jun 15 05:53:37.420809 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.420790 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c"} err="failed to get container status \"a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c\": rpc error: code = NotFound desc = could not find container \"a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c\": container with ID starting with a6992d80f43d123471d77b3a51b73a372e20ac344a6bdf659c6b12533d5ffc3c not found: ID does not exist" Jun 15 05:53:37.420883 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.420812 2586 scope.go:117] "RemoveContainer" containerID="405b892f3ea1e6e5a1439d05953ddcca40533078cc7bc3dfa47904e330e46e42" Jun 15 05:53:37.421118 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.421096 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"405b892f3ea1e6e5a1439d05953ddcca40533078cc7bc3dfa47904e330e46e42"} err="failed to get container status \"405b892f3ea1e6e5a1439d05953ddcca40533078cc7bc3dfa47904e330e46e42\": rpc error: code = NotFound desc = could not find container \"405b892f3ea1e6e5a1439d05953ddcca40533078cc7bc3dfa47904e330e46e42\": container with ID starting with 405b892f3ea1e6e5a1439d05953ddcca40533078cc7bc3dfa47904e330e46e42 not found: ID does not exist" Jun 15 05:53:37.421655 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.421637 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 05:53:37.421915 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.421904 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3c16d8d-a40d-4db9-b626-33c62d39fe03" containerName="console" Jun 15 05:53:37.421952 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.421917 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3c16d8d-a40d-4db9-b626-33c62d39fe03" containerName="console" Jun 15 05:53:37.421952 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.421928 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="kube-rbac-proxy" Jun 15 05:53:37.421952 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.421934 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="kube-rbac-proxy" Jun 15 05:53:37.421952 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.421940 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="prom-label-proxy" Jun 15 05:53:37.421952 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.421945 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="prom-label-proxy" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.421956 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b541e040-366d-498b-8e5a-353e5860e633" containerName="registry" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.421961 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="b541e040-366d-498b-8e5a-353e5860e633" containerName="registry" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.421968 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="alertmanager" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.421974 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="alertmanager" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.421980 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="config-reloader" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.421985 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="config-reloader" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.421991 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="kube-rbac-proxy-web" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.421996 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="kube-rbac-proxy-web" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.422005 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="kube-rbac-proxy-metric" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.422010 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="kube-rbac-proxy-metric" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.422017 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="init-config-reloader" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.422022 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="init-config-reloader" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.422066 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="kube-rbac-proxy" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.422073 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="config-reloader" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.422078 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="prom-label-proxy" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.422084 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="b541e040-366d-498b-8e5a-353e5860e633" containerName="registry" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.422090 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="kube-rbac-proxy-metric" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.422096 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="alertmanager" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.422102 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3c16d8d-a40d-4db9-b626-33c62d39fe03" containerName="console" Jun 15 05:53:37.422137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.422107 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" containerName="kube-rbac-proxy-web" Jun 15 05:53:37.426870 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.426853 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.431079 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.430857 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 15 05:53:37.431079 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.430900 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zdsv4\"" Jun 15 05:53:37.431079 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.430937 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 15 05:53:37.431079 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.430963 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 15 05:53:37.431079 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.430906 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 15 05:53:37.431079 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.430933 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 15 05:53:37.431079 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.431072 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 15 05:53:37.431079 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.431077 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 15 05:53:37.431515 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.431110 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 15 05:53:37.435875 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.435858 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 15 05:53:37.444610 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.444585 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 05:53:37.514514 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.514470 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.514708 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.514540 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/144bd52a-8583-4d6c-9bcf-33db6f388dc8-config-out\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.514708 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.514574 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-config-volume\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.514708 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.514598 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.514708 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.514668 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.514708 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.514699 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/144bd52a-8583-4d6c-9bcf-33db6f388dc8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.514956 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.514718 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.514956 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.514738 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.514956 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.514760 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/144bd52a-8583-4d6c-9bcf-33db6f388dc8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.514956 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.514780 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4zqc\" (UniqueName: \"kubernetes.io/projected/144bd52a-8583-4d6c-9bcf-33db6f388dc8-kube-api-access-t4zqc\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.514956 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.514811 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-web-config\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.514956 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.514833 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/144bd52a-8583-4d6c-9bcf-33db6f388dc8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.514956 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.514853 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/144bd52a-8583-4d6c-9bcf-33db6f388dc8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.615932 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.615838 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-web-config\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.615932 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.615881 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/144bd52a-8583-4d6c-9bcf-33db6f388dc8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.615932 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.615904 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/144bd52a-8583-4d6c-9bcf-33db6f388dc8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.615932 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.615925 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.616719 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.615959 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/144bd52a-8583-4d6c-9bcf-33db6f388dc8-config-out\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.616719 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.615994 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-config-volume\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.616719 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.616014 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.616719 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.616043 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.616719 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.616070 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/144bd52a-8583-4d6c-9bcf-33db6f388dc8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.616719 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.616098 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.616719 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.616128 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.616719 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.616158 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/144bd52a-8583-4d6c-9bcf-33db6f388dc8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.616719 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.616188 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4zqc\" (UniqueName: \"kubernetes.io/projected/144bd52a-8583-4d6c-9bcf-33db6f388dc8-kube-api-access-t4zqc\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.616719 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.616300 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/144bd52a-8583-4d6c-9bcf-33db6f388dc8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.617378 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.616803 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/144bd52a-8583-4d6c-9bcf-33db6f388dc8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.617800 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.617767 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/144bd52a-8583-4d6c-9bcf-33db6f388dc8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.619161 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.619131 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/144bd52a-8583-4d6c-9bcf-33db6f388dc8-config-out\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.619553 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.619528 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/144bd52a-8583-4d6c-9bcf-33db6f388dc8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.619932 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.619908 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.620027 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.619943 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-config-volume\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.620027 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.619960 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-web-config\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.620272 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.620255 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.620272 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.620267 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.620389 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.620355 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.621058 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.621042 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/144bd52a-8583-4d6c-9bcf-33db6f388dc8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.627894 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.627876 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4zqc\" (UniqueName: \"kubernetes.io/projected/144bd52a-8583-4d6c-9bcf-33db6f388dc8-kube-api-access-t4zqc\") pod \"alertmanager-main-0\" (UID: \"144bd52a-8583-4d6c-9bcf-33db6f388dc8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.738408 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.738368 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 05:53:37.897134 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:37.897100 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 05:53:37.898167 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:53:37.898146 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144bd52a_8583_4d6c_9bcf_33db6f388dc8.slice/crio-c51c280e934c236cc5f705269eb4ece6139fe61f6594ab6adff442ea2647c885 WatchSource:0}: Error finding container c51c280e934c236cc5f705269eb4ece6139fe61f6594ab6adff442ea2647c885: Status 404 returned error can't find the container with id c51c280e934c236cc5f705269eb4ece6139fe61f6594ab6adff442ea2647c885 Jun 15 05:53:38.044045 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:38.044014 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1" path="/var/lib/kubelet/pods/80284e1d-c7d5-4cf3-b5c3-39683bbe7ef1/volumes" Jun 15 05:53:38.373916 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:38.373884 2586 generic.go:356] "Generic (PLEG): container finished" podID="144bd52a-8583-4d6c-9bcf-33db6f388dc8" containerID="75ec7129999a0378cb689ba1d7c56dc775351c37c04e2775594d687283ef7f71" exitCode=0 Jun 15 05:53:38.374114 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:38.373977 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"144bd52a-8583-4d6c-9bcf-33db6f388dc8","Type":"ContainerDied","Data":"75ec7129999a0378cb689ba1d7c56dc775351c37c04e2775594d687283ef7f71"} Jun 15 05:53:38.374193 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:38.374164 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"144bd52a-8583-4d6c-9bcf-33db6f388dc8","Type":"ContainerStarted","Data":"c51c280e934c236cc5f705269eb4ece6139fe61f6594ab6adff442ea2647c885"} Jun 15 05:53:39.328967 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.328928 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-655797f886-sgr25"] Jun 15 05:53:39.332446 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.332394 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.341070 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.341041 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 15 05:53:39.341178 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.341072 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 15 05:53:39.345919 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.345899 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 15 05:53:39.345919 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.345912 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 15 05:53:39.346373 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.346360 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-k5fch\"" Jun 15 05:53:39.346674 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.346652 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 15 05:53:39.346933 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.346919 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 15 05:53:39.355135 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.355113 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-655797f886-sgr25"] Jun 15 05:53:39.384885 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.384851 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"144bd52a-8583-4d6c-9bcf-33db6f388dc8","Type":"ContainerStarted","Data":"516f1ca3922c180f3c42e3dd08ed5c1324a98c9a01c81eb94dd4b69552ded114"} Jun 15 05:53:39.385247 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.385224 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"144bd52a-8583-4d6c-9bcf-33db6f388dc8","Type":"ContainerStarted","Data":"f580d7c9580d89aa83af4d2ebede3f053b4c7f057c31e338626b87e53b1fa577"} Jun 15 05:53:39.385387 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.385273 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"144bd52a-8583-4d6c-9bcf-33db6f388dc8","Type":"ContainerStarted","Data":"5de670b9f165bccb3cd7c90222582c64cf99695cc23f23a5beae28498ae47966"} Jun 15 05:53:39.385387 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.385312 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"144bd52a-8583-4d6c-9bcf-33db6f388dc8","Type":"ContainerStarted","Data":"122ff28fc791af40168ec6cb0132d70cf0020805e0c677c98528241db3affd1a"} Jun 15 05:53:39.385387 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.385349 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"144bd52a-8583-4d6c-9bcf-33db6f388dc8","Type":"ContainerStarted","Data":"29bf32a4a415ee76fddf93ac604d47c582e0b087bc7733b0253938f1708a8941"} Jun 15 05:53:39.385387 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.385386 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"144bd52a-8583-4d6c-9bcf-33db6f388dc8","Type":"ContainerStarted","Data":"9f17b2222701e6e8fc48e77e8a0d3f68400e0ebd096bf0147f8c286b086e15e7"} Jun 15 05:53:39.432703 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.432658 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbt6s\" (UniqueName: \"kubernetes.io/projected/50d962b5-7d18-464c-8dab-295c601d0ae0-kube-api-access-vbt6s\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.432921 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.432728 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/50d962b5-7d18-464c-8dab-295c601d0ae0-federate-client-tls\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.432921 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.432777 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50d962b5-7d18-464c-8dab-295c601d0ae0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.432921 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.432859 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50d962b5-7d18-464c-8dab-295c601d0ae0-metrics-client-ca\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.433070 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.432932 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50d962b5-7d18-464c-8dab-295c601d0ae0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.433111 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.433072 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/50d962b5-7d18-464c-8dab-295c601d0ae0-secret-telemeter-client\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.433204 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.433170 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50d962b5-7d18-464c-8dab-295c601d0ae0-serving-certs-ca-bundle\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.433274 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.433214 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/50d962b5-7d18-464c-8dab-295c601d0ae0-telemeter-client-tls\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.534125 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.534081 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbt6s\" (UniqueName: \"kubernetes.io/projected/50d962b5-7d18-464c-8dab-295c601d0ae0-kube-api-access-vbt6s\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.534318 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.534145 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/50d962b5-7d18-464c-8dab-295c601d0ae0-federate-client-tls\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.534318 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.534173 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50d962b5-7d18-464c-8dab-295c601d0ae0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.534318 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.534209 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50d962b5-7d18-464c-8dab-295c601d0ae0-metrics-client-ca\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.534318 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.534241 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50d962b5-7d18-464c-8dab-295c601d0ae0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.534318 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.534302 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/50d962b5-7d18-464c-8dab-295c601d0ae0-secret-telemeter-client\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.534613 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.534364 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50d962b5-7d18-464c-8dab-295c601d0ae0-serving-certs-ca-bundle\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.534613 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.534396 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/50d962b5-7d18-464c-8dab-295c601d0ae0-telemeter-client-tls\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.535100 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.535064 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50d962b5-7d18-464c-8dab-295c601d0ae0-metrics-client-ca\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.535292 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.535226 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50d962b5-7d18-464c-8dab-295c601d0ae0-serving-certs-ca-bundle\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.535810 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.535788 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50d962b5-7d18-464c-8dab-295c601d0ae0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.537034 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.537001 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50d962b5-7d18-464c-8dab-295c601d0ae0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.537505 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.537482 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/50d962b5-7d18-464c-8dab-295c601d0ae0-telemeter-client-tls\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.537581 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.537527 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/50d962b5-7d18-464c-8dab-295c601d0ae0-federate-client-tls\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.537581 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.537550 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/50d962b5-7d18-464c-8dab-295c601d0ae0-secret-telemeter-client\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.546227 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.546201 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbt6s\" (UniqueName: \"kubernetes.io/projected/50d962b5-7d18-464c-8dab-295c601d0ae0-kube-api-access-vbt6s\") pod \"telemeter-client-655797f886-sgr25\" (UID: \"50d962b5-7d18-464c-8dab-295c601d0ae0\") " pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.642947 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.642841 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-655797f886-sgr25" Jun 15 05:53:39.682257 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.682205 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6670223650000002 podStartE2EDuration="2.682186899s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.164534ms" isStatefulPod=false podCreationTimestamp="2026-06-15 05:53:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:53:39.438241957 +0000 UTC m=+371.882607763" watchObservedRunningTime="2026-06-15 05:53:39.682186899 +0000 UTC m=+372.126552705" Jun 15 05:53:39.684039 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.684008 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 05:53:39.684599 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.684569 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="prometheus" containerID="cri-o://d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e" gracePeriod=600 Jun 15 05:53:39.685383 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.684744 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8" gracePeriod=600 Jun 15 05:53:39.686395 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.684971 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="kube-rbac-proxy-web" containerID="cri-o://c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3" gracePeriod=600 Jun 15 05:53:39.686533 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.684996 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="kube-rbac-proxy" containerID="cri-o://02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1" gracePeriod=600 Jun 15 05:53:39.686598 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.685018 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="thanos-sidecar" containerID="cri-o://6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0" gracePeriod=600 Jun 15 05:53:39.686709 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.685039 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="config-reloader" containerID="cri-o://783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558" gracePeriod=600 Jun 15 05:53:39.823710 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.823680 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-655797f886-sgr25"] Jun 15 05:53:39.827758 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:53:39.827723 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d962b5_7d18_464c_8dab_295c601d0ae0.slice/crio-a044289f04e01722de1e6cd1bf869816fce4b7e9348848bb6a91adbd063d043e WatchSource:0}: Error finding container a044289f04e01722de1e6cd1bf869816fce4b7e9348848bb6a91adbd063d043e: Status 404 returned error can't find the container with id a044289f04e01722de1e6cd1bf869816fce4b7e9348848bb6a91adbd063d043e Jun 15 05:53:39.829588 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.829572 2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 05:53:39.953385 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:39.953349 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.039315 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.039279 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-0\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.039537 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.039338 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg8cq\" (UniqueName: \"kubernetes.io/projected/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-kube-api-access-xg8cq\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.039537 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.039368 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-tls\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.039684 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.039652 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-2\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.039754 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.039703 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.039754 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.039747 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-kube-rbac-proxy\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.039854 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.039779 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-config-out\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.039854 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.039805 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-1\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.039854 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.039834 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-thanos-prometheus-http-client-file\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.039989 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.039862 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-tls-assets\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.039989 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.039903 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-kubelet-serving-ca-bundle\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.039989 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.039947 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-trusted-ca-bundle\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.039989 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.039972 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-serving-certs-ca-bundle\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.040180 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.039998 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-db\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.040180 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.040029 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.040180 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.040057 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-metrics-client-ca\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.040180 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.040087 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-web-config\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.040180 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.040118 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-metrics-client-certs\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.040180 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.040157 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-grpc-tls\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.040489 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.040217 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-config\") pod \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\" (UID: \"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf\") " Jun 15 05:53:40.040489 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.040459 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:53:40.040597 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.040532 2586 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.041209 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.040926 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:53:40.041209 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.040950 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:53:40.041209 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.040963 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:53:40.041448 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.041250 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:53:40.042073 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.041648 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:53:40.042725 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.042509 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:53:40.044592 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.044564 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:53:40.044700 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.044653 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:53:40.044700 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.044665 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-config-out" (OuterVolumeSpecName: "config-out") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:53:40.045924 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.045890 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-kube-api-access-xg8cq" (OuterVolumeSpecName: "kube-api-access-xg8cq") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "kube-api-access-xg8cq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:53:40.046119 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.046087 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:53:40.047342 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.047288 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:53:40.047793 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.047761 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:53:40.047959 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.047920 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:53:40.048508 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.048459 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:53:40.048508 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.048484 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-config" (OuterVolumeSpecName: "config") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:53:40.048508 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.048494 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:53:40.049551 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.049412 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:53:40.061839 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.061802 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-web-config" (OuterVolumeSpecName: "web-config") pod "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" (UID: "5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 05:53:40.141518 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141471 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141518 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141509 2586 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141518 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141519 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-db\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141518 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141528 2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141829 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141540 2586 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-configmap-metrics-client-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141829 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141549 2586 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-web-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141829 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141557 2586 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-metrics-client-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141829 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141566 2586 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-grpc-tls\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141829 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141574 2586 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141829 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141582 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141829 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141590 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xg8cq\" (UniqueName: \"kubernetes.io/projected/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-kube-api-access-xg8cq\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141829 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141599 2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141829 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141608 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141829 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141617 2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141829 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141625 2586 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-secret-kube-rbac-proxy\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141829 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141633 2586 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-config-out\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141829 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141641 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141829 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141665 2586 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.141829 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.141699 2586 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf-tls-assets\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:53:40.392762 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.392725 2586 generic.go:356] "Generic (PLEG): container finished" podID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerID="5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8" exitCode=0 Jun 15 05:53:40.392762 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.392749 2586 generic.go:356] "Generic (PLEG): container finished" podID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerID="02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1" exitCode=0 Jun 15 05:53:40.392762 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.392756 2586 generic.go:356] "Generic (PLEG): container finished" podID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerID="c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3" exitCode=0 Jun 15 05:53:40.392762 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.392762 2586 generic.go:356] "Generic (PLEG): container finished" podID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerID="6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0" exitCode=0 Jun 15 05:53:40.392762 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.392767 2586 generic.go:356] "Generic (PLEG): container finished" podID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerID="783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558" exitCode=0 Jun 15 05:53:40.392762 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.392772 2586 generic.go:356] "Generic (PLEG): container finished" podID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerID="d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e" exitCode=0 Jun 15 05:53:40.393504 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.392817 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.393504 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.392818 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf","Type":"ContainerDied","Data":"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8"} Jun 15 05:53:40.393504 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.392914 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf","Type":"ContainerDied","Data":"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1"} Jun 15 05:53:40.393504 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.392961 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf","Type":"ContainerDied","Data":"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3"} Jun 15 05:53:40.393504 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.392982 2586 scope.go:117] "RemoveContainer" containerID="5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8" Jun 15 05:53:40.393504 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.393002 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf","Type":"ContainerDied","Data":"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0"} Jun 15 05:53:40.393504 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.393041 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf","Type":"ContainerDied","Data":"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558"} Jun 15 05:53:40.393504 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.393079 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf","Type":"ContainerDied","Data":"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e"} Jun 15 05:53:40.393504 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.393118 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf","Type":"ContainerDied","Data":"f33a899c528792a0a17b776e752b233d77c05b6b9dd8e0f6f946031c39b222a0"} Jun 15 05:53:40.394148 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.394097 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-655797f886-sgr25" event={"ID":"50d962b5-7d18-464c-8dab-295c601d0ae0","Type":"ContainerStarted","Data":"a044289f04e01722de1e6cd1bf869816fce4b7e9348848bb6a91adbd063d043e"} Jun 15 05:53:40.401891 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.401867 2586 scope.go:117] "RemoveContainer" containerID="02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1" Jun 15 05:53:40.410254 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.410232 2586 scope.go:117] "RemoveContainer" containerID="c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3" Jun 15 05:53:40.418519 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.418477 2586 scope.go:117] "RemoveContainer" containerID="6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0" Jun 15 05:53:40.419300 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.419275 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 05:53:40.424175 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.424137 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 05:53:40.427058 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.427037 2586 scope.go:117] "RemoveContainer" containerID="783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558" Jun 15 05:53:40.436127 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.436107 2586 scope.go:117] "RemoveContainer" containerID="d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e" Jun 15 05:53:40.446482 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.446460 2586 scope.go:117] "RemoveContainer" containerID="bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b" Jun 15 05:53:40.453297 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453267 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 05:53:40.453684 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453660 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="init-config-reloader" Jun 15 05:53:40.453684 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453684 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="init-config-reloader" Jun 15 05:53:40.453842 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453698 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="config-reloader" Jun 15 05:53:40.453842 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453706 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="config-reloader" Jun 15 05:53:40.453842 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453717 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="thanos-sidecar" Jun 15 05:53:40.453842 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453726 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="thanos-sidecar" Jun 15 05:53:40.453842 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453737 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="kube-rbac-proxy-thanos" Jun 15 05:53:40.453842 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453745 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="kube-rbac-proxy-thanos" Jun 15 05:53:40.453842 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453756 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="prometheus" Jun 15 05:53:40.453842 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453764 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="prometheus" Jun 15 05:53:40.453842 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453780 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="kube-rbac-proxy-web" Jun 15 05:53:40.453842 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453789 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="kube-rbac-proxy-web" Jun 15 05:53:40.453842 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453801 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="kube-rbac-proxy" Jun 15 05:53:40.453842 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453809 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="kube-rbac-proxy" Jun 15 05:53:40.454382 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453896 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="prometheus" Jun 15 05:53:40.454382 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453910 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="kube-rbac-proxy" Jun 15 05:53:40.454382 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453921 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="config-reloader" Jun 15 05:53:40.454382 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453930 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="kube-rbac-proxy-web" Jun 15 05:53:40.454382 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453939 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="kube-rbac-proxy-thanos" Jun 15 05:53:40.454382 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.453948 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" containerName="thanos-sidecar" Jun 15 05:53:40.456191 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.456171 2586 scope.go:117] "RemoveContainer" containerID="5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8" Jun 15 05:53:40.456668 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:53:40.456648 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8\": container with ID starting with 5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8 not found: ID does not exist" containerID="5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8" Jun 15 05:53:40.456750 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.456678 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8"} err="failed to get container status \"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8\": rpc error: code = NotFound desc = could not find container \"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8\": container with ID starting with 5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8 not found: ID does not exist" Jun 15 05:53:40.456750 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.456709 2586 scope.go:117] "RemoveContainer" containerID="02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1" Jun 15 05:53:40.457031 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:53:40.457010 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1\": container with ID starting with 02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1 not found: ID does not exist" containerID="02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1" Jun 15 05:53:40.457118 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.457039 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1"} err="failed to get container status \"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1\": rpc error: code = NotFound desc = could not find container \"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1\": container with ID starting with 02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1 not found: ID does not exist" Jun 15 05:53:40.457118 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.457056 2586 scope.go:117] "RemoveContainer" containerID="c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3" Jun 15 05:53:40.457373 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:53:40.457345 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3\": container with ID starting with c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3 not found: ID does not exist" containerID="c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3" Jun 15 05:53:40.457471 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.457375 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3"} err="failed to get container status \"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3\": rpc error: code = NotFound desc = could not find container \"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3\": container with ID starting with c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3 not found: ID does not exist" Jun 15 05:53:40.457471 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.457396 2586 scope.go:117] "RemoveContainer" containerID="6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0" Jun 15 05:53:40.458300 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:53:40.458272 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0\": container with ID starting with 6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0 not found: ID does not exist" containerID="6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0" Jun 15 05:53:40.458399 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.458303 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0"} err="failed to get container status \"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0\": rpc error: code = NotFound desc = could not find container \"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0\": container with ID starting with 6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0 not found: ID does not exist" Jun 15 05:53:40.458399 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.458325 2586 scope.go:117] "RemoveContainer" containerID="783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558" Jun 15 05:53:40.458619 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:53:40.458598 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558\": container with ID starting with 783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558 not found: ID does not exist" containerID="783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558" Jun 15 05:53:40.458684 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.458627 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558"} err="failed to get container status \"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558\": rpc error: code = NotFound desc = could not find container \"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558\": container with ID starting with 783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558 not found: ID does not exist" Jun 15 05:53:40.458684 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.458646 2586 scope.go:117] "RemoveContainer" containerID="d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e" Jun 15 05:53:40.459065 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:53:40.459017 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e\": container with ID starting with d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e not found: ID does not exist" containerID="d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e" Jun 15 05:53:40.459065 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.459046 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e"} err="failed to get container status \"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e\": rpc error: code = NotFound desc = could not find container \"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e\": container with ID starting with d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e not found: ID does not exist" Jun 15 05:53:40.459065 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.459067 2586 scope.go:117] "RemoveContainer" containerID="bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b" Jun 15 05:53:40.459896 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.459878 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.460834 ip-10-0-132-4 kubenswrapper[2586]: E0615 05:53:40.460811 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b\": container with ID starting with bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b not found: ID does not exist" containerID="bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b" Jun 15 05:53:40.460917 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.460842 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b"} err="failed to get container status \"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b\": rpc error: code = NotFound desc = could not find container \"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b\": container with ID starting with bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b not found: ID does not exist" Jun 15 05:53:40.460917 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.460863 2586 scope.go:117] "RemoveContainer" containerID="5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8" Jun 15 05:53:40.461175 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.461152 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8"} err="failed to get container status \"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8\": rpc error: code = NotFound desc = could not find container \"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8\": container with ID starting with 5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8 not found: ID does not exist" Jun 15 05:53:40.461261 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.461178 2586 scope.go:117] "RemoveContainer" containerID="02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1" Jun 15 05:53:40.461479 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.461456 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1"} err="failed to get container status \"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1\": rpc error: code = NotFound desc = could not find container \"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1\": container with ID starting with 02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1 not found: ID does not exist" Jun 15 05:53:40.461571 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.461482 2586 scope.go:117] "RemoveContainer" containerID="c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3" Jun 15 05:53:40.461823 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.461802 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3"} err="failed to get container status \"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3\": rpc error: code = NotFound desc = could not find container \"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3\": container with ID starting with c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3 not found: ID does not exist" Jun 15 05:53:40.461899 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.461824 2586 scope.go:117] "RemoveContainer" containerID="6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0" Jun 15 05:53:40.462094 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.462065 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0"} err="failed to get container status \"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0\": rpc error: code = NotFound desc = could not find container \"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0\": container with ID starting with 6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0 not found: ID does not exist" Jun 15 05:53:40.462094 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.462091 2586 scope.go:117] "RemoveContainer" containerID="783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558" Jun 15 05:53:40.462524 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.462504 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 15 05:53:40.462868 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.462727 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 15 05:53:40.463938 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.463057 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 15 05:53:40.463938 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.463164 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 15 05:53:40.463938 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.463220 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 15 05:53:40.463938 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.463330 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 15 05:53:40.463938 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.463354 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 15 05:53:40.463938 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.463459 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 15 05:53:40.463938 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.463520 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 15 05:53:40.463938 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.463600 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558"} err="failed to get container status \"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558\": rpc error: code = NotFound desc = could not find container \"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558\": container with ID starting with 783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558 not found: ID does not exist" Jun 15 05:53:40.463938 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.463621 2586 scope.go:117] "RemoveContainer" containerID="d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e" Jun 15 05:53:40.463938 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.463706 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 15 05:53:40.463938 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.463819 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 15 05:53:40.464572 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.464022 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 15 05:53:40.464572 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.464107 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ed7rq90723i3n\"" Jun 15 05:53:40.464572 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.464034 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e"} err="failed to get container status \"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e\": rpc error: code = NotFound desc = could not find container \"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e\": container with ID starting with d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e not found: ID does not exist" Jun 15 05:53:40.464572 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.464162 2586 scope.go:117] "RemoveContainer" containerID="bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b" Jun 15 05:53:40.464572 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.464324 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d5qzd\"" Jun 15 05:53:40.467197 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.466330 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b"} err="failed to get container status \"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b\": rpc error: code = NotFound desc = could not find container \"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b\": container with ID starting with bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b not found: ID does not exist" Jun 15 05:53:40.467197 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.466377 2586 scope.go:117] "RemoveContainer" containerID="5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8" Jun 15 05:53:40.467197 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.466788 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8"} err="failed to get container status \"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8\": rpc error: code = NotFound desc = could not find container \"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8\": container with ID starting with 5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8 not found: ID does not exist" Jun 15 05:53:40.467197 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.466813 2586 scope.go:117] "RemoveContainer" containerID="02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1" Jun 15 05:53:40.467197 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.467020 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1"} err="failed to get container status \"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1\": rpc error: code = NotFound desc = could not find container \"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1\": container with ID starting with 02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1 not found: ID does not exist" Jun 15 05:53:40.467197 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.467045 2586 scope.go:117] "RemoveContainer" containerID="c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3" Jun 15 05:53:40.467571 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.467253 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 15 05:53:40.467727 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.467697 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3"} err="failed to get container status \"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3\": rpc error: code = NotFound desc = could not find container \"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3\": container with ID starting with c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3 not found: ID does not exist" Jun 15 05:53:40.467727 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.467726 2586 scope.go:117] "RemoveContainer" containerID="6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0" Jun 15 05:53:40.468052 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.468024 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0"} err="failed to get container status \"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0\": rpc error: code = NotFound desc = could not find container \"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0\": container with ID starting with 6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0 not found: ID does not exist" Jun 15 05:53:40.468052 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.468049 2586 scope.go:117] "RemoveContainer" containerID="783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558" Jun 15 05:53:40.468449 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.468342 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558"} err="failed to get container status \"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558\": rpc error: code = NotFound desc = could not find container \"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558\": container with ID starting with 783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558 not found: ID does not exist" Jun 15 05:53:40.468449 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.468366 2586 scope.go:117] "RemoveContainer" containerID="d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e" Jun 15 05:53:40.468769 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.468680 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e"} err="failed to get container status \"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e\": rpc error: code = NotFound desc = could not find container \"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e\": container with ID starting with d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e not found: ID does not exist" Jun 15 05:53:40.468769 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.468713 2586 scope.go:117] "RemoveContainer" containerID="bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b" Jun 15 05:53:40.469040 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.468968 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b"} err="failed to get container status \"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b\": rpc error: code = NotFound desc = could not find container \"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b\": container with ID starting with bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b not found: ID does not exist" Jun 15 05:53:40.469040 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.468991 2586 scope.go:117] "RemoveContainer" containerID="5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8" Jun 15 05:53:40.469661 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.469576 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8"} err="failed to get container status \"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8\": rpc error: code = NotFound desc = could not find container \"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8\": container with ID starting with 5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8 not found: ID does not exist" Jun 15 05:53:40.469661 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.469599 2586 scope.go:117] "RemoveContainer" containerID="02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1" Jun 15 05:53:40.469945 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.469875 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1"} err="failed to get container status \"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1\": rpc error: code = NotFound desc = could not find container \"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1\": container with ID starting with 02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1 not found: ID does not exist" Jun 15 05:53:40.469945 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.469898 2586 scope.go:117] "RemoveContainer" containerID="c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3" Jun 15 05:53:40.470562 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.470388 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3"} err="failed to get container status \"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3\": rpc error: code = NotFound desc = could not find container \"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3\": container with ID starting with c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3 not found: ID does not exist" Jun 15 05:53:40.470562 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.470413 2586 scope.go:117] "RemoveContainer" containerID="6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0" Jun 15 05:53:40.471012 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.470878 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0"} err="failed to get container status \"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0\": rpc error: code = NotFound desc = could not find container \"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0\": container with ID starting with 6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0 not found: ID does not exist" Jun 15 05:53:40.471012 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.470914 2586 scope.go:117] "RemoveContainer" containerID="783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558" Jun 15 05:53:40.471217 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.471147 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 15 05:53:40.471499 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.471355 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558"} err="failed to get container status \"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558\": rpc error: code = NotFound desc = could not find container \"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558\": container with ID starting with 783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558 not found: ID does not exist" Jun 15 05:53:40.471499 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.471382 2586 scope.go:117] "RemoveContainer" containerID="d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e" Jun 15 05:53:40.472056 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.472030 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e"} err="failed to get container status \"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e\": rpc error: code = NotFound desc = could not find container \"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e\": container with ID starting with d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e not found: ID does not exist" Jun 15 05:53:40.472132 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.472057 2586 scope.go:117] "RemoveContainer" containerID="bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b" Jun 15 05:53:40.472458 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.472337 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b"} err="failed to get container status \"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b\": rpc error: code = NotFound desc = could not find container \"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b\": container with ID starting with bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b not found: ID does not exist" Jun 15 05:53:40.472458 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.472362 2586 scope.go:117] "RemoveContainer" containerID="5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8" Jun 15 05:53:40.473119 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.472836 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8"} err="failed to get container status \"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8\": rpc error: code = NotFound desc = could not find container \"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8\": container with ID starting with 5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8 not found: ID does not exist" Jun 15 05:53:40.473119 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.472863 2586 scope.go:117] "RemoveContainer" containerID="02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1" Jun 15 05:53:40.473636 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.473165 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1"} err="failed to get container status \"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1\": rpc error: code = NotFound desc = could not find container \"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1\": container with ID starting with 02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1 not found: ID does not exist" Jun 15 05:53:40.473636 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.473193 2586 scope.go:117] "RemoveContainer" containerID="c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3" Jun 15 05:53:40.475521 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.475402 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3"} err="failed to get container status \"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3\": rpc error: code = NotFound desc = could not find container \"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3\": container with ID starting with c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3 not found: ID does not exist" Jun 15 05:53:40.475521 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.475450 2586 scope.go:117] "RemoveContainer" containerID="6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0" Jun 15 05:53:40.475767 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.475680 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 05:53:40.476496 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.476356 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0"} err="failed to get container status \"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0\": rpc error: code = NotFound desc = could not find container \"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0\": container with ID starting with 6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0 not found: ID does not exist" Jun 15 05:53:40.476496 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.476381 2586 scope.go:117] "RemoveContainer" containerID="783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558" Jun 15 05:53:40.479630 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.479597 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558"} err="failed to get container status \"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558\": rpc error: code = NotFound desc = could not find container \"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558\": container with ID starting with 783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558 not found: ID does not exist" Jun 15 05:53:40.479630 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.479626 2586 scope.go:117] "RemoveContainer" containerID="d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e" Jun 15 05:53:40.479975 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.479883 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e"} err="failed to get container status \"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e\": rpc error: code = NotFound desc = could not find container \"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e\": container with ID starting with d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e not found: ID does not exist" Jun 15 05:53:40.479975 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.479902 2586 scope.go:117] "RemoveContainer" containerID="bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b" Jun 15 05:53:40.480533 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.480306 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b"} err="failed to get container status \"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b\": rpc error: code = NotFound desc = could not find container \"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b\": container with ID starting with bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b not found: ID does not exist" Jun 15 05:53:40.480533 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.480332 2586 scope.go:117] "RemoveContainer" containerID="5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8" Jun 15 05:53:40.480883 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.480775 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8"} err="failed to get container status \"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8\": rpc error: code = NotFound desc = could not find container \"5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8\": container with ID starting with 5c9a7e3db00975f0bcbb1c560659d95eec8fb278118214f95d9713262678aef8 not found: ID does not exist" Jun 15 05:53:40.480883 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.480803 2586 scope.go:117] "RemoveContainer" containerID="02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1" Jun 15 05:53:40.481225 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.481141 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1"} err="failed to get container status \"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1\": rpc error: code = NotFound desc = could not find container \"02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1\": container with ID starting with 02cd2af5f484e961c19f546f8d8760512018f23fd8601c204dca5b2018c1aad1 not found: ID does not exist" Jun 15 05:53:40.481225 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.481164 2586 scope.go:117] "RemoveContainer" containerID="c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3" Jun 15 05:53:40.481630 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.481529 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3"} err="failed to get container status \"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3\": rpc error: code = NotFound desc = could not find container \"c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3\": container with ID starting with c5a08c9ac42f973652d41e999ace301120013dbdd4c8c4617fdad45f015d16c3 not found: ID does not exist" Jun 15 05:53:40.481630 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.481552 2586 scope.go:117] "RemoveContainer" containerID="6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0" Jun 15 05:53:40.482093 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.481965 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0"} err="failed to get container status \"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0\": rpc error: code = NotFound desc = could not find container \"6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0\": container with ID starting with 6efbeb0b4ce166c2371b5c4b6a96bb95567559d4590083f3737f56e6ec50dde0 not found: ID does not exist" Jun 15 05:53:40.482093 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.482005 2586 scope.go:117] "RemoveContainer" containerID="783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558" Jun 15 05:53:40.482299 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.482277 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558"} err="failed to get container status \"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558\": rpc error: code = NotFound desc = could not find container \"783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558\": container with ID starting with 783ab0c5859711b7f7a31c2aea4a481cab3170733025a5f5338deab7e37e1558 not found: ID does not exist" Jun 15 05:53:40.482451 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.482301 2586 scope.go:117] "RemoveContainer" containerID="d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e" Jun 15 05:53:40.482702 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.482680 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e"} err="failed to get container status \"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e\": rpc error: code = NotFound desc = could not find container \"d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e\": container with ID starting with d6d80d72b93806671f16952b4a6668ac930274a8959b9f13adc09927db2e5e3e not found: ID does not exist" Jun 15 05:53:40.482798 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.482704 2586 scope.go:117] "RemoveContainer" containerID="bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b" Jun 15 05:53:40.483030 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.483010 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b"} err="failed to get container status \"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b\": rpc error: code = NotFound desc = could not find container \"bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b\": container with ID starting with bf90e72e3c32d5f1235ad0d064a37467f1bb94da0c32092e0ef836ecf04cb36b not found: ID does not exist" Jun 15 05:53:40.545715 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.545675 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.545715 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.545711 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/194d2c03-c48f-4571-814b-8b767d691fac-config-out\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.545952 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.545730 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.545952 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.545750 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.545952 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.545821 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.545952 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.545883 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.545952 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.545913 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.546166 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.545955 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-config\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.546166 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.545980 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.546166 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.546033 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.546166 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.546056 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.546166 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.546088 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vv7g\" (UniqueName: \"kubernetes.io/projected/194d2c03-c48f-4571-814b-8b767d691fac-kube-api-access-4vv7g\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.546166 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.546131 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-web-config\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.546166 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.546155 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.546407 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.546172 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/194d2c03-c48f-4571-814b-8b767d691fac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.546407 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.546188 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.546407 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.546204 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.546407 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.546232 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/194d2c03-c48f-4571-814b-8b767d691fac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.546407 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.546260 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.546407 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.546295 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.647226 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.647134 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.647226 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.647190 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.647226 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.647219 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.647539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.647257 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-config\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.647539 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.647285 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.647684 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.647646 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.647802 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.647691 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.647802 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.647731 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vv7g\" (UniqueName: \"kubernetes.io/projected/194d2c03-c48f-4571-814b-8b767d691fac-kube-api-access-4vv7g\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.647802 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.647761 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-web-config\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.647802 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.647789 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.648038 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.647815 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/194d2c03-c48f-4571-814b-8b767d691fac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.648038 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.647838 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.648038 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.647863 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.648038 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.647910 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/194d2c03-c48f-4571-814b-8b767d691fac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.648038 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.647941 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.648038 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.647974 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.648038 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.648010 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.648038 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.648034 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/194d2c03-c48f-4571-814b-8b767d691fac-config-out\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.648407 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.648066 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.648407 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.648081 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.648407 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.648104 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.648775 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.648707 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.649182 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.649154 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.650846 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.649267 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.650846 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.649838 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.650846 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.650150 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/194d2c03-c48f-4571-814b-8b767d691fac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.652059 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.651057 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-web-config\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.652059 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.651180 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.652059 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.651634 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.652059 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.651652 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.652059 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.652041 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-config\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.652606 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.652546 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/194d2c03-c48f-4571-814b-8b767d691fac-config-out\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.652965 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.652919 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.653684 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.653658 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.654467 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.654442 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.654561 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.654538 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/194d2c03-c48f-4571-814b-8b767d691fac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.654890 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.654867 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/194d2c03-c48f-4571-814b-8b767d691fac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.655589 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.655567 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.656000 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.655975 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/194d2c03-c48f-4571-814b-8b767d691fac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.662039 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.662015 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vv7g\" (UniqueName: \"kubernetes.io/projected/194d2c03-c48f-4571-814b-8b767d691fac-kube-api-access-4vv7g\") pod \"prometheus-k8s-0\" (UID: \"194d2c03-c48f-4571-814b-8b767d691fac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.801804 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.801756 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:40.962484 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:40.957301 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 05:53:41.402046 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:41.402009 2586 generic.go:356] "Generic (PLEG): container finished" podID="194d2c03-c48f-4571-814b-8b767d691fac" containerID="73474402fc1a4003881dc12be229a1d4fd443cef43acf3ded0b16b4d41678d36" exitCode=0 Jun 15 05:53:41.402472 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:41.402095 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"194d2c03-c48f-4571-814b-8b767d691fac","Type":"ContainerDied","Data":"73474402fc1a4003881dc12be229a1d4fd443cef43acf3ded0b16b4d41678d36"} Jun 15 05:53:41.402472 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:41.402187 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"194d2c03-c48f-4571-814b-8b767d691fac","Type":"ContainerStarted","Data":"af9df073a53c8f0123bcf0526b824aeb90dce676119073e6c8de3cbe853b2539"} Jun 15 05:53:41.960876 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:41.960842 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs\") pod \"network-metrics-daemon-hx8xj\" (UID: \"e08f6162-b5b3-4beb-af7c-0b23b0635346\") " pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:53:41.963374 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:41.963350 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08f6162-b5b3-4beb-af7c-0b23b0635346-metrics-certs\") pod \"network-metrics-daemon-hx8xj\" (UID: \"e08f6162-b5b3-4beb-af7c-0b23b0635346\") " pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:53:42.044478 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:42.044445 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8qp7w\"" Jun 15 05:53:42.045132 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:42.045112 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf" path="/var/lib/kubelet/pods/5c2f5ae6-ba56-4ea5-8fb5-b978640a14cf/volumes" Jun 15 05:53:42.051176 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:42.051157 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hx8xj" Jun 15 05:53:42.190150 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:42.190124 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hx8xj"] Jun 15 05:53:42.191339 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:53:42.191308 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08f6162_b5b3_4beb_af7c_0b23b0635346.slice/crio-6dc4935323a7503a14e0e41235db70bf87c9f976fa88433632245032b8a54e6a WatchSource:0}: Error finding container 6dc4935323a7503a14e0e41235db70bf87c9f976fa88433632245032b8a54e6a: Status 404 returned error can't find the container with id 6dc4935323a7503a14e0e41235db70bf87c9f976fa88433632245032b8a54e6a Jun 15 05:53:42.409144 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:42.409110 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-655797f886-sgr25" event={"ID":"50d962b5-7d18-464c-8dab-295c601d0ae0","Type":"ContainerStarted","Data":"d6a01ee1c4f6a59b25dd204215362fc49289c6fa178bdecfbecea88a4a6672ab"} Jun 15 05:53:42.409603 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:42.409172 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-655797f886-sgr25" event={"ID":"50d962b5-7d18-464c-8dab-295c601d0ae0","Type":"ContainerStarted","Data":"6f639f1a3bb8a533d23d5140d5f0a7e3c9e32cd2f7986617da2fa9be5eec5a07"} Jun 15 05:53:42.409603 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:42.409203 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-655797f886-sgr25" event={"ID":"50d962b5-7d18-464c-8dab-295c601d0ae0","Type":"ContainerStarted","Data":"e577c641f0ff10fe5a4e14fa6095d4c18f3c125a012ea729b90274fad25c7464"} Jun 15 05:53:42.412569 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:42.412542 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"194d2c03-c48f-4571-814b-8b767d691fac","Type":"ContainerStarted","Data":"eca9f60a71f92d958e11571ecdd388cb68d6d12b8ce3d366ff9ee8388f2f8f1f"} Jun 15 05:53:42.412710 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:42.412602 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"194d2c03-c48f-4571-814b-8b767d691fac","Type":"ContainerStarted","Data":"c6d72f96eaa6b199ea79537a562c2a25d07dd1a6008a2301cead9eb661bc7abd"} Jun 15 05:53:42.412710 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:42.412640 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"194d2c03-c48f-4571-814b-8b767d691fac","Type":"ContainerStarted","Data":"28e0b5ceccfff4f37afe51ca8654a0de1d65fde5f74d4182ed3c560965f83fac"} Jun 15 05:53:42.412710 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:42.412679 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"194d2c03-c48f-4571-814b-8b767d691fac","Type":"ContainerStarted","Data":"8f12484a4899060c8cbfe5eaa9230adde87eb95fefff8cd6f381204def1603e6"} Jun 15 05:53:42.412832 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:42.412716 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"194d2c03-c48f-4571-814b-8b767d691fac","Type":"ContainerStarted","Data":"54e41d303c5330280c1e899fed92661b212b65435507bd02c7331b3ce52f8375"} Jun 15 05:53:42.412832 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:42.412744 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"194d2c03-c48f-4571-814b-8b767d691fac","Type":"ContainerStarted","Data":"b7208b93cadd5691dd3236057c197f4dd0e7a6ae3a1969c1db08e3ea1d17ec89"} Jun 15 05:53:42.413618 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:42.413598 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hx8xj" event={"ID":"e08f6162-b5b3-4beb-af7c-0b23b0635346","Type":"ContainerStarted","Data":"6dc4935323a7503a14e0e41235db70bf87c9f976fa88433632245032b8a54e6a"} Jun 15 05:53:42.441943 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:42.441840 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-655797f886-sgr25" podStartSLOduration=1.6830856299999999 podStartE2EDuration="3.441826205s" totalImagesPullingTime="1.758740575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:53:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:53:42.440330534 +0000 UTC m=+374.884696339" watchObservedRunningTime="2026-06-15 05:53:42.441826205 +0000 UTC m=+374.886192014" Jun 15 05:53:42.497173 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:42.497109 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.473092705 podStartE2EDuration="2.497089468s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.996763ms" isStatefulPod=false podCreationTimestamp="2026-06-15 05:53:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:53:42.495866904 +0000 UTC m=+374.940232735" watchObservedRunningTime="2026-06-15 05:53:42.497089468 +0000 UTC m=+374.941455274" Jun 15 05:53:43.508622 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:43.508537 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:53:43.628203 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:43.628111 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:53:43.728037 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:43.728006 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:53:43.813255 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:43.813220 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:53:44.234068 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:44.234030 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:53:44.296798 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:44.296766 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:53:44.424841 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:44.424804 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hx8xj" event={"ID":"e08f6162-b5b3-4beb-af7c-0b23b0635346","Type":"ContainerStarted","Data":"7f81c377be081ce6d2fb76ad1a44cef64fc05005cec9538d9e5d4a8107dbeb5a"} Jun 15 05:53:44.425017 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:44.424858 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hx8xj" event={"ID":"e08f6162-b5b3-4beb-af7c-0b23b0635346","Type":"ContainerStarted","Data":"c89352821fd65117bee3fed7483bf7fa4fef3dfb1d98ee62d8a7c75ba13e249b"} Jun 15 05:53:44.618483 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:44.618451 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:53:44.678710 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:44.678678 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:53:45.802210 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:45.802171 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:53:53.870219 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:53.870180 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:53:53.929039 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:53.929003 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:53:54.922288 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:54.922227 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:53:55.026075 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:55.025981 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:53:55.093601 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:53:55.093568 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:54:07.704558 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:54:07.704523 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:54:28.344467 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:54:28.344411 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:54:28.445560 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:54:28.445521 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:54:40.802101 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:54:40.802053 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:54:40.818729 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:54:40.818702 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:54:40.850871 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:54:40.850806 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hx8xj" podStartSLOduration=431.680932022 podStartE2EDuration="7m12.850785256s" totalImagesPullingTime="1.169853234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:53:44.480333652 +0000 UTC m=+376.924699457" watchObservedRunningTime="2026-06-15 05:54:40.850785256 +0000 UTC m=+433.295151064" Jun 15 05:54:41.678025 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:54:41.677998 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 05:54:49.716273 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:54:49.716190 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:54:49.784126 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:54:49.784092 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:54:57.250364 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:54:57.250320 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:54:57.314611 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:54:57.314573 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:01.548345 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:01.548268 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:01.645841 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:01.645796 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:07.478656 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:07.478611 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:07.597262 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:07.597225 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:07.812505 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:07.812473 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:08.309137 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:08.309103 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:08.396611 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:08.396579 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:08.454871 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:08.454835 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:21.948117 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:21.948070 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:22.043328 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:22.043297 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:38.641373 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:38.641339 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:38.724265 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:38.724232 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:38.966677 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:38.966588 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:39.081071 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:39.081037 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:39.161224 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:39.161185 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:57.783523 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:57.783481 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:55:59.763923 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:55:59.763890 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:56:00.484838 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:56:00.484806 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:56:00.593443 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:56:00.593389 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:56:05.969206 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:56:05.969168 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:56:06.073106 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:56:06.073066 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:56:06.224987 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:56:06.224906 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:56:06.416890 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:56:06.416851 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:56:06.645812 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:56:06.645776 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:56:06.722046 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:56:06.722010 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:56:06.790184 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:56:06.790147 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:56:07.094005 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:56:07.093958 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:56:07.317113 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:56:07.317077 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:56:07.663360 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:56:07.663328 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:56:08.016986 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:56:08.016954 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:56:08.119758 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:56:08.119722 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:56:18.403305 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:56:18.403256 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:56:18.503453 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:56:18.503402 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:57:16.235817 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:57:16.235776 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:57:16.346665 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:57:16.346567 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:57:16.484776 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:57:16.484742 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:57:16.561153 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:57:16.561116 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:57:16.798613 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:57:16.798585 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:57:17.446340 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:57:17.446306 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:57:17.540257 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:57:17.540222 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:57:17.640883 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:57:17.640848 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:57:28.024083 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:57:28.024054 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 05:57:28.025696 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:57:28.025626 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 05:57:56.278608 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:57:56.278520 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:57:57.357294 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:57:57.357262 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:57:58.428568 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:57:58.428535 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:57:58.485771 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:57:58.485737 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:58:25.573157 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:25.573124 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:58:25.653222 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:25.653184 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:58:25.715583 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:25.715552 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:58:25.970285 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:25.970198 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:58:26.071181 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:26.071145 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:58:26.183120 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:26.183089 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:58:41.722388 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:41.722355 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-qsglc"] Jun 15 05:58:41.725648 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:41.725629 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qsglc" Jun 15 05:58:41.730409 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:41.730375 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jun 15 05:58:41.730554 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:41.730507 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-fb2sw\"" Jun 15 05:58:41.730677 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:41.730657 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jun 15 05:58:41.730932 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:41.730914 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jun 15 05:58:41.742366 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:41.742334 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-qsglc"] Jun 15 05:58:41.764794 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:41.764760 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de47fdb6-e25e-45a4-9182-5073d048696a-model-cache\") pod \"s3-init-qsglc\" (UID: \"de47fdb6-e25e-45a4-9182-5073d048696a\") " pod="kserve/s3-init-qsglc" Jun 15 05:58:41.764955 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:41.764814 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcx6q\" (UniqueName: \"kubernetes.io/projected/de47fdb6-e25e-45a4-9182-5073d048696a-kube-api-access-wcx6q\") pod \"s3-init-qsglc\" (UID: \"de47fdb6-e25e-45a4-9182-5073d048696a\") " pod="kserve/s3-init-qsglc" Jun 15 05:58:41.865887 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:41.865853 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de47fdb6-e25e-45a4-9182-5073d048696a-model-cache\") pod \"s3-init-qsglc\" (UID: \"de47fdb6-e25e-45a4-9182-5073d048696a\") " pod="kserve/s3-init-qsglc" Jun 15 05:58:41.866060 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:41.865901 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcx6q\" (UniqueName: \"kubernetes.io/projected/de47fdb6-e25e-45a4-9182-5073d048696a-kube-api-access-wcx6q\") pod \"s3-init-qsglc\" (UID: \"de47fdb6-e25e-45a4-9182-5073d048696a\") " pod="kserve/s3-init-qsglc" Jun 15 05:58:41.866221 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:41.866202 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de47fdb6-e25e-45a4-9182-5073d048696a-model-cache\") pod \"s3-init-qsglc\" (UID: \"de47fdb6-e25e-45a4-9182-5073d048696a\") " pod="kserve/s3-init-qsglc" Jun 15 05:58:41.875585 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:41.875559 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcx6q\" (UniqueName: \"kubernetes.io/projected/de47fdb6-e25e-45a4-9182-5073d048696a-kube-api-access-wcx6q\") pod \"s3-init-qsglc\" (UID: \"de47fdb6-e25e-45a4-9182-5073d048696a\") " pod="kserve/s3-init-qsglc" Jun 15 05:58:42.044787 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:42.044760 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qsglc" Jun 15 05:58:42.179094 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:42.179065 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-qsglc"] Jun 15 05:58:42.182095 ip-10-0-132-4 kubenswrapper[2586]: W0615 05:58:42.182071 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde47fdb6_e25e_45a4_9182_5073d048696a.slice/crio-a082cac2f08f61a883d47af40dc4bddd70c039ef5438a273c7e2af8f1cf40d40 WatchSource:0}: Error finding container a082cac2f08f61a883d47af40dc4bddd70c039ef5438a273c7e2af8f1cf40d40: Status 404 returned error can't find the container with id a082cac2f08f61a883d47af40dc4bddd70c039ef5438a273c7e2af8f1cf40d40 Jun 15 05:58:42.184373 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:42.184355 2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 05:58:42.617929 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:42.617890 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qsglc" event={"ID":"de47fdb6-e25e-45a4-9182-5073d048696a","Type":"ContainerStarted","Data":"a082cac2f08f61a883d47af40dc4bddd70c039ef5438a273c7e2af8f1cf40d40"} Jun 15 05:58:46.635982 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:46.635943 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qsglc" event={"ID":"de47fdb6-e25e-45a4-9182-5073d048696a","Type":"ContainerStarted","Data":"8d298a7a72f0d8d4d2cfa41119354bd90f93bc35d3f1f9d86fae883b2f5527ce"} Jun 15 05:58:47.641709 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:47.641670 2586 generic.go:356] "Generic (PLEG): container finished" podID="de47fdb6-e25e-45a4-9182-5073d048696a" containerID="8d298a7a72f0d8d4d2cfa41119354bd90f93bc35d3f1f9d86fae883b2f5527ce" exitCode=0 Jun 15 05:58:47.642166 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:47.641735 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qsglc" event={"ID":"de47fdb6-e25e-45a4-9182-5073d048696a","Type":"ContainerDied","Data":"8d298a7a72f0d8d4d2cfa41119354bd90f93bc35d3f1f9d86fae883b2f5527ce"} Jun 15 05:58:52.023682 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:52.023631 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:58:52.122734 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:52.122687 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:58:52.669027 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:52.668944 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qsglc" event={"ID":"de47fdb6-e25e-45a4-9182-5073d048696a","Type":"ContainerStarted","Data":"17e76c25c410ebe0fc085033e73b4dd3baf35c1c6c98ad3e07dce18ac124e3ca"} Jun 15 05:58:52.686451 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:58:52.686360 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-qsglc" podStartSLOduration=2.133903379 podStartE2EDuration="11.686340537s" totalImagesPullingTime="8.268210632s" totalInitContainerRuntime="1.284226526s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:58:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:58:52.685940793 +0000 UTC m=+685.130306599" watchObservedRunningTime="2026-06-15 05:58:52.686340537 +0000 UTC m=+685.130706345" Jun 15 05:59:00.688996 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:00.688957 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:59:03.152648 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:03.152605 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:59:03.205230 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:03.205195 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:59:03.261314 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:03.261279 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:59:47.548529 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:47.548491 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 05:59:57.942703 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:57.942613 2586 generic.go:356] "Generic (PLEG): container finished" podID="de47fdb6-e25e-45a4-9182-5073d048696a" containerID="17e76c25c410ebe0fc085033e73b4dd3baf35c1c6c98ad3e07dce18ac124e3ca" exitCode=0 Jun 15 05:59:57.942703 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:57.942686 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qsglc" event={"ID":"de47fdb6-e25e-45a4-9182-5073d048696a","Type":"ContainerDied","Data":"17e76c25c410ebe0fc085033e73b4dd3baf35c1c6c98ad3e07dce18ac124e3ca"} Jun 15 05:59:59.072128 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:59.072101 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qsglc" Jun 15 05:59:59.163291 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:59.163261 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcx6q\" (UniqueName: \"kubernetes.io/projected/de47fdb6-e25e-45a4-9182-5073d048696a-kube-api-access-wcx6q\") pod \"de47fdb6-e25e-45a4-9182-5073d048696a\" (UID: \"de47fdb6-e25e-45a4-9182-5073d048696a\") " Jun 15 05:59:59.163291 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:59.163298 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de47fdb6-e25e-45a4-9182-5073d048696a-model-cache\") pod \"de47fdb6-e25e-45a4-9182-5073d048696a\" (UID: \"de47fdb6-e25e-45a4-9182-5073d048696a\") " Jun 15 05:59:59.165678 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:59.165645 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de47fdb6-e25e-45a4-9182-5073d048696a-kube-api-access-wcx6q" (OuterVolumeSpecName: "kube-api-access-wcx6q") pod "de47fdb6-e25e-45a4-9182-5073d048696a" (UID: "de47fdb6-e25e-45a4-9182-5073d048696a"). InnerVolumeSpecName "kube-api-access-wcx6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:59:59.182190 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:59.182152 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de47fdb6-e25e-45a4-9182-5073d048696a-model-cache" (OuterVolumeSpecName: "model-cache") pod "de47fdb6-e25e-45a4-9182-5073d048696a" (UID: "de47fdb6-e25e-45a4-9182-5073d048696a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:59:59.264267 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:59.264236 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcx6q\" (UniqueName: \"kubernetes.io/projected/de47fdb6-e25e-45a4-9182-5073d048696a-kube-api-access-wcx6q\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:59:59.264267 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:59.264269 2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de47fdb6-e25e-45a4-9182-5073d048696a-model-cache\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 05:59:59.952651 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:59.952621 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qsglc" Jun 15 05:59:59.952651 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:59.952630 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qsglc" event={"ID":"de47fdb6-e25e-45a4-9182-5073d048696a","Type":"ContainerDied","Data":"a082cac2f08f61a883d47af40dc4bddd70c039ef5438a273c7e2af8f1cf40d40"} Jun 15 05:59:59.952871 ip-10-0-132-4 kubenswrapper[2586]: I0615 05:59:59.952671 2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a082cac2f08f61a883d47af40dc4bddd70c039ef5438a273c7e2af8f1cf40d40" Jun 15 06:00:00.313653 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:00.313617 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:00:00.413109 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:00.413070 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:00:11.227330 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.227295 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:00:11.288748 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.288714 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q"] Jun 15 06:00:11.289034 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.289021 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de47fdb6-e25e-45a4-9182-5073d048696a" containerName="download-hf-model" Jun 15 06:00:11.289080 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.289036 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="de47fdb6-e25e-45a4-9182-5073d048696a" containerName="download-hf-model" Jun 15 06:00:11.289080 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.289045 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de47fdb6-e25e-45a4-9182-5073d048696a" containerName="s3-init" Jun 15 06:00:11.289080 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.289051 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="de47fdb6-e25e-45a4-9182-5073d048696a" containerName="s3-init" Jun 15 06:00:11.289177 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.289112 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="de47fdb6-e25e-45a4-9182-5073d048696a" containerName="s3-init" Jun 15 06:00:11.292614 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.292593 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:11.295235 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.295205 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Jun 15 06:00:11.295409 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.295308 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jun 15 06:00:11.295409 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.295339 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-tjxr4\"" Jun 15 06:00:11.295567 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.295505 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jun 15 06:00:11.295691 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.295574 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Jun 15 06:00:11.295789 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.295773 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jun 15 06:00:11.296164 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.296150 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jun 15 06:00:11.308058 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.308030 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q"] Jun 15 06:00:11.372505 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.372456 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f0a14ab3-458f-4a41-9db1-56c56adf897c-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:11.372719 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.372513 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f0a14ab3-458f-4a41-9db1-56c56adf897c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:11.372719 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.372567 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f0a14ab3-458f-4a41-9db1-56c56adf897c-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:11.372719 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.372606 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzgrl\" (UniqueName: \"kubernetes.io/projected/f0a14ab3-458f-4a41-9db1-56c56adf897c-kube-api-access-tzgrl\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:11.372719 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.372673 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0a14ab3-458f-4a41-9db1-56c56adf897c-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:11.414727 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.414693 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:00:11.473468 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.473434 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f0a14ab3-458f-4a41-9db1-56c56adf897c-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:11.473657 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.473487 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f0a14ab3-458f-4a41-9db1-56c56adf897c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:11.473657 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.473520 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f0a14ab3-458f-4a41-9db1-56c56adf897c-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:11.473657 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.473549 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzgrl\" (UniqueName: \"kubernetes.io/projected/f0a14ab3-458f-4a41-9db1-56c56adf897c-kube-api-access-tzgrl\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:11.473657 ip-10-0-132-4 kubenswrapper[2586]: E0615 06:00:11.473551 2586 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Jun 15 06:00:11.473657 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.473617 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0a14ab3-458f-4a41-9db1-56c56adf897c-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:11.474020 ip-10-0-132-4 kubenswrapper[2586]: E0615 06:00:11.473719 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0a14ab3-458f-4a41-9db1-56c56adf897c-proxy-tls podName:f0a14ab3-458f-4a41-9db1-56c56adf897c nodeName:}" failed. No retries permitted until 2026-06-15 06:00:11.97369793 +0000 UTC m=+764.418063715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/f0a14ab3-458f-4a41-9db1-56c56adf897c-proxy-tls") pod "isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" (UID: "f0a14ab3-458f-4a41-9db1-56c56adf897c") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Jun 15 06:00:11.474115 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.474089 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0a14ab3-458f-4a41-9db1-56c56adf897c-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:11.474307 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.474290 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f0a14ab3-458f-4a41-9db1-56c56adf897c-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:11.474375 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.474320 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f0a14ab3-458f-4a41-9db1-56c56adf897c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:11.488300 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.488230 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzgrl\" (UniqueName: \"kubernetes.io/projected/f0a14ab3-458f-4a41-9db1-56c56adf897c-kube-api-access-tzgrl\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:11.524264 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.524224 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:00:11.578737 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.578697 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw"] Jun 15 06:00:11.582333 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.582309 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:11.584801 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.584778 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Jun 15 06:00:11.584801 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.584793 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Jun 15 06:00:11.591550 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.591524 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw"] Jun 15 06:00:11.647026 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.646984 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:00:11.675191 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.675156 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42mj4\" (UniqueName: \"kubernetes.io/projected/60899697-ea88-42f6-8467-1280c652e6c3-kube-api-access-42mj4\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xllkw\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:11.675365 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.675256 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/60899697-ea88-42f6-8467-1280c652e6c3-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xllkw\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:11.675365 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.675297 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/60899697-ea88-42f6-8467-1280c652e6c3-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xllkw\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:11.675365 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.675347 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/60899697-ea88-42f6-8467-1280c652e6c3-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xllkw\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:11.675571 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.675380 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/60899697-ea88-42f6-8467-1280c652e6c3-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xllkw\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:11.710942 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.710909 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:00:11.776371 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.776334 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/60899697-ea88-42f6-8467-1280c652e6c3-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xllkw\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:11.776569 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.776383 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/60899697-ea88-42f6-8467-1280c652e6c3-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xllkw\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:11.776569 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.776442 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42mj4\" (UniqueName: \"kubernetes.io/projected/60899697-ea88-42f6-8467-1280c652e6c3-kube-api-access-42mj4\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xllkw\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:11.776569 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.776542 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/60899697-ea88-42f6-8467-1280c652e6c3-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xllkw\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:11.776751 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.776603 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/60899697-ea88-42f6-8467-1280c652e6c3-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xllkw\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:11.776751 ip-10-0-132-4 kubenswrapper[2586]: E0615 06:00:11.776719 2586 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-graph-predictor-serving-cert: secret "isvc-xgboost-graph-predictor-serving-cert" not found Jun 15 06:00:11.776857 ip-10-0-132-4 kubenswrapper[2586]: E0615 06:00:11.776794 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60899697-ea88-42f6-8467-1280c652e6c3-proxy-tls podName:60899697-ea88-42f6-8467-1280c652e6c3 nodeName:}" failed. No retries permitted until 2026-06-15 06:00:12.276774217 +0000 UTC m=+764.721140004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/60899697-ea88-42f6-8467-1280c652e6c3-proxy-tls") pod "isvc-xgboost-graph-predictor-555fc69d56-xllkw" (UID: "60899697-ea88-42f6-8467-1280c652e6c3") : secret "isvc-xgboost-graph-predictor-serving-cert" not found Jun 15 06:00:11.776972 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.776948 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/60899697-ea88-42f6-8467-1280c652e6c3-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xllkw\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:11.777149 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.777130 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/60899697-ea88-42f6-8467-1280c652e6c3-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xllkw\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:11.777186 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.777168 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/60899697-ea88-42f6-8467-1280c652e6c3-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xllkw\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:11.788312 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.788277 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42mj4\" (UniqueName: \"kubernetes.io/projected/60899697-ea88-42f6-8467-1280c652e6c3-kube-api-access-42mj4\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xllkw\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:11.910514 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.910477 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:00:11.978111 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:11.978079 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f0a14ab3-458f-4a41-9db1-56c56adf897c-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:11.978279 ip-10-0-132-4 kubenswrapper[2586]: E0615 06:00:11.978237 2586 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Jun 15 06:00:11.978325 ip-10-0-132-4 kubenswrapper[2586]: E0615 06:00:11.978303 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0a14ab3-458f-4a41-9db1-56c56adf897c-proxy-tls podName:f0a14ab3-458f-4a41-9db1-56c56adf897c nodeName:}" failed. No retries permitted until 2026-06-15 06:00:12.978287438 +0000 UTC m=+765.422653222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/f0a14ab3-458f-4a41-9db1-56c56adf897c-proxy-tls") pod "isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" (UID: "f0a14ab3-458f-4a41-9db1-56c56adf897c") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Jun 15 06:00:12.135083 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:12.134996 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:00:12.204772 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:12.204739 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:00:12.281781 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:12.281746 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/60899697-ea88-42f6-8467-1280c652e6c3-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xllkw\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:12.284401 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:12.284375 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/60899697-ea88-42f6-8467-1280c652e6c3-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xllkw\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:12.371391 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:12.371339 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:00:12.492835 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:12.492750 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:12.629007 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:12.628973 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw"] Jun 15 06:00:12.632277 ip-10-0-132-4 kubenswrapper[2586]: W0615 06:00:12.632246 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60899697_ea88_42f6_8467_1280c652e6c3.slice/crio-06b0b864919d4f94cb463dbafdfa681025f5de5f05b2f4119aa3bef0a9781203 WatchSource:0}: Error finding container 06b0b864919d4f94cb463dbafdfa681025f5de5f05b2f4119aa3bef0a9781203: Status 404 returned error can't find the container with id 06b0b864919d4f94cb463dbafdfa681025f5de5f05b2f4119aa3bef0a9781203 Jun 15 06:00:12.658732 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:12.658704 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:00:12.988871 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:12.988832 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f0a14ab3-458f-4a41-9db1-56c56adf897c-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:12.991543 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:12.991515 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f0a14ab3-458f-4a41-9db1-56c56adf897c-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-844fcc5454-69j9q\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:13.008755 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:13.008723 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" event={"ID":"60899697-ea88-42f6-8467-1280c652e6c3","Type":"ContainerStarted","Data":"950ff1b673c73eaa25a18ee9aed3c75f14f1e4e519f70a2a148c8064f192addd"} Jun 15 06:00:13.008894 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:13.008780 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" event={"ID":"60899697-ea88-42f6-8467-1280c652e6c3","Type":"ContainerStarted","Data":"06b0b864919d4f94cb463dbafdfa681025f5de5f05b2f4119aa3bef0a9781203"} Jun 15 06:00:13.103169 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:13.103133 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:13.254457 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:13.254409 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q"] Jun 15 06:00:14.015372 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:14.015328 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" event={"ID":"f0a14ab3-458f-4a41-9db1-56c56adf897c","Type":"ContainerStarted","Data":"38229c71091cf6bfa5e4c4334190d4cc6a98459d7677d131576a10e09b07424f"} Jun 15 06:00:14.015823 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:14.015392 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" event={"ID":"f0a14ab3-458f-4a41-9db1-56c56adf897c","Type":"ContainerStarted","Data":"2d852a51ba08a8e1716419b0577135373c755cbc64a8c19861b7255208a2135d"} Jun 15 06:00:17.029207 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:17.029168 2586 generic.go:356] "Generic (PLEG): container finished" podID="60899697-ea88-42f6-8467-1280c652e6c3" containerID="950ff1b673c73eaa25a18ee9aed3c75f14f1e4e519f70a2a148c8064f192addd" exitCode=0 Jun 15 06:00:17.029806 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:17.029231 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" event={"ID":"60899697-ea88-42f6-8467-1280c652e6c3","Type":"ContainerDied","Data":"950ff1b673c73eaa25a18ee9aed3c75f14f1e4e519f70a2a148c8064f192addd"} Jun 15 06:00:18.035087 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:18.035056 2586 generic.go:356] "Generic (PLEG): container finished" podID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerID="38229c71091cf6bfa5e4c4334190d4cc6a98459d7677d131576a10e09b07424f" exitCode=0 Jun 15 06:00:18.035530 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:18.035112 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" event={"ID":"f0a14ab3-458f-4a41-9db1-56c56adf897c","Type":"ContainerDied","Data":"38229c71091cf6bfa5e4c4334190d4cc6a98459d7677d131576a10e09b07424f"} Jun 15 06:00:42.176803 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:42.176751 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" event={"ID":"60899697-ea88-42f6-8467-1280c652e6c3","Type":"ContainerStarted","Data":"6b377fcadb487e5348eb5ef4080a19ce1333f17ee0d2d82e1ffbe236e832af53"} Jun 15 06:00:42.180645 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:42.180610 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" event={"ID":"f0a14ab3-458f-4a41-9db1-56c56adf897c","Type":"ContainerStarted","Data":"aa47150c8fb7ab322ccb65b7774014ed25b123d4ab9ee41ec525d8f3e8a99009"} Jun 15 06:00:45.197853 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:45.197747 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" event={"ID":"60899697-ea88-42f6-8467-1280c652e6c3","Type":"ContainerStarted","Data":"42a5056701fe90070b43f2d746e3dbc31690e13d02bfb4c45dd9ce4d855f590e"} Jun 15 06:00:45.198318 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:45.197925 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:45.199786 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:45.199762 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" event={"ID":"f0a14ab3-458f-4a41-9db1-56c56adf897c","Type":"ContainerStarted","Data":"60ce5b2f1b17440feac2cfe19200e83e2a224c1c1ee6cfd69fa2ec2cb442c4de"} Jun 15 06:00:45.199924 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:45.199886 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:45.218406 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:45.218348 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" podStartSLOduration=2.604235102 podStartE2EDuration="34.218327513s" totalImagesPullingTime="27.814443358s" totalInitContainerRuntime="3.799649053s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:00:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:00:45.216506369 +0000 UTC m=+797.660872179" watchObservedRunningTime="2026-06-15 06:00:45.218327513 +0000 UTC m=+797.662693318" Jun 15 06:00:45.235307 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:45.235252 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" podStartSLOduration=3.615554077 podStartE2EDuration="34.235233056s" totalImagesPullingTime="26.652740277s" totalInitContainerRuntime="3.966938702s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:00:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:00:45.234977392 +0000 UTC m=+797.679343198" watchObservedRunningTime="2026-06-15 06:00:45.235233056 +0000 UTC m=+797.679598864" Jun 15 06:00:46.204382 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:46.204346 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:46.204842 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:46.204411 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:46.205189 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:46.205162 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jun 15 06:00:46.205248 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:46.205163 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jun 15 06:00:47.208075 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:47.208022 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jun 15 06:00:47.208568 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:47.208085 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jun 15 06:00:52.212733 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:52.212704 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:00:52.213194 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:52.213029 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:00:52.213277 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:52.213251 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jun 15 06:00:52.213866 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:00:52.213842 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jun 15 06:01:02.213374 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:02.213323 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jun 15 06:01:02.213976 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:02.213926 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jun 15 06:01:12.214062 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:12.214017 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jun 15 06:01:12.214559 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:12.214018 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jun 15 06:01:22.213606 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:22.213562 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jun 15 06:01:22.214105 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:22.213725 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jun 15 06:01:31.277368 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:31.277329 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:01:31.530645 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:31.530556 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:01:32.213311 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:32.213273 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jun 15 06:01:32.213748 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:32.213720 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jun 15 06:01:42.213281 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:42.213240 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jun 15 06:01:42.214308 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:42.214290 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:01:45.462993 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:45.462952 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:01:45.583730 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:45.583697 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:01:45.653931 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:45.653899 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:01:45.721673 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:45.721592 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:01:45.863952 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:45.863917 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:01:45.959985 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:45.959953 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:01:48.969900 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:48.969860 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:01:52.213347 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:01:52.213304 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jun 15 06:02:02.214075 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:02.214045 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:02:18.109822 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:18.109735 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:02:18.164598 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:18.164556 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:02:28.052914 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:28.052878 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:02:28.055207 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:28.055183 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:02:28.209735 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:28.209698 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:02:31.233240 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:31.233209 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:02:31.998665 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:31.998629 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:02:41.361335 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:41.361300 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:02:41.474656 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:41.474625 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:02:41.528040 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:41.528004 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q"] Jun 15 06:02:41.528316 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:41.528290 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kserve-container" containerID="cri-o://aa47150c8fb7ab322ccb65b7774014ed25b123d4ab9ee41ec525d8f3e8a99009" gracePeriod=30 Jun 15 06:02:41.528408 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:41.528325 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kube-rbac-proxy" containerID="cri-o://60ce5b2f1b17440feac2cfe19200e83e2a224c1c1ee6cfd69fa2ec2cb442c4de" gracePeriod=30 Jun 15 06:02:41.579693 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:41.579656 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:02:41.653251 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:41.653220 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw"] Jun 15 06:02:41.653546 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:41.653510 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kserve-container" containerID="cri-o://6b377fcadb487e5348eb5ef4080a19ce1333f17ee0d2d82e1ffbe236e832af53" gracePeriod=30 Jun 15 06:02:41.653688 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:41.653620 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kube-rbac-proxy" containerID="cri-o://42a5056701fe90070b43f2d746e3dbc31690e13d02bfb4c45dd9ce4d855f590e" gracePeriod=30 Jun 15 06:02:41.656265 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:41.656202 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:02:41.694795 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:41.694765 2586 generic.go:356] "Generic (PLEG): container finished" podID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerID="60ce5b2f1b17440feac2cfe19200e83e2a224c1c1ee6cfd69fa2ec2cb442c4de" exitCode=2 Jun 15 06:02:41.694955 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:41.694836 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" event={"ID":"f0a14ab3-458f-4a41-9db1-56c56adf897c","Type":"ContainerDied","Data":"60ce5b2f1b17440feac2cfe19200e83e2a224c1c1ee6cfd69fa2ec2cb442c4de"} Jun 15 06:02:41.713853 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:41.713793 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:02:41.981697 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:41.981598 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:02:42.208600 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:42.208556 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.26:8643/healthz\": dial tcp 10.132.0.26:8643: connect: connection refused" Jun 15 06:02:42.208797 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:42.208555 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.27:8643/healthz\": dial tcp 10.132.0.27:8643: connect: connection refused" Jun 15 06:02:42.214157 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:42.214131 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jun 15 06:02:42.214232 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:42.214128 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jun 15 06:02:42.701429 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:42.701395 2586 generic.go:356] "Generic (PLEG): container finished" podID="60899697-ea88-42f6-8467-1280c652e6c3" containerID="42a5056701fe90070b43f2d746e3dbc31690e13d02bfb4c45dd9ce4d855f590e" exitCode=2 Jun 15 06:02:42.701806 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:42.701455 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" event={"ID":"60899697-ea88-42f6-8467-1280c652e6c3","Type":"ContainerDied","Data":"42a5056701fe90070b43f2d746e3dbc31690e13d02bfb4c45dd9ce4d855f590e"} Jun 15 06:02:45.683813 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:45.683768 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:02:45.716612 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:45.716579 2586 generic.go:356] "Generic (PLEG): container finished" podID="60899697-ea88-42f6-8467-1280c652e6c3" containerID="6b377fcadb487e5348eb5ef4080a19ce1333f17ee0d2d82e1ffbe236e832af53" exitCode=0 Jun 15 06:02:45.716784 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:45.716647 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" event={"ID":"60899697-ea88-42f6-8467-1280c652e6c3","Type":"ContainerDied","Data":"6b377fcadb487e5348eb5ef4080a19ce1333f17ee0d2d82e1ffbe236e832af53"} Jun 15 06:02:45.804050 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:45.804027 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:02:45.902582 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:45.902480 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/60899697-ea88-42f6-8467-1280c652e6c3-cabundle-cert\") pod \"60899697-ea88-42f6-8467-1280c652e6c3\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " Jun 15 06:02:45.902582 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:45.902589 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42mj4\" (UniqueName: \"kubernetes.io/projected/60899697-ea88-42f6-8467-1280c652e6c3-kube-api-access-42mj4\") pod \"60899697-ea88-42f6-8467-1280c652e6c3\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " Jun 15 06:02:45.902835 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:45.902627 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/60899697-ea88-42f6-8467-1280c652e6c3-kserve-provision-location\") pod \"60899697-ea88-42f6-8467-1280c652e6c3\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " Jun 15 06:02:45.902835 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:45.902657 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/60899697-ea88-42f6-8467-1280c652e6c3-proxy-tls\") pod \"60899697-ea88-42f6-8467-1280c652e6c3\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " Jun 15 06:02:45.902835 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:45.902686 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/60899697-ea88-42f6-8467-1280c652e6c3-kube-rbac-proxy-sar-config\") pod \"60899697-ea88-42f6-8467-1280c652e6c3\" (UID: \"60899697-ea88-42f6-8467-1280c652e6c3\") " Jun 15 06:02:45.902990 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:45.902942 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60899697-ea88-42f6-8467-1280c652e6c3-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "60899697-ea88-42f6-8467-1280c652e6c3" (UID: "60899697-ea88-42f6-8467-1280c652e6c3"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:02:45.902990 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:45.902948 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60899697-ea88-42f6-8467-1280c652e6c3-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "60899697-ea88-42f6-8467-1280c652e6c3" (UID: "60899697-ea88-42f6-8467-1280c652e6c3"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:02:45.903084 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:45.903047 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60899697-ea88-42f6-8467-1280c652e6c3-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "60899697-ea88-42f6-8467-1280c652e6c3" (UID: "60899697-ea88-42f6-8467-1280c652e6c3"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:02:45.905089 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:45.905071 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60899697-ea88-42f6-8467-1280c652e6c3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "60899697-ea88-42f6-8467-1280c652e6c3" (UID: "60899697-ea88-42f6-8467-1280c652e6c3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 06:02:45.905161 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:45.905132 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60899697-ea88-42f6-8467-1280c652e6c3-kube-api-access-42mj4" (OuterVolumeSpecName: "kube-api-access-42mj4") pod "60899697-ea88-42f6-8467-1280c652e6c3" (UID: "60899697-ea88-42f6-8467-1280c652e6c3"). InnerVolumeSpecName "kube-api-access-42mj4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:02:46.004102 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.004058 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42mj4\" (UniqueName: \"kubernetes.io/projected/60899697-ea88-42f6-8467-1280c652e6c3-kube-api-access-42mj4\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 06:02:46.004102 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.004099 2586 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/60899697-ea88-42f6-8467-1280c652e6c3-kserve-provision-location\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 06:02:46.004102 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.004109 2586 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/60899697-ea88-42f6-8467-1280c652e6c3-proxy-tls\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 06:02:46.004102 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.004119 2586 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/60899697-ea88-42f6-8467-1280c652e6c3-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 06:02:46.004383 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.004127 2586 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/60899697-ea88-42f6-8467-1280c652e6c3-cabundle-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 06:02:46.074838 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.074801 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:02:46.723177 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.723148 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" Jun 15 06:02:46.723627 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.723150 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw" event={"ID":"60899697-ea88-42f6-8467-1280c652e6c3","Type":"ContainerDied","Data":"06b0b864919d4f94cb463dbafdfa681025f5de5f05b2f4119aa3bef0a9781203"} Jun 15 06:02:46.723627 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.723308 2586 scope.go:117] "RemoveContainer" containerID="42a5056701fe90070b43f2d746e3dbc31690e13d02bfb4c45dd9ce4d855f590e" Jun 15 06:02:46.739732 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.739714 2586 scope.go:117] "RemoveContainer" containerID="6b377fcadb487e5348eb5ef4080a19ce1333f17ee0d2d82e1ffbe236e832af53" Jun 15 06:02:46.747401 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.747349 2586 scope.go:117] "RemoveContainer" containerID="950ff1b673c73eaa25a18ee9aed3c75f14f1e4e519f70a2a148c8064f192addd" Jun 15 06:02:46.750546 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.750522 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw"] Jun 15 06:02:46.755949 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.755925 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xllkw"] Jun 15 06:02:46.883026 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.883004 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:02:46.911713 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.911684 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f0a14ab3-458f-4a41-9db1-56c56adf897c-cabundle-cert\") pod \"f0a14ab3-458f-4a41-9db1-56c56adf897c\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " Jun 15 06:02:46.911876 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.911734 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f0a14ab3-458f-4a41-9db1-56c56adf897c-proxy-tls\") pod \"f0a14ab3-458f-4a41-9db1-56c56adf897c\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " Jun 15 06:02:46.911876 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.911758 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f0a14ab3-458f-4a41-9db1-56c56adf897c-kube-rbac-proxy-sar-config\") pod \"f0a14ab3-458f-4a41-9db1-56c56adf897c\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " Jun 15 06:02:46.911876 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.911848 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzgrl\" (UniqueName: \"kubernetes.io/projected/f0a14ab3-458f-4a41-9db1-56c56adf897c-kube-api-access-tzgrl\") pod \"f0a14ab3-458f-4a41-9db1-56c56adf897c\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " Jun 15 06:02:46.911876 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.911873 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0a14ab3-458f-4a41-9db1-56c56adf897c-kserve-provision-location\") pod \"f0a14ab3-458f-4a41-9db1-56c56adf897c\" (UID: \"f0a14ab3-458f-4a41-9db1-56c56adf897c\") " Jun 15 06:02:46.912321 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.912279 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0a14ab3-458f-4a41-9db1-56c56adf897c-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "f0a14ab3-458f-4a41-9db1-56c56adf897c" (UID: "f0a14ab3-458f-4a41-9db1-56c56adf897c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:02:46.912635 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.912329 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0a14ab3-458f-4a41-9db1-56c56adf897c-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f0a14ab3-458f-4a41-9db1-56c56adf897c" (UID: "f0a14ab3-458f-4a41-9db1-56c56adf897c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:02:46.912635 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.912348 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0a14ab3-458f-4a41-9db1-56c56adf897c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "f0a14ab3-458f-4a41-9db1-56c56adf897c" (UID: "f0a14ab3-458f-4a41-9db1-56c56adf897c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:02:46.914168 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.914136 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0a14ab3-458f-4a41-9db1-56c56adf897c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f0a14ab3-458f-4a41-9db1-56c56adf897c" (UID: "f0a14ab3-458f-4a41-9db1-56c56adf897c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 06:02:46.914284 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:46.914172 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0a14ab3-458f-4a41-9db1-56c56adf897c-kube-api-access-tzgrl" (OuterVolumeSpecName: "kube-api-access-tzgrl") pod "f0a14ab3-458f-4a41-9db1-56c56adf897c" (UID: "f0a14ab3-458f-4a41-9db1-56c56adf897c"). InnerVolumeSpecName "kube-api-access-tzgrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:02:47.012733 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.012698 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzgrl\" (UniqueName: \"kubernetes.io/projected/f0a14ab3-458f-4a41-9db1-56c56adf897c-kube-api-access-tzgrl\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 06:02:47.012733 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.012728 2586 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0a14ab3-458f-4a41-9db1-56c56adf897c-kserve-provision-location\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 06:02:47.012733 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.012739 2586 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f0a14ab3-458f-4a41-9db1-56c56adf897c-cabundle-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 06:02:47.012969 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.012748 2586 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f0a14ab3-458f-4a41-9db1-56c56adf897c-proxy-tls\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 06:02:47.012969 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.012756 2586 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f0a14ab3-458f-4a41-9db1-56c56adf897c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 06:02:47.729147 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.729109 2586 generic.go:356] "Generic (PLEG): container finished" podID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerID="aa47150c8fb7ab322ccb65b7774014ed25b123d4ab9ee41ec525d8f3e8a99009" exitCode=0 Jun 15 06:02:47.729644 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.729169 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" Jun 15 06:02:47.729644 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.729200 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" event={"ID":"f0a14ab3-458f-4a41-9db1-56c56adf897c","Type":"ContainerDied","Data":"aa47150c8fb7ab322ccb65b7774014ed25b123d4ab9ee41ec525d8f3e8a99009"} Jun 15 06:02:47.729644 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.729285 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q" event={"ID":"f0a14ab3-458f-4a41-9db1-56c56adf897c","Type":"ContainerDied","Data":"2d852a51ba08a8e1716419b0577135373c755cbc64a8c19861b7255208a2135d"} Jun 15 06:02:47.729644 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.729326 2586 scope.go:117] "RemoveContainer" containerID="60ce5b2f1b17440feac2cfe19200e83e2a224c1c1ee6cfd69fa2ec2cb442c4de" Jun 15 06:02:47.738712 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.738691 2586 scope.go:117] "RemoveContainer" containerID="aa47150c8fb7ab322ccb65b7774014ed25b123d4ab9ee41ec525d8f3e8a99009" Jun 15 06:02:47.746703 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.746680 2586 scope.go:117] "RemoveContainer" containerID="38229c71091cf6bfa5e4c4334190d4cc6a98459d7677d131576a10e09b07424f" Jun 15 06:02:47.751459 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.751437 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q"] Jun 15 06:02:47.755139 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.755118 2586 scope.go:117] "RemoveContainer" containerID="60ce5b2f1b17440feac2cfe19200e83e2a224c1c1ee6cfd69fa2ec2cb442c4de" Jun 15 06:02:47.755330 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.755309 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-844fcc5454-69j9q"] Jun 15 06:02:47.755501 ip-10-0-132-4 kubenswrapper[2586]: E0615 06:02:47.755479 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60ce5b2f1b17440feac2cfe19200e83e2a224c1c1ee6cfd69fa2ec2cb442c4de\": container with ID starting with 60ce5b2f1b17440feac2cfe19200e83e2a224c1c1ee6cfd69fa2ec2cb442c4de not found: ID does not exist" containerID="60ce5b2f1b17440feac2cfe19200e83e2a224c1c1ee6cfd69fa2ec2cb442c4de" Jun 15 06:02:47.755580 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.755514 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60ce5b2f1b17440feac2cfe19200e83e2a224c1c1ee6cfd69fa2ec2cb442c4de"} err="failed to get container status \"60ce5b2f1b17440feac2cfe19200e83e2a224c1c1ee6cfd69fa2ec2cb442c4de\": rpc error: code = NotFound desc = could not find container \"60ce5b2f1b17440feac2cfe19200e83e2a224c1c1ee6cfd69fa2ec2cb442c4de\": container with ID starting with 60ce5b2f1b17440feac2cfe19200e83e2a224c1c1ee6cfd69fa2ec2cb442c4de not found: ID does not exist" Jun 15 06:02:47.755580 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.755540 2586 scope.go:117] "RemoveContainer" containerID="aa47150c8fb7ab322ccb65b7774014ed25b123d4ab9ee41ec525d8f3e8a99009" Jun 15 06:02:47.755838 ip-10-0-132-4 kubenswrapper[2586]: E0615 06:02:47.755821 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa47150c8fb7ab322ccb65b7774014ed25b123d4ab9ee41ec525d8f3e8a99009\": container with ID starting with aa47150c8fb7ab322ccb65b7774014ed25b123d4ab9ee41ec525d8f3e8a99009 not found: ID does not exist" containerID="aa47150c8fb7ab322ccb65b7774014ed25b123d4ab9ee41ec525d8f3e8a99009" Jun 15 06:02:47.755877 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.755848 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa47150c8fb7ab322ccb65b7774014ed25b123d4ab9ee41ec525d8f3e8a99009"} err="failed to get container status \"aa47150c8fb7ab322ccb65b7774014ed25b123d4ab9ee41ec525d8f3e8a99009\": rpc error: code = NotFound desc = could not find container \"aa47150c8fb7ab322ccb65b7774014ed25b123d4ab9ee41ec525d8f3e8a99009\": container with ID starting with aa47150c8fb7ab322ccb65b7774014ed25b123d4ab9ee41ec525d8f3e8a99009 not found: ID does not exist" Jun 15 06:02:47.755877 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.755864 2586 scope.go:117] "RemoveContainer" containerID="38229c71091cf6bfa5e4c4334190d4cc6a98459d7677d131576a10e09b07424f" Jun 15 06:02:47.756125 ip-10-0-132-4 kubenswrapper[2586]: E0615 06:02:47.756109 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38229c71091cf6bfa5e4c4334190d4cc6a98459d7677d131576a10e09b07424f\": container with ID starting with 38229c71091cf6bfa5e4c4334190d4cc6a98459d7677d131576a10e09b07424f not found: ID does not exist" containerID="38229c71091cf6bfa5e4c4334190d4cc6a98459d7677d131576a10e09b07424f" Jun 15 06:02:47.756186 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:47.756128 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38229c71091cf6bfa5e4c4334190d4cc6a98459d7677d131576a10e09b07424f"} err="failed to get container status \"38229c71091cf6bfa5e4c4334190d4cc6a98459d7677d131576a10e09b07424f\": rpc error: code = NotFound desc = could not find container \"38229c71091cf6bfa5e4c4334190d4cc6a98459d7677d131576a10e09b07424f\": container with ID starting with 38229c71091cf6bfa5e4c4334190d4cc6a98459d7677d131576a10e09b07424f not found: ID does not exist" Jun 15 06:02:48.044633 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:48.044601 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60899697-ea88-42f6-8467-1280c652e6c3" path="/var/lib/kubelet/pods/60899697-ea88-42f6-8467-1280c652e6c3/volumes" Jun 15 06:02:48.045115 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:02:48.045102 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" path="/var/lib/kubelet/pods/f0a14ab3-458f-4a41-9db1-56c56adf897c/volumes" Jun 15 06:03:41.509388 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:03:41.509345 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:03:42.669283 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:03:42.669245 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:06:45.745820 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:06:45.745729 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:07:27.837810 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:07:27.837724 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:07:27.898844 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:07:27.898803 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:07:28.078874 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:07:28.078849 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:07:28.082274 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:07:28.082240 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:11:00.541867 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:11:00.541828 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:11:01.608938 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:11:01.608903 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:11:56.855139 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:11:56.855100 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:11:56.957495 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:11:56.957441 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:12:00.735981 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:12:00.735944 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:12:00.947956 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:12:00.947915 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:12:10.825161 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:12:10.825122 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:12:10.934240 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:12:10.934202 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:12:11.033701 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:12:11.033665 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:12:11.096079 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:12:11.095972 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:12:11.526302 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:12:11.526267 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:12:28.105325 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:12:28.105294 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:12:28.109359 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:12:28.109337 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:12:56.405651 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:12:56.405547 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:12:56.462443 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:12:56.462385 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:13:06.524792 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:13:06.524758 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:13:06.599150 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:13:06.599116 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:13:06.662162 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:13:06.662128 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:13:06.724861 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:13:06.724821 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:13:07.025750 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:13:07.025714 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:13:07.391892 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:13:07.391797 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:13:11.009721 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:13:11.009686 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:13:11.083990 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:13:11.083945 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:14:06.723312 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:14:06.723275 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:14:07.099591 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:14:07.099553 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:14:30.361720 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:14:30.361638 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:14:41.558281 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:14:41.558243 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:17:06.699904 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:17:06.699872 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:17:07.902108 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:17:07.902073 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:17:28.135966 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:17:28.135935 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:17:28.140365 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:17:28.140340 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:21:25.751347 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:21:25.751313 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:21:25.832116 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:21:25.832077 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:21:25.892796 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:21:25.892757 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:21:25.962103 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:21:25.962061 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:21:26.160706 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:21:26.160623 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:21:26.264549 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:21:26.264503 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:21:57.961506 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:21:57.961400 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:22:21.531882 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:22:21.531836 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:22:22.692043 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:22:22.692001 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:22:25.931476 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:22:25.931442 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:22:26.428394 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:22:26.428357 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:22:28.162189 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:22:28.162155 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:22:28.167977 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:22:28.167948 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:22:36.052224 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:22:36.052184 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:22:36.152326 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:22:36.152284 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:22:36.220167 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:22:36.220133 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:22:36.274290 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:22:36.274255 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:22:36.685805 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:22:36.685762 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:22:36.786705 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:22:36.786666 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:22:59.280944 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:22:59.280904 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:23:21.729548 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:23:21.729460 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:23:22.564250 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:23:22.564214 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:23:36.234315 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:23:36.234282 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:23:36.372553 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:23:36.372513 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:27:22.709988 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:27:22.709953 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:27:23.671184 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:27:23.671150 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:27:28.189161 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:27:28.189128 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:27:28.194965 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:27:28.194942 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:31:50.962888 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:31:50.962850 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:31:51.051509 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:31:51.051468 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:31:51.102756 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:31:51.102720 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:32:28.215355 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:32:28.215325 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:32:28.223044 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:32:28.223016 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:33:59.342858 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:33:59.342761 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:37:28.241655 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:37:28.241543 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:37:28.255260 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:37:28.255233 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:38:52.299616 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:38:52.299527 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:39:41.172008 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:41.171936 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:39:42.486407 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486370 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4b6vt/must-gather-tpnc6"] Jun 15 06:39:42.486812 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486733 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kserve-container" Jun 15 06:39:42.486812 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486749 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kserve-container" Jun 15 06:39:42.486812 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486766 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kserve-container" Jun 15 06:39:42.486812 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486772 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kserve-container" Jun 15 06:39:42.486812 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486779 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="storage-initializer" Jun 15 06:39:42.486812 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486787 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="storage-initializer" Jun 15 06:39:42.486812 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486793 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kube-rbac-proxy" Jun 15 06:39:42.486812 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486798 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kube-rbac-proxy" Jun 15 06:39:42.486812 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486808 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kube-rbac-proxy" Jun 15 06:39:42.486812 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486814 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kube-rbac-proxy" Jun 15 06:39:42.487114 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486826 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="storage-initializer" Jun 15 06:39:42.487114 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486830 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="storage-initializer" Jun 15 06:39:42.487114 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486884 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kube-rbac-proxy" Jun 15 06:39:42.487114 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486891 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="60899697-ea88-42f6-8467-1280c652e6c3" containerName="kserve-container" Jun 15 06:39:42.487114 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486898 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kserve-container" Jun 15 06:39:42.487114 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.486909 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a14ab3-458f-4a41-9db1-56c56adf897c" containerName="kube-rbac-proxy" Jun 15 06:39:42.490130 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.490108 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4b6vt/must-gather-tpnc6" Jun 15 06:39:42.492372 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.492349 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4b6vt\"/\"kube-root-ca.crt\"" Jun 15 06:39:42.493318 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.493299 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4b6vt\"/\"openshift-service-ca.crt\"" Jun 15 06:39:42.493412 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.493302 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4b6vt\"/\"default-dockercfg-fbnss\"" Jun 15 06:39:42.497087 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.497065 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4b6vt/must-gather-tpnc6"] Jun 15 06:39:42.546360 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.546330 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:39:42.558611 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.558580 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2jqb\" (UniqueName: \"kubernetes.io/projected/72ba92b7-fee7-4aca-a7f7-22b26ae52977-kube-api-access-p2jqb\") pod \"must-gather-tpnc6\" (UID: \"72ba92b7-fee7-4aca-a7f7-22b26ae52977\") " pod="openshift-must-gather-4b6vt/must-gather-tpnc6" Jun 15 06:39:42.558699 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.558617 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/72ba92b7-fee7-4aca-a7f7-22b26ae52977-must-gather-output\") pod \"must-gather-tpnc6\" (UID: \"72ba92b7-fee7-4aca-a7f7-22b26ae52977\") " pod="openshift-must-gather-4b6vt/must-gather-tpnc6" Jun 15 06:39:42.660014 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.659972 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jqb\" (UniqueName: \"kubernetes.io/projected/72ba92b7-fee7-4aca-a7f7-22b26ae52977-kube-api-access-p2jqb\") pod \"must-gather-tpnc6\" (UID: \"72ba92b7-fee7-4aca-a7f7-22b26ae52977\") " pod="openshift-must-gather-4b6vt/must-gather-tpnc6" Jun 15 06:39:42.660014 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.660017 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/72ba92b7-fee7-4aca-a7f7-22b26ae52977-must-gather-output\") pod \"must-gather-tpnc6\" (UID: \"72ba92b7-fee7-4aca-a7f7-22b26ae52977\") " pod="openshift-must-gather-4b6vt/must-gather-tpnc6" Jun 15 06:39:42.660346 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.660327 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/72ba92b7-fee7-4aca-a7f7-22b26ae52977-must-gather-output\") pod \"must-gather-tpnc6\" (UID: \"72ba92b7-fee7-4aca-a7f7-22b26ae52977\") " pod="openshift-must-gather-4b6vt/must-gather-tpnc6" Jun 15 06:39:42.668480 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.668447 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2jqb\" (UniqueName: \"kubernetes.io/projected/72ba92b7-fee7-4aca-a7f7-22b26ae52977-kube-api-access-p2jqb\") pod \"must-gather-tpnc6\" (UID: \"72ba92b7-fee7-4aca-a7f7-22b26ae52977\") " pod="openshift-must-gather-4b6vt/must-gather-tpnc6" Jun 15 06:39:42.810355 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.810320 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4b6vt/must-gather-tpnc6" Jun 15 06:39:42.944049 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.944023 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4b6vt/must-gather-tpnc6"] Jun 15 06:39:42.946107 ip-10-0-132-4 kubenswrapper[2586]: W0615 06:39:42.946082 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72ba92b7_fee7_4aca_a7f7_22b26ae52977.slice/crio-07581c5fa9a4107015b3b7489fe5c0296a40456d49a3185b462c38fdf30fcb30 WatchSource:0}: Error finding container 07581c5fa9a4107015b3b7489fe5c0296a40456d49a3185b462c38fdf30fcb30: Status 404 returned error can't find the container with id 07581c5fa9a4107015b3b7489fe5c0296a40456d49a3185b462c38fdf30fcb30 Jun 15 06:39:42.947835 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:42.947817 2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 06:39:43.727721 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:43.727679 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4b6vt/must-gather-tpnc6" event={"ID":"72ba92b7-fee7-4aca-a7f7-22b26ae52977","Type":"ContainerStarted","Data":"07581c5fa9a4107015b3b7489fe5c0296a40456d49a3185b462c38fdf30fcb30"} Jun 15 06:39:49.760931 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:49.760893 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4b6vt/must-gather-tpnc6" event={"ID":"72ba92b7-fee7-4aca-a7f7-22b26ae52977","Type":"ContainerStarted","Data":"5303e388a4d93a8b3cc33b13aaa1819c67ac5401c351d4fc6310eb602b1eee57"} Jun 15 06:39:49.761452 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:49.760941 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4b6vt/must-gather-tpnc6" event={"ID":"72ba92b7-fee7-4aca-a7f7-22b26ae52977","Type":"ContainerStarted","Data":"398bcb079135c6c047761a949469a42170d3f35dd1170f4e825ae4ceefb6cef3"} Jun 15 06:39:49.778165 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:39:49.778106 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4b6vt/must-gather-tpnc6" podStartSLOduration=1.613934742 podStartE2EDuration="7.778091249s" totalImagesPullingTime="6.164156507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:39:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:39:49.776834777 +0000 UTC m=+3142.221200597" watchObservedRunningTime="2026-06-15 06:39:49.778091249 +0000 UTC m=+3142.222457085" Jun 15 06:40:12.871814 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:12.871777 2586 generic.go:356] "Generic (PLEG): container finished" podID="72ba92b7-fee7-4aca-a7f7-22b26ae52977" containerID="398bcb079135c6c047761a949469a42170d3f35dd1170f4e825ae4ceefb6cef3" exitCode=0 Jun 15 06:40:12.872270 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:12.871851 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4b6vt/must-gather-tpnc6" event={"ID":"72ba92b7-fee7-4aca-a7f7-22b26ae52977","Type":"ContainerDied","Data":"398bcb079135c6c047761a949469a42170d3f35dd1170f4e825ae4ceefb6cef3"} Jun 15 06:40:12.872270 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:12.872170 2586 scope.go:117] "RemoveContainer" containerID="398bcb079135c6c047761a949469a42170d3f35dd1170f4e825ae4ceefb6cef3" Jun 15 06:40:13.040094 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:13.040057 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4b6vt_must-gather-tpnc6_72ba92b7-fee7-4aca-a7f7-22b26ae52977/gather/0.log" Jun 15 06:40:13.494837 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:13.494756 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:40:13.650644 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:13.650605 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:40:13.702107 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:13.702077 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:40:16.398638 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:16.398611 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gq488_451d8df0-b161-46b5-9ffb-0a0d3f608881/global-pull-secret-syncer/0.log" Jun 15 06:40:16.450590 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:16.450558 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" Jun 15 06:40:16.571971 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:16.571943 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-4.ec2.internal_d9e068ea74451873cf30d8effd17b743/haproxy/0.log" Jun 15 06:40:18.486476 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.486438 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-4b6vt/must-gather-tpnc6"] Jun 15 06:40:18.487224 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.486704 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-4b6vt/must-gather-tpnc6" podUID="72ba92b7-fee7-4aca-a7f7-22b26ae52977" containerName="copy" containerID="cri-o://5303e388a4d93a8b3cc33b13aaa1819c67ac5401c351d4fc6310eb602b1eee57" gracePeriod=2 Jun 15 06:40:18.493088 ip-10-0-132-4 kubenswrapper[2586]: E0615 06:40:18.493046 2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-tpnc6\" is forbidden: User \"system:node:ip-10-0-132-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4b6vt\": no relationship found between node 'ip-10-0-132-4.ec2.internal' and this object" podUID="72ba92b7-fee7-4aca-a7f7-22b26ae52977" pod="openshift-must-gather-4b6vt/must-gather-tpnc6" Jun 15 06:40:18.494066 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.494040 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-4b6vt/must-gather-tpnc6"] Jun 15 06:40:18.718067 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.718043 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4b6vt_must-gather-tpnc6_72ba92b7-fee7-4aca-a7f7-22b26ae52977/copy/0.log" Jun 15 06:40:18.719544 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.719527 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4b6vt/must-gather-tpnc6" Jun 15 06:40:18.721890 ip-10-0-132-4 kubenswrapper[2586]: E0615 06:40:18.721863 2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-tpnc6\" is forbidden: User \"system:node:ip-10-0-132-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4b6vt\": no relationship found between node 'ip-10-0-132-4.ec2.internal' and this object" podUID="72ba92b7-fee7-4aca-a7f7-22b26ae52977" pod="openshift-must-gather-4b6vt/must-gather-tpnc6" Jun 15 06:40:18.889199 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.889159 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2jqb\" (UniqueName: \"kubernetes.io/projected/72ba92b7-fee7-4aca-a7f7-22b26ae52977-kube-api-access-p2jqb\") pod \"72ba92b7-fee7-4aca-a7f7-22b26ae52977\" (UID: \"72ba92b7-fee7-4aca-a7f7-22b26ae52977\") " Jun 15 06:40:18.889404 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.889269 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/72ba92b7-fee7-4aca-a7f7-22b26ae52977-must-gather-output\") pod \"72ba92b7-fee7-4aca-a7f7-22b26ae52977\" (UID: \"72ba92b7-fee7-4aca-a7f7-22b26ae52977\") " Jun 15 06:40:18.890726 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.890697 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ba92b7-fee7-4aca-a7f7-22b26ae52977-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "72ba92b7-fee7-4aca-a7f7-22b26ae52977" (UID: "72ba92b7-fee7-4aca-a7f7-22b26ae52977"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:40:18.891638 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.891613 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72ba92b7-fee7-4aca-a7f7-22b26ae52977-kube-api-access-p2jqb" (OuterVolumeSpecName: "kube-api-access-p2jqb") pod "72ba92b7-fee7-4aca-a7f7-22b26ae52977" (UID: "72ba92b7-fee7-4aca-a7f7-22b26ae52977"). InnerVolumeSpecName "kube-api-access-p2jqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:40:18.898889 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.898867 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4b6vt_must-gather-tpnc6_72ba92b7-fee7-4aca-a7f7-22b26ae52977/copy/0.log" Jun 15 06:40:18.899251 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.899217 2586 generic.go:356] "Generic (PLEG): container finished" podID="72ba92b7-fee7-4aca-a7f7-22b26ae52977" containerID="5303e388a4d93a8b3cc33b13aaa1819c67ac5401c351d4fc6310eb602b1eee57" exitCode=143 Jun 15 06:40:18.899329 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.899268 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4b6vt/must-gather-tpnc6" Jun 15 06:40:18.899329 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.899285 2586 scope.go:117] "RemoveContainer" containerID="5303e388a4d93a8b3cc33b13aaa1819c67ac5401c351d4fc6310eb602b1eee57" Jun 15 06:40:18.901494 ip-10-0-132-4 kubenswrapper[2586]: E0615 06:40:18.901464 2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-tpnc6\" is forbidden: User \"system:node:ip-10-0-132-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4b6vt\": no relationship found between node 'ip-10-0-132-4.ec2.internal' and this object" podUID="72ba92b7-fee7-4aca-a7f7-22b26ae52977" pod="openshift-must-gather-4b6vt/must-gather-tpnc6" Jun 15 06:40:18.907544 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.907524 2586 scope.go:117] "RemoveContainer" containerID="398bcb079135c6c047761a949469a42170d3f35dd1170f4e825ae4ceefb6cef3" Jun 15 06:40:18.909550 ip-10-0-132-4 kubenswrapper[2586]: E0615 06:40:18.909514 2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-tpnc6\" is forbidden: User \"system:node:ip-10-0-132-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4b6vt\": no relationship found between node 'ip-10-0-132-4.ec2.internal' and this object" podUID="72ba92b7-fee7-4aca-a7f7-22b26ae52977" pod="openshift-must-gather-4b6vt/must-gather-tpnc6" Jun 15 06:40:18.921185 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.921162 2586 scope.go:117] "RemoveContainer" containerID="5303e388a4d93a8b3cc33b13aaa1819c67ac5401c351d4fc6310eb602b1eee57" Jun 15 06:40:18.921548 ip-10-0-132-4 kubenswrapper[2586]: E0615 06:40:18.921525 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5303e388a4d93a8b3cc33b13aaa1819c67ac5401c351d4fc6310eb602b1eee57\": container with ID starting with 5303e388a4d93a8b3cc33b13aaa1819c67ac5401c351d4fc6310eb602b1eee57 not found: ID does not exist" containerID="5303e388a4d93a8b3cc33b13aaa1819c67ac5401c351d4fc6310eb602b1eee57" Jun 15 06:40:18.921618 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.921556 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5303e388a4d93a8b3cc33b13aaa1819c67ac5401c351d4fc6310eb602b1eee57"} err="failed to get container status \"5303e388a4d93a8b3cc33b13aaa1819c67ac5401c351d4fc6310eb602b1eee57\": rpc error: code = NotFound desc = could not find container \"5303e388a4d93a8b3cc33b13aaa1819c67ac5401c351d4fc6310eb602b1eee57\": container with ID starting with 5303e388a4d93a8b3cc33b13aaa1819c67ac5401c351d4fc6310eb602b1eee57 not found: ID does not exist" Jun 15 06:40:18.921618 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.921576 2586 scope.go:117] "RemoveContainer" containerID="398bcb079135c6c047761a949469a42170d3f35dd1170f4e825ae4ceefb6cef3" Jun 15 06:40:18.921850 ip-10-0-132-4 kubenswrapper[2586]: E0615 06:40:18.921831 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"398bcb079135c6c047761a949469a42170d3f35dd1170f4e825ae4ceefb6cef3\": container with ID starting with 398bcb079135c6c047761a949469a42170d3f35dd1170f4e825ae4ceefb6cef3 not found: ID does not exist" containerID="398bcb079135c6c047761a949469a42170d3f35dd1170f4e825ae4ceefb6cef3" Jun 15 06:40:18.921899 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.921856 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"398bcb079135c6c047761a949469a42170d3f35dd1170f4e825ae4ceefb6cef3"} err="failed to get container status \"398bcb079135c6c047761a949469a42170d3f35dd1170f4e825ae4ceefb6cef3\": rpc error: code = NotFound desc = could not find container \"398bcb079135c6c047761a949469a42170d3f35dd1170f4e825ae4ceefb6cef3\": container with ID starting with 398bcb079135c6c047761a949469a42170d3f35dd1170f4e825ae4ceefb6cef3 not found: ID does not exist" Jun 15 06:40:18.990125 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.990089 2586 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/72ba92b7-fee7-4aca-a7f7-22b26ae52977-must-gather-output\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 06:40:18.990125 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:18.990121 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2jqb\" (UniqueName: \"kubernetes.io/projected/72ba92b7-fee7-4aca-a7f7-22b26ae52977-kube-api-access-p2jqb\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Jun 15 06:40:19.446353 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:19.446317 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:40:19.501229 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:19.501199 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5cfkb_d5723186-ee58-4ca9-937f-60a78d5a4d04/konnectivity-agent/0.log" limit=1024 Jun 15 06:40:20.044271 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:20.044234 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72ba92b7-fee7-4aca-a7f7-22b26ae52977" path="/var/lib/kubelet/pods/72ba92b7-fee7-4aca-a7f7-22b26ae52977/volumes" Jun 15 06:40:20.906102 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:20.906069 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_144bd52a-8583-4d6c-9bcf-33db6f388dc8/alertmanager/0.log" Jun 15 06:40:20.935092 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:20.935054 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_144bd52a-8583-4d6c-9bcf-33db6f388dc8/config-reloader/0.log" Jun 15 06:40:20.965161 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:20.965132 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_144bd52a-8583-4d6c-9bcf-33db6f388dc8/kube-rbac-proxy-web/0.log" Jun 15 06:40:20.989693 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:20.989663 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_144bd52a-8583-4d6c-9bcf-33db6f388dc8/kube-rbac-proxy/0.log" Jun 15 06:40:21.015209 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:21.015186 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_144bd52a-8583-4d6c-9bcf-33db6f388dc8/kube-rbac-proxy-metric/0.log" Jun 15 06:40:21.047360 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:21.047338 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_144bd52a-8583-4d6c-9bcf-33db6f388dc8/prom-label-proxy/0.log" Jun 15 06:40:21.074011 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:21.073982 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_144bd52a-8583-4d6c-9bcf-33db6f388dc8/init-config-reloader/0.log" Jun 15 06:40:21.251849 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:21.251828 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7796c75c49-s79hx_734feb89-7ac0-4d84-be74-35932cc220c1/metrics-server/0.log" Jun 15 06:40:21.483191 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:21.483161 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wvgq6_d3f1a446-f953-4e83-bcee-0491a529dec7/node-exporter/0.log" Jun 15 06:40:21.513012 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:21.512940 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wvgq6_d3f1a446-f953-4e83-bcee-0491a529dec7/kube-rbac-proxy/0.log" Jun 15 06:40:21.543333 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:21.543308 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wvgq6_d3f1a446-f953-4e83-bcee-0491a529dec7/init-textfile/0.log" Jun 15 06:40:21.670000 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:21.669974 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_194d2c03-c48f-4571-814b-8b767d691fac/prometheus/0.log" Jun 15 06:40:21.692186 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:21.692159 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_194d2c03-c48f-4571-814b-8b767d691fac/config-reloader/0.log" Jun 15 06:40:21.718194 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:21.718170 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_194d2c03-c48f-4571-814b-8b767d691fac/thanos-sidecar/0.log" Jun 15 06:40:21.746015 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:21.745985 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_194d2c03-c48f-4571-814b-8b767d691fac/kube-rbac-proxy-web/0.log" Jun 15 06:40:21.777053 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:21.776988 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_194d2c03-c48f-4571-814b-8b767d691fac/kube-rbac-proxy/0.log" Jun 15 06:40:21.805378 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:21.805353 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_194d2c03-c48f-4571-814b-8b767d691fac/kube-rbac-proxy-thanos/0.log" Jun 15 06:40:21.843361 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:21.843336 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_194d2c03-c48f-4571-814b-8b767d691fac/init-config-reloader/0.log" Jun 15 06:40:21.879479 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:21.879397 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-wtpg7_1ae33c38-32d5-4da1-a760-046a9419ae09/prometheus-operator/0.log" Jun 15 06:40:21.959859 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:21.959833 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-wtpg7_1ae33c38-32d5-4da1-a760-046a9419ae09/kube-rbac-proxy/0.log" Jun 15 06:40:22.091916 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:22.091886 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-655797f886-sgr25_50d962b5-7d18-464c-8dab-295c601d0ae0/telemeter-client/0.log" Jun 15 06:40:22.121796 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:22.121770 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-655797f886-sgr25_50d962b5-7d18-464c-8dab-295c601d0ae0/reload/0.log" Jun 15 06:40:22.157364 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:22.157334 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-655797f886-sgr25_50d962b5-7d18-464c-8dab-295c601d0ae0/kube-rbac-proxy/0.log" Jun 15 06:40:23.440880 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:23.440847 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-cz27n_458b7d17-e77f-4343-9178-644fa6ed65b4/networking-console-plugin/0.log" Jun 15 06:40:23.896874 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:23.896841 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/1.log" Jun 15 06:40:23.901528 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:23.901507 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-47jpt_eb5db5db-873d-45de-b051-b6afdc3f8563/console-operator/2.log" Jun 15 06:40:24.395761 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.395727 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t"] Jun 15 06:40:24.396063 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.396051 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72ba92b7-fee7-4aca-a7f7-22b26ae52977" containerName="copy" Jun 15 06:40:24.396110 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.396065 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="72ba92b7-fee7-4aca-a7f7-22b26ae52977" containerName="copy" Jun 15 06:40:24.396110 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.396073 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72ba92b7-fee7-4aca-a7f7-22b26ae52977" containerName="gather" Jun 15 06:40:24.396110 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.396079 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="72ba92b7-fee7-4aca-a7f7-22b26ae52977" containerName="gather" Jun 15 06:40:24.396206 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.396121 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="72ba92b7-fee7-4aca-a7f7-22b26ae52977" containerName="gather" Jun 15 06:40:24.396206 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.396131 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="72ba92b7-fee7-4aca-a7f7-22b26ae52977" containerName="copy" Jun 15 06:40:24.399716 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.399692 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.402313 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.402288 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j8rxx\"/\"openshift-service-ca.crt\"" Jun 15 06:40:24.402412 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.402321 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j8rxx\"/\"kube-root-ca.crt\"" Jun 15 06:40:24.403150 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.403136 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j8rxx\"/\"default-dockercfg-t4kgc\"" Jun 15 06:40:24.408778 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.408753 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t"] Jun 15 06:40:24.536553 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.536512 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af7f4cdb-f780-42da-8ded-4defbbac4345-sys\") pod \"perf-node-gather-daemonset-cm65t\" (UID: \"af7f4cdb-f780-42da-8ded-4defbbac4345\") " pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.536939 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.536566 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af7f4cdb-f780-42da-8ded-4defbbac4345-lib-modules\") pod \"perf-node-gather-daemonset-cm65t\" (UID: \"af7f4cdb-f780-42da-8ded-4defbbac4345\") " pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.536939 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.536647 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhmfg\" (UniqueName: \"kubernetes.io/projected/af7f4cdb-f780-42da-8ded-4defbbac4345-kube-api-access-hhmfg\") pod \"perf-node-gather-daemonset-cm65t\" (UID: \"af7f4cdb-f780-42da-8ded-4defbbac4345\") " pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.536939 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.536670 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/af7f4cdb-f780-42da-8ded-4defbbac4345-proc\") pod \"perf-node-gather-daemonset-cm65t\" (UID: \"af7f4cdb-f780-42da-8ded-4defbbac4345\") " pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.536939 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.536713 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/af7f4cdb-f780-42da-8ded-4defbbac4345-podres\") pod \"perf-node-gather-daemonset-cm65t\" (UID: \"af7f4cdb-f780-42da-8ded-4defbbac4345\") " pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.637621 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.637582 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af7f4cdb-f780-42da-8ded-4defbbac4345-sys\") pod \"perf-node-gather-daemonset-cm65t\" (UID: \"af7f4cdb-f780-42da-8ded-4defbbac4345\") " pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.637795 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.637628 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af7f4cdb-f780-42da-8ded-4defbbac4345-lib-modules\") pod \"perf-node-gather-daemonset-cm65t\" (UID: \"af7f4cdb-f780-42da-8ded-4defbbac4345\") " pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.637795 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.637668 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhmfg\" (UniqueName: \"kubernetes.io/projected/af7f4cdb-f780-42da-8ded-4defbbac4345-kube-api-access-hhmfg\") pod \"perf-node-gather-daemonset-cm65t\" (UID: \"af7f4cdb-f780-42da-8ded-4defbbac4345\") " pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.637795 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.637692 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/af7f4cdb-f780-42da-8ded-4defbbac4345-proc\") pod \"perf-node-gather-daemonset-cm65t\" (UID: \"af7f4cdb-f780-42da-8ded-4defbbac4345\") " pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.637795 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.637720 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/af7f4cdb-f780-42da-8ded-4defbbac4345-podres\") pod \"perf-node-gather-daemonset-cm65t\" (UID: \"af7f4cdb-f780-42da-8ded-4defbbac4345\") " pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.637795 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.637708 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af7f4cdb-f780-42da-8ded-4defbbac4345-sys\") pod \"perf-node-gather-daemonset-cm65t\" (UID: \"af7f4cdb-f780-42da-8ded-4defbbac4345\") " pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.637976 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.637794 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/af7f4cdb-f780-42da-8ded-4defbbac4345-proc\") pod \"perf-node-gather-daemonset-cm65t\" (UID: \"af7f4cdb-f780-42da-8ded-4defbbac4345\") " pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.637976 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.637844 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af7f4cdb-f780-42da-8ded-4defbbac4345-lib-modules\") pod \"perf-node-gather-daemonset-cm65t\" (UID: \"af7f4cdb-f780-42da-8ded-4defbbac4345\") " pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.637976 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.637854 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/af7f4cdb-f780-42da-8ded-4defbbac4345-podres\") pod \"perf-node-gather-daemonset-cm65t\" (UID: \"af7f4cdb-f780-42da-8ded-4defbbac4345\") " pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.646261 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.646199 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhmfg\" (UniqueName: \"kubernetes.io/projected/af7f4cdb-f780-42da-8ded-4defbbac4345-kube-api-access-hhmfg\") pod \"perf-node-gather-daemonset-cm65t\" (UID: \"af7f4cdb-f780-42da-8ded-4defbbac4345\") " pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.710463 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.710385 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:24.842034 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.842005 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t"] Jun 15 06:40:24.844556 ip-10-0-132-4 kubenswrapper[2586]: W0615 06:40:24.844526 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaf7f4cdb_f780_42da_8ded_4defbbac4345.slice/crio-f980e98fcc73f627fa69171c63e59c97f79810a9dd249f122b7796a0cf8bd515 WatchSource:0}: Error finding container f980e98fcc73f627fa69171c63e59c97f79810a9dd249f122b7796a0cf8bd515: Status 404 returned error can't find the container with id f980e98fcc73f627fa69171c63e59c97f79810a9dd249f122b7796a0cf8bd515 Jun 15 06:40:24.924957 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:24.924869 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" event={"ID":"af7f4cdb-f780-42da-8ded-4defbbac4345","Type":"ContainerStarted","Data":"f980e98fcc73f627fa69171c63e59c97f79810a9dd249f122b7796a0cf8bd515"} Jun 15 06:40:25.872830 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:25.872786 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h9zkf_a528d398-c858-4dd2-be98-3a6fc9422529/dns/0.log" Jun 15 06:40:25.896116 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:25.896091 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h9zkf_a528d398-c858-4dd2-be98-3a6fc9422529/kube-rbac-proxy/0.log" Jun 15 06:40:25.930758 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:25.930727 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" event={"ID":"af7f4cdb-f780-42da-8ded-4defbbac4345","Type":"ContainerStarted","Data":"7a6d8476480f02b756acc4b245bac945c8735d51714f7ea4471746e00852b1d2"} Jun 15 06:40:25.930897 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:25.930852 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:25.948262 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:25.948207 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" podStartSLOduration=1.948190103 podStartE2EDuration="1.948190103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 06:40:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:40:25.946626161 +0000 UTC m=+3178.390991964" watchObservedRunningTime="2026-06-15 06:40:25.948190103 +0000 UTC m=+3178.392555939" Jun 15 06:40:26.071690 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:26.071661 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vkl6p_607f39f7-4e69-48b8-9127-b5d6fa14681c/dns-node-resolver/0.log" Jun 15 06:40:26.613943 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:26.613912 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kwpd4_385e0bfa-0d96-489b-a1f3-c83f3ac0066f/node-ca/0.log" Jun 15 06:40:27.427674 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:27.427640 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-958db9c48-7c8vk_f19cd9f9-7da1-4505-99b0-b4b97d240670/router/0.log" Jun 15 06:40:27.848324 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:27.848287 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bldd9_2314ceb2-1069-49a2-b197-5417e717b4c6/serve-healthcheck-canary/0.log" Jun 15 06:40:28.244061 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:28.243985 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-rf87f_16423435-593d-4a83-9d74-75edb172923b/insights-operator/0.log" Jun 15 06:40:28.244772 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:28.244756 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-rf87f_16423435-593d-4a83-9d74-75edb172923b/insights-operator/1.log" Jun 15 06:40:28.333857 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:28.333828 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l4fhk_cb93c3f8-d6f5-4126-84ec-87a7df5f296c/kube-rbac-proxy/0.log" Jun 15 06:40:28.355529 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:28.355504 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l4fhk_cb93c3f8-d6f5-4126-84ec-87a7df5f296c/exporter/0.log" Jun 15 06:40:28.376464 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:28.376436 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l4fhk_cb93c3f8-d6f5-4126-84ec-87a7df5f296c/extractor/0.log" Jun 15 06:40:30.645821 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:30.645792 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-qsglc_de47fdb6-e25e-45a4-9182-5073d048696a/s3-init/0.log" Jun 15 06:40:30.662329 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:30.662305 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-qsglc_de47fdb6-e25e-45a4-9182-5073d048696a/download-hf-model/0.log" Jun 15 06:40:31.945586 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:31.945557 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j8rxx/perf-node-gather-daemonset-cm65t" Jun 15 06:40:35.196519 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:35.196478 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-djl2t_d4b20d67-802a-4a38-b55a-c98bb9bfa1a0/kube-storage-version-migrator-operator/1.log" Jun 15 06:40:35.197367 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:35.197346 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-djl2t_d4b20d67-802a-4a38-b55a-c98bb9bfa1a0/kube-storage-version-migrator-operator/0.log" Jun 15 06:40:36.137509 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:36.137477 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-224th_d0871a8a-1c3b-473f-8845-dcc783210854/kube-multus-additional-cni-plugins/0.log" Jun 15 06:40:36.161327 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:36.161290 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-224th_d0871a8a-1c3b-473f-8845-dcc783210854/egress-router-binary-copy/0.log" Jun 15 06:40:36.185270 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:36.185241 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-224th_d0871a8a-1c3b-473f-8845-dcc783210854/cni-plugins/0.log" Jun 15 06:40:36.208779 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:36.208758 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-224th_d0871a8a-1c3b-473f-8845-dcc783210854/bond-cni-plugin/0.log" Jun 15 06:40:36.229736 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:36.229706 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-224th_d0871a8a-1c3b-473f-8845-dcc783210854/routeoverride-cni/0.log" Jun 15 06:40:36.250343 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:36.250318 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-224th_d0871a8a-1c3b-473f-8845-dcc783210854/whereabouts-cni-bincopy/0.log" Jun 15 06:40:36.271565 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:36.271540 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-224th_d0871a8a-1c3b-473f-8845-dcc783210854/whereabouts-cni/0.log" Jun 15 06:40:36.640092 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:36.640058 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hbff2_b673936d-2921-478e-b86b-0b5d848874b4/kube-multus/0.log" Jun 15 06:40:36.799502 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:36.799473 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hx8xj_e08f6162-b5b3-4beb-af7c-0b23b0635346/network-metrics-daemon/0.log" Jun 15 06:40:36.834981 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:36.834947 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hx8xj_e08f6162-b5b3-4beb-af7c-0b23b0635346/kube-rbac-proxy/0.log" Jun 15 06:40:37.827227 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:37.827199 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6dj8_6667edff-458f-44e4-b82b-a434ede9a795/ovn-controller/0.log" Jun 15 06:40:37.847577 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:37.847548 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6dj8_6667edff-458f-44e4-b82b-a434ede9a795/ovn-acl-logging/0.log" Jun 15 06:40:37.876258 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:37.876230 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6dj8_6667edff-458f-44e4-b82b-a434ede9a795/kube-rbac-proxy-node/0.log" Jun 15 06:40:37.897530 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:37.897505 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6dj8_6667edff-458f-44e4-b82b-a434ede9a795/kube-rbac-proxy-ovn-metrics/0.log" Jun 15 06:40:37.915958 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:37.915931 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6dj8_6667edff-458f-44e4-b82b-a434ede9a795/northd/0.log" Jun 15 06:40:37.937790 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:37.937760 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6dj8_6667edff-458f-44e4-b82b-a434ede9a795/nbdb/0.log" Jun 15 06:40:37.960033 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:37.960007 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6dj8_6667edff-458f-44e4-b82b-a434ede9a795/sbdb/0.log" Jun 15 06:40:38.002606 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:38.002573 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6dj8_6667edff-458f-44e4-b82b-a434ede9a795/ovnkube-controller/0.log" Jun 15 06:40:39.256494 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:39.256453 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-twc9d_7087d934-a825-4c23-9848-4742b1151be7/network-check-target-container/0.log" Jun 15 06:40:40.323373 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:40.323333 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-kspwz_09340711-a3a9-4ef3-b0fb-e57e83099d88/iptables-alerter/0.log" Jun 15 06:40:41.058301 ip-10-0-132-4 kubenswrapper[2586]: I0615 06:40:41.058269 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-84c6n_b881a9c5-0572-4255-b8f8-63cb06d5c107/tuned/0.log"